Quantifying Information Gain in Infinite Space

For my machine learning, info, and search class, I decided to solve the following problem of how to measure the Information Costs of Choosing a Subset of an Infinite Range. To define the problem, we assume that our space of interest and uncountable, such as the real line. If we pick a finite interval, the overarching question is how do we quantify information gain in this situation?