[PDS] Probability in Finance – Key Ideas: III
When we do elementary probability, one of the most common setup used is the cointoss game with the outcomes being or . While it remains one of the most useful thought experiments to think systematically about chance, with the abstract outcomes as “” and ““, there is not much one can do with that.
For example, if one were to toss the coin many times it would be good to get a sense of “expected outcome” and “variations” in outcome from the cointoss game. But with the abstract sample space such as and , it is not possible to do so.
From elementary probability, however, we also know how to get around that. The way is to assign the abstract outcomes and some numbers. Say, whenever comes, assign the number to it, and whenever comes assign the number to it. This way, because the abstract outcomes have been converted to numbers, one can now do math with it and find things like “expectations” and “variance” of outcomes. And these are useful things to have, as they help to summarize more complex experiments/models.
Mathematically, one can think of assigning numbers to abstract outcomes as “carrying out a function” – that of mapping abstract outcomes to “real” numbers. It turns out there is a name for this kind of “function”. Mathematicians call it random variable. (Yes, “variable” is perhaps not the the best word for “carrying out a function”, but that’s how it is for historical reasons, and we have to live with it.)
In the world of Lebesgue measure that we have been considering, it turns out random variables in probability are just an example of what are called measurable functions .
…
Random Variables
If the sample space is known, knowing all possible numbers associated with an experiment (random variables) is equivalent to knowing the field, the converse, however, does not hold. That is, while assigning numbers to outcomes of experiments is useful, knowing just the random variables associated with an experiment is not the same as knowing the field. Consider the following examples.
Example 1 (Cointoss): The associated sample space and field are respectively and . Let random variable assign numbers to outcomes of a single coin toss game such that and . Knowing the value of the random variable in this case is enough to tell us about everything about the underlying game.
Example 2 (Dietoss): The associated sample space is and the associated field is . Let random variable assign numbers to outcomes of the dietoss outcome such that if the outcome is odd numbered, the random variable assigns the value to it and otherwise. That is, the random variable is such that and . Clearly, knowing the value of the random variable in this case is simply not enough to tell us about the underlying experiment, because there is no way to distinguish between, for example, outcomes and . The random variable is just too “coarse”.
Not only that, random variables and are indistinguishable from each other. If only random variables are reported there is no way to know if the underlying experiment is a cointoss game or a dietoss game.
That said, in both examples, however, one thing is clear – values of the random variables must correspond to some elements in the field. This is the idea behind “measurability” – that random variable values must correspond to “something that can happen” (Englishspeak for members of the field).
Now we are ready to introduce the idea of random variables and measurability more formally.
…
Random Variables as LebesgueMeasurable Functions
Measurable Functions: Definition
Given a measurable set , a function is said to be measurable if for any interval :
That is, a function is measurable if it’s inverse image belongs to the collection of Lebesguemeasurable subsets of . Put simply, a measurable (“nice”) function is one which is obtained from a measurable (“nice”) set.
In probability, instead of , as mentioned earlier, typically we encounter Borelmeasurable sets. So if , we call as a Borelmeasurable, or simply a Borel function.
Random Variables: Definition
Random variable is a Lebesguemeasurable function such that given a probability space , and an interval :
What this says is that random variable are obtained from sets that belong to the field – or alternatively, values of a random variable are obtained by assigning numbers to “all possible things that may happen in a game” (Englishspeak for subsets/elements of field ) – of course, this is simply the act of assigning numbers to abstract outcomes as in the examples above. This definition formalizes this notion.
When there is no confusion about the underlying field , Lebesguemeasurable functions are simply often referred to as measurable.
…
field Generated by Random Variables
The fact that random variables can often be “coarse” (like assigning only odd/even numbers to outcomes of the dietoss) gives rise to the notion of field associated with a random variable.
field associated with a random variable is the collection of subsets that can be identified by the random variable. So for the random variable described above, field generated by would be – that is, the random variable can only identify outcomes upto whether they are odd or even numbers.
We can make this idea more formal by technically defining the notion of field generated by a random variable.
field Generated by a Random Variable: Definition
Given a probability space and a random variable , the family of sets such that for some :
is a field; where is a Borel field.
In Englishspeak field generated by a random variable is the smallest subset of (i.e. the smallest field) that describes the random variable.
The last piece of formalization we need now is to describe systematically the probabilities associated with different values of the random variable.
…
Probability Distribution
Probability distribution of a random variable is the probability of elements in the field generated by the random variable. (Remember that probabilities are assigned to events and not directly to random variables. So, probability of random variable taking some value or lying in a certain interval must correspond to some events in the field.)
Consider the random variable in our example above. The field generated by it is , and the probability associated with those are , i.e. probability when the random variable takes the value , , and
It turns out one can summarize the distribution of these probabilities associated with different values taken by the random variable simply as:
where is any member of the Borel field .
For the random variable , then we can use this concise definition to again write the distribution of probabilities associated with values taken by the random variable as:

If the Borel set containes both and :

If the Borel set containes neither and :

If the Borel set containes only but not :

If the Borel set containes only but not :
which is what we argued intuitively.
[PS: Definitions above taken from Capinski and Kopp]
[…] defined random variables using the measuretheoretic language, to complete the basic setup we can now define familiar […]
[PDS] Probability in Finance – Key Ideas: IV  Back of the Envelope
March 7, 2013 at 1:52 pm