1. 1
Module 2
Random Variable and Its Distribution
1. Random Variable
Let ሺߗ, ℱ, ܲሻ be a probability space. On many occasions we may not be directly interested in
the whole sample space ߗ. Rather we may be interested in some numerical characteristic of the
sample space ߗ, as the following example illustrates.
Example 1.1
Let three distinguishable dice be labeled as ,ܣ ܤ and .ܥ Consider the random experiment of
rolling these three dice. Then the sample space is ߗ = ൛ሺ݅, ݆, ݇ሻ: ݅, ݆, ݇ ∈ ሼ1, 2, … ,6ሽൟ; here an
outcome ሺ݅, ݆, ݇ሻ ∈ ߗ indicates that the dice ,ܣ ,ܤ and ܥ show, respectively, ݅, ݆ and ݇ number
of dots on their upper faces. Suppose that our primary interest is on the study of random
phenomenon of sum of number of dots on the upper faces of three dice. Here we are primarily
interested in the study of the function ܺ: ߗ → ℝ, defined by
ܺ൫ሺ݅, ݆, ݇ሻ൯ = ݅ + ݆ + ݇, ሺ݅, ݆, ݇ሻ ∈ ߗ. ▄
Moreover, generally, the sample space ߗ is quite abstract and thus may be tedious to deal with.
In such situations it may be convenient to study the probability space ሺߗ, ℱ, ܲሻ through the
study of a real-valued function defined on ߗ.
Example 1.2
Consider the random experiment of tossing a fair coin twice. Here the sample space ߗ =
ሼHH, HT, TH, TTሽ, where H and T stand for head and tail respectively and in an outcome (e.g.,
HT) the first letter (e.g., H in HT) indicates the result of the first toss and the second letter (e.g.,
T in HT) indicates the result of the second toss. Since we are more comfortable in dealing with
real numbers it may be helpful to identify various outcomes in ߗ with different real numbers
(e.g., identify HH, HT, TH and TT with 1, 2, 3 and 4 respectively). This amounts to defining a
function ܺ: ߗ → ℝ on the sample space (e.g., ܺ: ߗ → ℝ, defined as ܺሺHHሻ = 1, ܺሺHTሻ = 2,
ܺሺTHሻ = 3, and ܺሺTTሻ = 4ሻ. ▄
The above discussion suggests the desirability of study of real valued functions ܺ: ߗ → ℝ
defined on the sample space ߗ.
Consider a function ܺ: ߗ → ℝ defined on the sample space ߗ.Since the outcomes ሺin ߗሻ of the
random experiment cannot be predicted in advance the values assumed by the function ܺ are
2. 2
also unpredictable. It may be of interest to compute the probabilities of various events
concerning the values assumed by function ܺ. Specifically, it may be of interest to compute the
probability that the random experiment results in a value of ܺ in a given set ܤ ⊆ ℝ. This
amounts to assigning probabilities,
ܲሺܤሻ ≝ ܲሺሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽሻ, ܤ ⊆ ℝ,
to various subsets of ℝ. Note that, for B ⊆ ℝ, ܲሺܤሻ = ܲሺሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽሻ is properly
defined only if ሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽ ∈ ℱ. This puts restrictions on kind of functions ܺ and/or
kind of sets ܤ ⊆ ℝ we should be considering. An approach to deal with this issue is to
appropriately choose an event space (a sigma-field) ℬ of subsets of ℝand then put restriction(s)
on the function ܺ so that ܲሺܤሻ = ܲሺሼ߱ ∈ ߗ ∶ ܺሺ߱ሻ ∈ ܤሽሻ is properly defined for each ܤ ∈
ℬ, i. e. , ሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽ ∈ ℱ, ∀ܤ ∈ ℬ.
Let ࣪ሺℝሻ and ࣪ሺߗሻ denote the power sets of ℝ and ߗ, respectively. Define ܺିଵ
: ࣪ሺℝሻ →
࣪ሺߗሻ by
ܺିଵሺܤሻ = ሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽ, ܤ ∈ ࣪ሺℝሻ.
The following proposition, which follows directly from the definition of ܺିଵ
, will be useful for
further discussion (see Problem 2).
Lemma 1.1
Let ,ܣ ܤ ∈ ࣪ሺℝሻ and let ܣ ∈ ࣪ሺℝሻ, α ∈ ߉, where ߉ ⊆ ℝ is an arbitrary index set. Then
(i) ܺିଵሺܣ − ܤሻ = ܺିଵሺܣሻ − ܺିଵሺܤሻ. In particular ܺିଵሺܤሻ = ൫ܺିଵሺܤሻ൯
;
(ii) ܺିଵሺ⋃ ܣఈఈ ∈ ௸ ሻ = ⋃ ܺିଵ
ఈ ∈ ௸ ሺܣఈሻ and ܺିଵሺ⋂ ܣఈఈ ∈ ௸ ሻ = ⋂ ܺିଵ
ఈ ∈ ௸ ሺܣఈሻ;
(iii) ܣ ∩ ܤ = ߶ ⇒ ܺିଵሺܣሻ ∩ ܺିଵሺܤሻ = ߶. ▄
Let ࣤ denote the class of all open intervals in ℝ, i.e., ࣤ= ሼሺܽ, ܾሻ: −∞ ≤ ܽ < ܾ ≤ ∞ሽ. In the real
line ℝ an appropriate event space is the Borel sigma-field ℬଵ = ߪሺࣤሻ, the smallest sigma-field
containing ࣤ. Now, for ܲሺܤሻ = ܲሺሼ߱ ∈ ℝ: ܺሺ߱ሻ ∈ ܤሽሻ to be properly defined for every Borel
set ܤ ∈ ℬଵ, we must have
ܺିଵሺܤሻ = ሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽ ∈ ℱ, ∀ ܤ ∈ ℬଵ.
This leads to the introduction of the following definition.
Definition 1.1
Let ሺߗ, ℱ, ܲሻ be a probability space and let ܺ: ߗ → ℝ be a given function. We say that ܺ is a
random variable (r.v.) if ܺିଵሺܤሻ ∈ ℱ, ∀ ܤ ∈ ℬଵ. ▄
3. 3
Note that if ℱ = ࣪ሺߗሻ then any function ܺ: ߗ → ℝ is a random variable. The following theorem
provides an easy to verify condition for checking whether or not a given function ܺ: ߗ → ℝ is a
random variable.
Theorem 1.1
Let ሺߗ, ℱ, ܲሻ be a probability space and let ܺ: ߗ → ℝ be a given function. Then ܺ is a random
variable if, and only if, ܺିଵሺሺ−∞, ܽ]ሻ = ሼ߱ ∈ ߗ: ܺሺ߱ሻ ≤ ܽሽ ∈ ℱ, ∀ ܽ ∈ ℝ.
Proof. First suppose that ܺ is a random variable. Then ܺିଵሺܤሻ ∈ ℱ, ∀ ܤ ∈ ℬଵ and, in particular
ܺିଵ
ሺሺܿ, ݀ሻሻ ∈ ℱ, whenever −∞ ≤ ܿ < ݀ ≤ ∞ (since ࣤ ⊆ ℬଵ).
Fix ܽ ∈ ℝ. Then ሺ−∞, ܽሻ = ⋃ ቀ−݊, ܽ −
ଵ
ቁஶ
ୀଵ and ሼܽሽ = ⋂ ቀܽ −
ଵ
, ܽ +
ଵ
ቁஶ
ୀଵ . Therefore
ሺ−∞, ܽ] = ሺ−∞, ܽሻ ∪ ሼܽሽ
= ൭ራ ൬−݊, ܽ −
1
݊
൰
ஶ
ୀଵ
൱ ∪ ൭ሩ ൬ܽ −
1
݊
, ܽ +
1
݊
൰
ஶ
ୀଵ
൱ .
Now using Lemma 1.1 (ii), it follows that
ܺିଵሺሺ−∞, ܽ]ሻ = ሺራ ܺିଵ
ሺ൬−݊, ܽ −
1
݊
൰ሻ
ᇣᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇥ
ሻ
∈ ℱ,∀ஹଵ
ஶ
ୀଵ
ᇣᇧᇧᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇧᇧᇥ
∈ ℱ
∪ ሺሩ ܺିଵ
ሺ൬ܽ −
1
݊
, ܽ +
1
݊
൰ሻ
ᇣᇧᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇧᇥ
ሻ
∈ ℱ,∀ஹଵ
ஶ
ୀଵ
ᇣᇧᇧᇧᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇧᇧᇧᇥ
∈ ℱ
ᇣᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇥ
∈ ℱ
i.e., ܺିଵሺሺ−∞, ܽ]ሻ ∈ ℱ.
Conversely suppose that ܺିଵሺሺ−∞, ܽ]ሻ ∈ ℱ, ∀ ܽ ∈ ℝ . Then, for −∞ ≤ ܿ < ݀ ≤ ∞,
ሺ−∞, ݀ሻ = ⋃ ቀ−∞, ݀ −
ଵ
ቁஶ
ୀଵ , and
ܺିଵ
൫ሺܿ, ݀ሻ൯ = ܺିଵሺሺ−∞, ݀ሻሻ − ሺሺ−∞, ܿ]ሻ
= ܺିଵሺሺ−∞, ݀ሻሻ − ܺିଵሺሺ−∞, ܿ]ሻ ሺusing Lemma 1.1 ሺiሻሻ
= ܺିଵ
൭ራሺ−∞, ݀ −
1
݊
]
ஶ
ୀଵ
൱ − ܺିଵ
ሺሺ−∞, ܿ]ሻ
= ራ ܺିଵ
ሺሺ−∞, ݀ −
1
݊
]ሻ
ᇣᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇥ
∈ ℱ,∀ஹଵ
ஶ
ୀଵ
ᇣᇧᇧᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇧᇧᇥ
∈ ℱ
− ܺିଵ
ሺሺ−∞, ܿ]ሻ ᇣᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇥ
∈ ℱ
ᇣᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇤᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇧᇥ
∈ ℱ
4. 4
⇒ ܺିଵሺܫሻ ∈ ℱ, ∀ ܫ ∈ ࣤ. ሺ1.1ሻ
Define,
ࣞ = ሼܣ ⊆ ℝ: ܺିଵሺܣሻ ∈ ℱሽ.
Using Lemma 1.1 it is easy to verify that ࣞ is a sigma-field of subsets of ℝ. Thus ࣞ = σሺࣞሻ.
Using (1.1) we have ࣤ ⊆ ࣞ = σሺࣞሻ, i.e., ࣤ ⊆ σሺࣞሻ. This implies that σ ሺࣤሻ ⊆ σሺࣞሻ = ࣞ, i.e.,
ℬଵ ⊆ ࣞ. Consequently ܺିଵሺܤሻ ∈ ℱ, ∀ܤ ∈ ℬଵ, i.e., ܺ is a random variable. ▄
The following theorem follows on using the arguments similar to the ones used in proving
Theorem 1.1.
Theorem 1.2
Let ሺߗ, ℱ, ܲሻ be a probability space and let ܺ: ߗ → ℝ be a given function. Then ܺ is a random
variable if, an only if, one of the following equivalent conditions is satisfied.
(i) ܺିଵሺሺ−∞, ܽሻሻ ∈ ℱ, ∀ ܽ ∈ ℝ;
(ii) ܺିଵሺሺܽ, ∞ሻሻ ∈ ℱ, ∀ ܽ ∈ ℝ;
(iii) ܺିଵሺ[ܽ, ∞ሻሻ ∈ ℱ, ∀ ܽ ∈ ℝ;
(iv) ܺିଵሺሺܽ, ܾ]ሻ ∈ ℱ, whenever −∞ ≤ ܽ < ܾ < ∞;
(v) ܺିଵሺ[ܽ, ܾሻሻ ∈ ℱ, whenever −∞ < ܽ < ܾ ≤ ∞;
(vi) ܺିଵሺሺܽ, ܾሻሻ ∈ ℱ, whenever −∞ ≤ ܽ < ܾ ≤ ∞. ▄
2. Induced Probability Measure
Let ሺߗ, ℱ, ܲሻ be a probability space and let ܺ: ߗ → ℝ be a random variable. Define the set
function ܲ: ℬଵ → ℝ, by
ܲሺܤሻ = ܲ൫ܺିଵሺܤሻ൯ = ܲሺሼ߱ ∈ ℝ: ܺ ሺ߱ሻ ∈ ܤሽሻ, ܤ ∈ ℬଵ,
where ℬଵ denotes the Borel sigma-field.
Since ܺ is a r.v., ܺିଵሺܤሻ ∈ ℱ, ∀ ܤ ∈ ℬଵ and, therefore, ܲ is well defined.
Theorem 2.1
ሺℝ, ℬଵ, ܲሻ is a probability space.
Proof. Clearly,
ܲሺܤሻ = ܲ൫ܺିଵሺܤሻ൯ ≥ 0, ∀ ܤ ∈ ℬଵ.
5. 5
Let ܤଵ, ܤଶ, ⋯ be a countable collection of mutually exclusive events ൫ܤ ∩ ܤ = ߶, if ݅ ≠ ݆൯ in
ℬଵ. Then ܺିଵሺܤଵሻ, ܺିଵሺܤଶሻ, ⋯ is a countable collection of mutually exclusive events in ℱ
(Lemma 1.1 (iii)). Therefore
ܲ ൭ራ ܤ
ஶ
ୀଵ
൱ = ܲ ቌܺିଵ
൭ራ ܤ
ஶ
ୀଵ
൱ቍ
= ܲ ቌራ ܺିଵ
ஶ
ୀଵ
ሺܤሻቍ ሺusing Lemma 1.1 ሺiiሻሻ
= ܲ
ஶ
ୀଵ
ቀܺ−1
ሺܤ݅ሻቁ
= ܲ
ஶ
ୀଵ
ሺܤ݅ሻ,
i.e., ܲ is countable additive.
We also have
ܲሺℝሻ = ܲ൫ܺିଵሺℝሻ൯ = ܲሺߗሻ = 1.
It follows that ܲ is a probability measure on ℬଵ, i.e., ሺℝ, ℬଵ, ܲሻ is a probability space. ▄
Definition 2.1
Letሺߗ, ℱ, ܲሻ be a probability space and let ܺ: ߗ → ℝ be a r.v.. Let ܲ: ℬଵ → ℝ be defined by
ܲሺܤሻ = ܲ൫ܺିଵሺܤሻ൯, ܤ ∈ ℬଵ. The probability space ሺℝ, ℬଵ, ܲሻ is called the probability space
induced by ܺ and ܲ is called the probability measure induced by ܺ. ▄
Our primary interest now is in the induced probability space ሺℝ, ℬଵ, ܲሻ rather than the original
probability space ሺߗ, ℱ, ܲሻ.
Example 2.1
(i) Suppose that a fair coin is independently flipped thrice. With usual interpretations of
the outcomes HHH, HHT, …, the sample space is
ߗ = ሼHHH, HHT, HTH, HTT, THH, THT, TTH, TTTሽ.
6. 6
Since ߗ is finite we shall take ℱ = ࣪ሺߗሻ. The relevant probability measure ܲ: ℱ → ℝ is
given by
ܲሺܣሻ =
||ܣ
8
, ܣ ∈ ℱ,
where||ܣ denotes the number of elements in ܣ.Suppose that we are primarily
interested in the number of times a head is observed in three flips, i.e., suppose that our
primary interest is on the function ܺ: ߗ → ℝ defined by
ܺሺ߱ሻ = ൞
0, if ߱ = TTT
1, if ߱ ∈ ሼHTT, THT, TTHሽ
2, if ߱ ∈ ሼHHT, HTH, THHሽ
3, if ߱ = HHH
.
Since ℱ = ࣪ሺߗሻ, any function ܻ: ߗ → ℝ is a random variable. In particular the function
ܺ: ߗ → ℝ defined above is a random variable. The probability space induced by r.v. ܺ is
ሺℝ, ℬଵ, ܲሻ, where ܲሺሼ0ሽሻ = ܲሺሼ3ሽሻ =
ଵ
଼
, ܲሺሼ1ሽሻ = ܲሺሼ2ሽሻ =
ଷ
଼
, and
ܲሺBሻ = ܲሺሼ݅ሽሻ
∈ ሼ,ଵ,ଶ,ଷሽ∩
, ܤ ∈ ℬଵ.
(ii) Consider the probability space ሺℝ, ℬଵ, ܲሻ, where
ܲሺܣሻ = න ݁ି௧
Iሺݐሻ ݀ݐ
ஶ
= න ݁ି௧
ܫ∩[,ஶሻሺݐሻ ݀ݐ
ஶ
ିஶ
,
and, for ܤ ⊆ ℝ, ܫሺ∙ሻ denotes the indicator function of ܤሺi. e., ܫሺݐሻ = 1, if ݐ ∈ ,ܤ =
0, if ݐ ∉ ܤሻ. It is easy to verify that ܲ is a probability measure on ℬଵ.
Define ܺ: ℝ → ℝ by
ܺሺ߱ሻ = ൜√߱, if ߱ > 0
0, if ߱ ≤ 0
.
We have
ܺିଵሺሺ−∞, a]ሻ = ൜
߶, if ܽ < 0
ሺ−∞, aଶ
], if ܽ ≥ 0
∈ ℬଵ.
7. 7
Thus ܺ is a random variable. The probability space induced by ܺ is ሺℝ, ℬଵ, ܲሻ, where,
for ܤ ∈ ℬଵ
ܲሺܤሻ = ܲሺሼ߱ ∈ ℝ: ܺሺ߱ሻ ∈ ܤሽሻ
= ܲ൫൛߱ ∈ ℝ: ߱ > 0, √߱ ∈ ܤൟ൯ + ܲሺሼ߱ ∈ ℝ: ߱ ≤ 0, 0 ∈ ܤሽሻ
= න ݁ି ௧
ܫ൫√ݐ൯݀ݐ + 0
ஶ
= 2 න ݁ݖିమ
ܫሺݖሻ݀.ݖ
ஶ
▄
3. Distribution Function and Its Properties
Let ሺߗ, ℱ, ܲሻ be a probability space and let ܺ: ߗ → ℝ be a r.v. so that ܺିଵሺሺ−∞, a]ሻ =
ሼ߱ ∈ ℝ: ܺሺ߱ሻ ≤ ܽሽ ∈ ℱ, ∀ ܽ ∈ ℝ. Throughout we will use the following notation:
ሼa statement ሺsay Sሻ about ܺሽ = ሼ߱ ∈ ߗ: statement S holdsሽ,
e. g.,
ሼܽ < ܺ ≤ ܾሽ ≝ ሼ߱ ∈ ߗ: ܽ < ܺሺ߱ሻ ≤ ܾሽ ≝ ܺିଵሺሺa, b]ሻ, −∞ ≤ ܽ < ܾ < ∞
ሼܺ = ܿሽ ≝ ሼ߱ ∈ ߗ: ܺሺ߱ሻ = ܿሽ ≝ ܺିଵሺሼcሽሻ, c ∈ ℝ,
ሼܺ ∈ ܤሽ ≝ ሼ߱ ∈ ߗ: ܺሺ߱ሻ ∈ ܤሽ ≝ ܺିଵሺܤሻ, ܤ ∈ ℬଵ,
ሼܺ ≤ cሽ ≝ ሼ߱ ∈ ߗ: ܺሺ߱ሻ ≤ ܿሽ ≝ ܺିଵሺሺ−∞, c]ሻ, c ∈ ℝ.
Definition 3.1
The function ܨ: ℝ → ℝ, defined by,
ܨሺݔሻ = ܲሺሼܺ ≤ ݔሽሻ = ܲሺሺ−∞, ]ݔሻ, ݔ ∈ ℝ,
is called the distribution function (d.f.) of random variable ܺ. ▄
Example 3.1
(i) Let us revisit Example 2.1 (i). The induced probability space is ሺℝ, ℬଵ, ܲሻ, where
ܲሺሼ0ሽሻ = ܲሺሼ3ሽሻ =
ଵ
଼
, ܲሺሼ1ሽሻ = ܲሺሼ2ሽሻ =
ଷ
଼
and
ܲሺܤሻ = ܲሺሼܺ ∈ ܤሽሻ
8. 8
= ܲሺሼ݅ሽሻ
∈ ሼ,ଵ,ଶ,ଷሽ∩
, ܤ ∈ ࣜଵ.
Clearly, for ݔ ∈ Թ,
ܨሺݔሻ ൌ ܲሺሼܺ ݔሽ ሻ
ൌ ܲሺሺെ∞, ݔሿ ሻ
ൌ ܲܺሺሼ݅ሽሻ
݅ ∈ ሼ0,1,2,3ሽ∩ሺିஶ,௫ሿ
ൌ
ە
ۖ
ۖ
۔
ۖ
ۖ
ۓ
0, if ݔ ൏ 0
1
8
, if 0 ݔ ൏ 1
1
2
, if 1 ݔ ൏ 2
7
8
, if 2 ݔ ൏ 3
1, if ݔ 3
Figure 3.1. Plot of distribution function ܨሺݔሻ
Note that ܨሺݔሻ is non-decreasing, right continuous, ܨሺെ∞ሻ ≝ lim௫→ିஶ ܨሺݔሻ ൌ 0
and ܨሺ∞ሻ ≝ lim௫→ஶ ܨሺݔሻ ൌ 1. Moreover ܨሺݔሻ is a step function having
discontinuities at points 0, 1, 2 and 3.
9. 9
(ii) Consider Example 2.1 (ii). The probability space induced by r.v. ܺ is (Թ, ℬଵ, ܲ),
where, for ܤ ∈ ℬଵ,
ܲሺܤሻ = 2 න ݖ
ஶ
݁ି௭మ
ܫሺݖሻ݀.ݖ
Therefore,
ܨሺݔሻ = ܲሺሼܺ ≤ ݔሽ ሻ
= ܲሺሺ−∞, ]ݔሻ
= 2 න ݖ
∞
0
݁−ݖ2
ܫሺିஶ,௫]ሺݖሻ݀,ݖ ݔ ∈ ℝ.
Clearly, for ݔ < 0, ܨሺݔሻ = 0. For ݔ ≥ 0
ܨሺݔሻ = 2 න ݖ
௫
݁ି௭మ
݀ݖ = 1 − ݁ି௫మ
.
Thus,
ܨሺݔሻ = ൜
0, if ݔ < 0
1 − ݁ି௫మ
, if ݔ ≥ 0
.
Note that ܨሺݔሻ is non-decreasing, continuous, ܨሺ−∞ሻ = lim௫→ିஶ ܨሺݔሻ = 0 and
ܨሺ∞ሻ = lim௫→ ஶ ܨሺݔሻ = 1. ▄
Now we will derive various properties of a distribution function. The following lemma, whose
proof is immediate and can be found in any standard text book on calculus, will be useful in
studying the properties of a distribution function.
Lemma 3.1
Let −∞ ≤ ܽ < ܾ ≤ ∞ and let ݂: ሺܽ, ܾሻ → ℝ be a non-decreasing functionሺi. e. , ݂ሺݏሻ ≤ ݂ሺݐሻ,
∀ ܽ < ݏ < ݐ < ܾሻ.
Then
(i) for all ݔ ∈ ሺܽ, ܾ] and ݕ ∈ [ܽ, ܾሻ, ݂ሺݔ −ሻ and ݂ሺݕ +ሻ exist;
(ii) for all ݔ ∈ ሺܽ, ܾሻ, ݂ሺݔ −ሻ ≤ ݂ሺݔሻ ≤ ݂ሺݔ +ሻ;
(iii) for ܽ < ݔ < ݕ < ܾ, ݂ሺ+ݔሻ ≤ ݂ሺ−ݕሻ;
(iv) ݂ has at most countable number of discontinuities;
10. 10
where ݂ሺܿ െሻ and ݂ሺܿ +ሻ denote, respectively, the left hand and right hand limits of the
function ݂ at point ܿ ∈ ሺܽ, ܾሻ. ▄
Theorem 3.1
Let ܨbe the distribution function of a random variable ܺ. Then
(i) ܨ is non-decreasing;
(ii) ܨ is right continuous;
(iii) ܨሺ−∞ሻ ≝ lim୶→ିஶ ܨ ሺݔሻ = 0 and ܨሺ∞ሻ ≝ lim௫→ ஶ ܨ ሺݔሻ = 1.
Proof.
(i) Let −∞ < ݔ < ݕ < ∞ . Then ሺ−∞, ݔ] ⊆ ሺ−∞, ]ݕ and therefore, on using
monotonicity of probability measures, we get
ܨሺݔሻ = ܲ൫ሺ−∞, ݔ]൯ ≤ ܲሺሺ−∞, ]ݕሻ = ܨሺݕሻ.
(ii) Fix ݔ ∈ ℝ. Since ܨ is non-decreasing, it follows from Lemma 3.1 that ܨሺݔ +ሻ
exists. Therefore
ܨሺݔ +ሻ = lim
→ ஶ
ܨ ൬ݔ +
1
݊
൰ = lim
→ ஶ
ܲ ൬ሺ−∞, ݔ +
1
݊
]൰.
Note that ቀ−∞, ݔ +
ଵ
ቃ ↓ and Lim→ ஶ ቀ−∞, ݔ +
ଵ
ቃ = ⋂ ቀ−∞, ݔ +
ଵ
ቃஶ
ୀଵ = ሺ−∞, .]ݔ
Now using continuity of probability measures (Theorem 4.1, Module 1) we have
ܨሺݔ +ሻ = lim
→ ஶ
ܲ ൬ሺ−∞, ݔ +
1
݊
]൰
= ܲ ቀLim
→ ஶ
ሺ−∞, ݔ +
ଵ
]ቁ
= ܲሺሺ−∞, ]ݔሻ
= ܨሺݔሻ.
(iii) Using standard arguments of calculus it follows that ܨሺ−∞ሻ = lim
→ ஶ
ܨሺ−݊ሻ
and ܨሺ∞ሻ = lim
→ ஶ
ܨሺ݊ሻ , where limits are taken along the sequence ሼ݊: ݊ =
1, 2, ⋯ ሽ. Note that ሺ−∞, −݊] ↓, ሺ−∞, ݊] ↑, Lim
→ ஶ
ሺ−∞, −݊] = ⋂ ሺ−∞, −݊]ஶ
ୀଵ = ߶
and Lim
→ ஶ
ሺ−∞, ݊] = ⋃ ሺ−∞, ݊]ஶ
୬ୀଵ = ℝ. Again using the continuity of probability
measures, we get
ܨሺ−∞ሻ = lim
→ ஶ
ܨሺ−݊ሻ = lim
→ ஶ
ܲ൫ሺ−∞, −݊]൯ = ܲ ቀLim
→ ஶ
ሺ−∞, −݊]ቁ = ܲሺ߶ሻ = 0,
and
11. 11
ܨሺ∞ሻ = lim
→ ஶ
ܨሺ݊ሻ = lim
→ ஶ
ܲ൫ሺ−∞, ݊]൯ = ܲ ቀLim
→ ஶ
ሺ−∞, ݊]ቁ = ܲሺℝሻ = 1. ▄
Remark 3.1
(i) Using Lemma-3.1 (i)-(ii) and Theorem 3.1 (i) it follows that for a d.f. ܨ, ܨሺݔ +ሻ and
ܨሺݔ −ሻexist for every ݔ ∈ ℝ and ܨ is discontinuous at ݔ ∈ ℝ if and only if
ܨሺݔ −ሻ < ܨሺݔ +ሻ = ܨሺݔሻ. Consequently a d.f. has only jump discontinuities (a
discontinuity point ݔ ∈ ℝ of ܨis called a jump discontinuity if ܨሺݔ +ሻ and ܨሺݔ −ሻ
exist but ܨሺݔ −ሻ = ܨሺݔ +ሻ = ܨሺݔሻ does not hold). Moreover the size of the jump
at a point ݔ ∈ ℝ of discontinuity is ௫ = ܨሺݔሻ − ܨሺݔ −ሻ.
(ii) Using Lemma 3.1 (iv) and Theorem 3.1 (i) it follows that any d.f. ܨ has atmost
countable number of discontinuities.
(iii) Let ܽ ∈ ℝ . Since ሺ−∞, a −
ଵ
୬
] ↑ and Lim→ஶ ሺ−∞, a −
ଵ
୬
] = ⋃ ሺ−∞, a −
ଵ
୬
] ஶ
ୀଵ =
ሺ−∞, ܽሻ, the continuity of probability measures implies
ܲሺሼܺ < ܽሽሻ = ܲ൫ሺ−∞, ܽሻ൯
= ܲ ቆLim
→ஶ
ሺ−∞, a −
1
n
] ቇ
= lim
→ஶ
ܲ ቆሺ−∞, a −
1
n
] ቇ
= lim
→ஶ
ܨ ൬ܽ −
1
݊
൰
= ܨሺܽ −ሻ.
Therefore,
Pሺሼܺ < ݔሽሻ = ܨሺݔ −ሻ, ∀ ݔ ∈ ℝ.
Also,
ܨሺݔሻ = ܨሺݔ +ሻ ≤ ܨሺݕ −ሻ, ∀ − ∞ < ݔ < ݕ < ∞ ሺusing Lemma 3.1 ሺiiiሻሻ
and
ܲሺሼܺ = ݔሽሻ = ܲሺሼܺ ≤ ݔሽሻ − ܲሺሼܺ < ݔሽሻ = ܨሺݔሻ − ܨሺݔ −ሻ, ∀ ݔ ∈ ℝ.
Thus ܨ is continuous (discontinuous) at a point ݔ ∈ ℝ if, and only if, ܲሺሼܺ = ݔሽሻ =
0 ሺܲሺሼܺ = ݔሽሻ > 0ሻ.
(iv) Let ܦ denote the set of discontinuity points (jump points) of d.f. ܨ. Then ܦ is a
countable set and
[ܨሺݔሻ − ܨሺݔ −ሻ]
௫ ∈
= ܲሺሼܺ = ݔሽሻ
௫ ∈
= ܲሺܦሻ ≤ 1,
12. 12
i.e., the sum of sizes of jumps of a d.f. does not exceed 1.
(v) Let െ∞ < ܽ < ܾ < ∞. Then
ܲሺሼܽ < ܺ ≤ ܾሽሻ = ܲሺሼܺ ≤ ܾሽሻ − ܲሺሼܺ ≤ ܽሽሻ = ܨሺܾሻ − ܨሺܽሻ
ܲሺሼܽ < ܺ < ܾሽሻ = ܲሺሼܺ < ܾሽሻ − ܲሺሼܺ ≤ ܽሽሻ = ܨሺܾ −ሻ − ܨሺܽሻ
ܲሺሼܽ ≤ ܺ < ܾሽሻ = ܲሺሼܺ < ܾሽሻ − ܲሺሼܺ < ܽሽሻ = ܨሺܾ −ሻ − ܨሺܽ−ሻ
ܲሺሼܽ ≤ ܺ ≤ ܾሽሻ = ܲሺሼܺ ≤ ܾሽሻ − ܲሺሼܺ < ܽሽሻ = ܨሺܾሻ − ܨሺܽ −ሻ,
and, for −∞ < ܽ < ∞,
ܲሺሼܺ ≥ ܽሽሻ = 1 − ܲሺሼܺ < ܽሽሻ = 1 − ܨሺܽ −ሻ,
and ܲሺሼܺ > ܽሽሻ = 1 − ܲሺሼܺ ≤ ܽሽሻ = 1 − ܨሺܽሻ. ▄
We state the following theorem without providing the proof. The theorem essentially states
that any function :ܩ ℝ → ℝ that is non-decreasing and right continuous with ܩሺ−∞ሻ =
lim௫→ିஶ ܩሺݔሻ = 0 and ܩሺ∞ሻ = lim௫→ஶ ܩሺݔሻ = 1 can be regarded as d.f. of a random variable.
Theorem 3.2
Let :ܩ ℝ → ℝ be a non-decreasing and right continuous function for which ܩሺ−∞ሻ = 0 and
ܩሺ∞ሻ = 1. Then there exists a random variable ܺ defined on a probability space ሺߗ, ℱ, ܲሻ such
that the distribution function of ܺ is .ܩ ▄
Example 3.2
(i) Consider a function:ܩ ℝ → ℝ, defined by,
ܩሺݔሻ = ൜
0, if ݔ < 0
1 − ݁ି௫
, if ݔ ≥ 0
.
13. 13
Figure 3.2. Plot of distribution function ܩሺݔሻ
Clearly ܩis non-decreasing, continuous and satisfies ܩሺെ∞ሻ ൌ 0 and ܩሺ∞ሻ ൌ 1.
Therefore G can be treated as d.f. of some r.v., say ܺ. Since ܩ is continuous we have
ܲሺሼܺ ൌ ݔሽሻ ൌ ܩሺݔሻ െ ܩሺݔ െሻ ൌ 0, ∀ ݔ ∈ Թ,
and, for െ∞ ൏ ܽ ൏ ܾ ൏ ∞,
ܲሺሼܽ ൏ ܺ ൏ ܾሽሻ ൌ ܲሺሼܽ ܺ ൏ ܾሽሻ ൌ Pሺܽ ܺ ܾሻ ൌ ܲሺሼܽ ൏ ܺ ܾሽሻ
ൌ ܩሺܾሻ െ Gሺaሻ.
Moreover, for െ∞ ൏ ܽ ൏ ∞,
ܲሺሼܺ ܽሽሻ ൌ ܲሺሼܺ ܽሽሻ ൌ 1 െ ܩሺܽሻ
and
ܲሺሼܺ ൏ ܽሽሻ ൌ ܲሺሼܺ ܽሽሻ ൌ ܩሺܽሻ.
In particular
ܲሺሼ2 ൏ ܺ 3ሽሻ ൌ ܩሺ3ሻ െ ܩሺ2ሻ ൌ ݁ିଶ
െ ݁ିଷ
;
ܲሺሼെ2 ൏ ܺ 3ሽሻ ൌ ܩሺ3ሻ െ ܩሺെ2ሻ ൌ 1 െ ݁ିଷ
;
ܲሺሼ1 ܺ ൏ 4ሽሻ ൌ ܩሺ4ሻ െ ܩሺ1ሻ ൌ ݁ିଵ
െ ݁ିସ
;
ܲሺሼ5 ܺ ൏ 8ሽሻ ൌ ܩሺ8ሻ െ ܩሺ5ሻ ൌ ݁ିହ
െ ݁ି଼
;
ܲሺሼܺ 2ሽሻ ൌ 1 െ ܩሺ2ሻ െ ݁ିଶ
;
14. 14
and
ܲሺሼܺ 5ሽሻ ൌ 1 െ ܩሺ5ሻ ൌ ݁ିହ
.
Note that the sum of sizes of jumps of ܩ is 0.
(ii) Let :ܪ Թ → Թ be given by
ܪሺݔሻ ൌ
ە
ۖۖ
۔
ۖۖ
ۓ
0, if ݔ ൏ 0
௫
ସ
, if 0 ݔ ൏ 1
௫
ଷ
if 1 ݔ ൏ 2
ଷ௫
଼
if 2 ݔ ൏
ହ
ଶ
1, if ݔ
ହ
ଶ
.
Figure 3.3. Plot of distribution function ܪሺݔሻ
Clearly ܪ is non-decreasing, right continuous and satisfies ܪሺെ∞ሻ ൌ 0 and
ܪሺ∞ሻ ൌ 1 . Therefore ܪ can be treated as d.f. of some r.v., say ܻ .
ܪis continuous everywhere except at points 1, 2, and 5/2 where it has jump
discontinuities with jumps of sizes ܲሺሼܻ ൌ 1ሽሻ ൌ ܪሺ1ሻ െ ܪሺ1 െሻ ൌ 1/
12, ܲሺሼܻ ൌ 2ሽሻ ൌ ܪሺ2ሻ െ ܪሺ2 െሻ ൌ 1/12 and ܲሺሼܻ ൌ 5/2ሽሻ ൌ ܪሺ5/2ሻ െ
ܪሺ5/2െሻ ൌ 1/16. Moreover for ݔ ∈ Թ െ ሼ1, 2, 5/2ሽ, ܲሺሼܻ ൌ ݔሽሻ ൌ 0. We also
have
ܲ ൬൜1 ൏ ܻ
5
2
ൠ൰ ൌ ܪ ൬
5
2
൰ െ ܪሺ1ሻ ൌ 1 െ
1
3
ൌ
2
3
;
15. 15
ܲ ൬൜1 ൏ ܻ ൏
5
2
ൠ൰ ൌ ܪ ൬
5
2
െ൰ െ ܪሺ1ሻ ൌ
15
16
െ
1
3
ൌ
29
48
;
ܲ ቀቄ1 ܻ ൏
ହ
ଶ
ቅቁ ൌ ܪ ቀ
ହ
ଶ
െቁ െ ܪሺ1 െሻ ൌ
ଵହ
ଵ
െ
ଵ
ସ
ൌ
ଵଵ
ଵ
;
ܲሺሼെ2 ܻ ൏ 1ሽሻ ൌ ܪሺ1 െሻ െ ܪሺെ2 െሻ ൌ
ଵ
ସ
െ 0 ൌ
ଵ
ସ
;
ܲሺሼܻ 2ሽሻ ൌ 1 െ ܪሺ2 െሻ ൌ 1 െ
2
3
ൌ
1
3
;
and ܲሺሼܻ 2ሽሻ ൌ 1 െ ܪሺ2ሻ ൌ 1 െ
ଷ
ସ
ൌ
ଵ
ସ
∙
Note that sum of sizes of jumps of ܪ is 11/48 ∈ ሺ0, 1ሻ.
(iii) Let :ܨ Թ → Թ be given by
ܨሺݔሻ ൌ
ە
ۖ
ۖ
ۖ
۔
ۖ
ۖ
ۖ
ۓ
0, if ݔ ൏ 0
ଵ
଼
, if 0 ݔ ൏ 2
ଵ
ସ
if 2 ݔ ൏ 3
ଵ
ଶ
if 3 ݔ ൏ 6
ସ
ହ
, if 6 ݔ ൏ 12
଼
, if 12 ݔ ൏ 15
1, if ݔ 15
.
Figure 3.4. Plot of distribution function ܨሺݔሻ
16. 16
As ܨ is non-decreasing and right continuous with ܨሺെ∞ሻ = 0 and ܨሺ∞ሻ = 1, it can
be regarded as d.f. of some r.v., say ܼ. Clearly, except at points 0, 2, 3, 6, 12 and 15,
ܨ is continuous at all other points and at discontinuity points 0, 2, 3, 6 ,12 and15 it
has jump discontinuities with jumps of sizes
ܲሺሼܼ = 0ሽሻ = ܨሺ0ሻ − ܨሺ0 −ሻ =
1
8
,
ܲሺሼܼ = 2ሽሻ = ܨሺ2ሻ − ܨሺ2 −ሻ =
1
8
,
ܲሺሼܼ = 3ሽሻ = ܨሺ3ሻ − ܨሺ3 −ሻ =
1
4
,
ܲሺሼܼ = 6ሽሻ = ܨሺ6ሻ − ܨሺ6 −ሻ =
3
10
,
ܲሺሼܼ = 12ሽሻ = ܨሺ12ሻ − ܨሺ12 −ሻ =
3
40
,
and
ܲሺሼܼ = 15ሽሻ = ܨሺ15ሻ − ܨሺ15 −ሻ =
1
8
.
Moreover ܲሺሼܼ = ݔሽሻ = ܨሺݔሻ = ܨሺݔ −ሻ = 0, ∀ ݔ ∈ ℝ − ሼ0, 2, 3, 6, 12, 15ሽ. Note
that in this case sum of sizes of jumps of ܨ is 1. ▄
Remark 3.2
Let ܺ be a r.v. defined on a probability space ሺߗ, ℱ, ܲሻ and let ሺℝ, ܤଵ, ܲሻ be the probability
space induced by ܺ. In advanced courses on probability theory it is shown that the d.f. ܨ
uniquely determines the induced probability measure ܲ and vice-versa. Thus to study the
induced probability space ሺℝ, ܤଵ, ܲሻ it suffices to study the d.f. ܨ. ▄
4. Types of Random Variables: Discrete, Continuous and Absolutely Continuous
Let ܺ be a r.v. defined on a probability space ሺߗ, ℱ, ܲሻ and let ሺℝ, ܤଵ, ܲሻbe the probability
space induced by ܺ. Let ܨ be the d.f. of ܺ. Then ܨ will either be continuous everywhere or it
will have countable number of discontinuities. Moreover the sum of sizes of jumps at the point
of discontinuities of ܨ will be either 1 or less than 1. These properties can be used to classify a
r.v. into three broad categories.
Definition 4.1
17. 17
A random variable ܺ is said to be of discrete type if there exists a non-empty and countable set
ܵ such that ܲሺሼܺ ൌ ݔሽሻ ൌ ܨሺݔሻ െ ܨሺݔ െሻ 0, ∀ ݔ ∈ ܵ and ܲሺܵሻ = ∑ ܲ௫∈ௌ
ሺሼܺ =
ݔሽሻ = ∑ [ܨሺݔሻ − ܨሺݔ −ሻ]௫∈ௌ
= 1. The set ܵ is called the support of the discrete random
variable ܺ. ▄
Remark 4.1
If a r.v. ܺ is of discrete type then ܲሺܵ
ሻ = 1 − ܲሺܵሻ = 0 and, consequently ܲሺሼܺ = ݔሽሻ =
0, ∀ ݔ ∈ ܵ
, i. e. , ܨሺݔሻ − ܨሺݔ −ሻ = 0, ∀ ݔ ∈ ܵ
and ܨ is continuous at every point of
ܵ
.Moreover, ܨሺݔሻ − ܨሺݔ −ሻ = ܲሺሼܺ = ݔሽሻ > 0, ∀ ݔ ∈ Sଡ଼. It follows that the support ܵ
of a discrete type r.v. ܺ is nothing but the set of discontinuity points of the d.f. ܨ. Moreover
the sum of sizes of jumps at the point of discontinuities is
∑ [ܨሺݔሻ − ܨሺݔ −ሻ]௫∈ௌೣ
= ∑ ܲሺሼܺ = ݔሽሻ௫∈ௌೣ
= ܲሺܵሻ = 1. ▄
Thus we have the following theorem.
Theorem 4.1
Let ܺ be a random variable with distribution function ܨ and let ܦ be the set of discontinuity
points of ܨ. Then ܺ is of discrete type if, and only if, ܲሺሼܺ ∈ ܦሽሻ = 1. ▄
Definition 4.2
Let ܺ be a discrete type random variable with support ܵ. The function ݂: ℝ → ℝ, defined by,
݂ሺݔሻ = ൜
ܲሺሼܺ = ݔሽሻ, if ݔ ∈ ܵ
0, otherwise
is called the probability mass function (p.m.f.) of ܺ.
Example 4.1
Let us consider a r.v. ܼ having the d.f. ܨ considered in Example 3.2 (iii). The set of discontinuity
points of ܨ is ܦ = ሼ0, 2, 3, 6, 12, 15ሽ and ܲሺሼܼ ∈ ܦሽሻ = ∑ [ܨሺݖሻ − ܨሺݖ −ሻ]௭∈ ೋ
= 1.
Therefore the r.v. ܼ is of discrete type with support ܵ = ܦ = ሼ0, 2, 3, 6, 12, 15ሽ and p.m.f.
݂ሺݖሻ = ൜
[ܨሺݖሻ − ܨሺݖ −ሻ], if ݖ ∈ ܵ
0, otherwise
18. 18
ൌ
ە
ۖ
ۖ
ۖ
۔
ۖ
ۖ
ۖ
ۓ
1
8
, if ݖ ∈ ሼ0, 2, 15ሽ
1
4
, if ݖ ൌ 3
3
10
, if ݖ ൌ 6
3
40
, if ݖ ൌ 12
0, otherwise
.
Figure 4.1. Plot of p.m.f. ݂ሺݖሻ
Note that the p.m.f. ݂ of a discrete type r.v. ܺ, having support ܵ, satisfies the following
properties:
(i) ݂ሺݔሻ 0, ∀ ݔ ∈ ܵ and ݂ሺݔሻ ൌ 0, ∀ ݔ ∉ ܵ, (4.1)
(ii) ∑ ݂ሺݔሻ ൌ௫ ∈ ௌ
∑ ܲሺሼܺ ൌ ݔሽሻ௫ ∈ ௌ
ൌ 1. (4.2)
Moreover, for ܤ ∈ ࣜଵ,
ܲሺܤሻ ൌ ܲሺܤ ∩ ܵሻ + ܲሺܤ ∩ ܵ
ሻ
ൌ ܲሺܤ ∩ ܵሻ (since ܤ ∩ ܵ
⊆ ܵ
and ܲሺܵ
ሻ ൌ 0)
ൌ ݂ሺݔሻ
௫ ∈∩ௌ
.
This suggest that we can study probability space ሺԹ, ࣜଵ, ܲሻ, induced by a discrete type r.v. ܺ,
through the study of its p.m.f. ݂. Also
ܨሺݔሻ ൌ ݂
௬ ∈ሺିஶ,௫ሿ∩ௌ
ሺݕሻ, ݔ ∈ Թ
and
19. 19
݂ሺݔሻ ൌ ܲሺሼܺ ൌ ݔሽሻ ൌ ܨሺݔሻ െ ܨሺݔ െሻ, ݔ ∈ ℝ.
Thus, given a p.m.f. of a discrete type of r.v., we can get its d.f. and vice-versa. In other words,
there is one-one correspondence between p.m.f.s and distribution functions of discrete type
random variables.
The following theorem establishes that any function ݃: ℝ → ℝ satisfying (4.1) and (4.2) is p.m.f.
of some discrete type random variable.
Theorem 4.2
Suppose that there exists a non-empty and countable set ܵ ⊆ ℝ and a function ݃: ℝ → ℝ
satisfying: (i) ݃ሺݔሻ > 0, ∀ ݔ ∈ ܵ; (ii)݃ሺݔሻ = 0, ∀ݔ ∉ ܵ, and (iii) ∑ ݃ሺݔሻ௫ ∈ௌ = 1. Then there
exists a discrete type random variable on some probability space ሺℝ, ℬଵ, ܲሻ such that the p.m.f.
of ܺ is ݃.
Proof. Define the set function ܲ: ℬଵ → ℝ by
ܲሺܤሻ = ݃ሺݔሻ
௫ ∈∩ௌ
, ܤ ∈ ℬଵ.
It is easy to verify that ܲ is a probability measure on ℬଵ, i.e., ሺℝ, ℬଵ, ܲሻis a probability space.
Define ܺ: ℝ → ℝ by ܺሺ߱ሻ = ߱, ߱ ∈ ℝ. Clearly ܺ is a r.v. on the probability space ሺℝ, ℬଵ, ܲሻ and
it induces the same probability space ሺℝ, ℬଵ, ܲሻ. Clearly ܲሺሼܺ = ݔሽሻ = ݃ሺݔሻ, ݔ ∈ ℝ, and
∑ ݃ሺݔሻ௫ ∈ௌ = 1. Therefore the r.v. ܺ is of discrete type with support ܵ and p.m.f. ݃. ▄
Example 4.2
Consider a coin that, in any flip, ends up in head with probability
ଵ
ସ
and in tail with probability
ଷ
ସ
.
The coin is tossed repeatedly and independently until a total of two heads have been observed.
Let ܺ denote the number of flips required to achieve this. Then ܲሺሼܺ = ݔሽሻ = 0, if ݔ ∉
ሼ2, 3, 4, ⋯ ሽ. For ݅ ∈ ሼ2, ,3 ,4 … ሽ
ܲሺሼܺ = ݅ሽሻ = ቌቀ
݅ − 1
1
ቁ
1
4
൬
3
4
൰
ିଶ
ቍ
1
4
=
݅ − 1
16
൬
3
4
൰
ିଶ
.
Moreover, ∑ ܲሺሼܺ = ݅ሽሻஶ
ୀଶ = 1. It follows that ܺ is a discrete type r.v. with support
ܵ = ሼ2, 3, 4, … ሽ and p.m.f.
20. 20
݂ሺݔሻ ൌ ൝
௫ିଵ
ଵ
ቀ
ଷ
ସ
ቁ
௫ିଶ
, if ݔ ∈ ሼ2, 3, 4, ⋯ ሽ
0, otherwise
.
Figure 4.2. Plot of p.m.f. ݂ሺݔሻ
The d.f. of ܺ is
ܨሺݔሻ ൌ ܲሺሼܺ ݔሽሻ
ൌ ൞
0, if ݔ ൏ 2
1
16
ሺ݆ െ 1ሻ ൬
3
4
൰
ିଶ
ୀଶ
, if ݅ ݔ ൏ ݅ + 1, ݅ ൌ 2, 3, 4, ⋯
ൌ ቐ
0, if ݔ ൏ 2
1 െ
݅ + 3
4
൬
3
4
൰
ିଵ
, if ݅ ݔ ൏ ݅ + 1, ݅ ൌ 2, 3, 4, ⋯
▄
Example 4.3
A r.v. ܺ has the d.f.
21. 21
ܨሺݔሻ ൌ
ە
ۖ
ۖ
ۖ
۔
ۖ
ۖ
ۖ
ۓ
0, if ݔ < 2
ଶ
ଷ
, if 2 ≤ ݔ < 5
ି
, if 5 ≤ ݔ < 9
ଷమିା
, if 9 ≤ ݔ < 14
ଵమିଵାଵଽ
ଵ
, if 14 ≤ ݔ ≤ 20
1, if ݔ > 20
,
where ݇ ∈ ℝ.
(i) Find the value of constant ݇;
(ii) Show that the r.v. ܺ is of discrete type and find its support;
(iii) Find the p.m.f. of ܺ.
Solution. (i) Since ܨ is right continuous, we have
ܨሺ20ሻ = ܨሺ20+ሻ
⇒ 16݇ଶ
− 16݇ + 3 = 0
⇒ ݇ =
1
4
or ݇ =
3
4
. ሺ4.3ሻ
Also ܨ is non-decreasing. Therefore
ܨሺ5 −ሻ ≤ ܨሺ5ሻ
⇒ ݇ ≤
1
2
. ሺ4.4ሻ
On combining (4.3) and (4.4) we get ݇ = 1/4. Therefore
ܨሺݔሻ =
ە
ۖۖ
۔
ۖۖ
ۓ
0, if ݔ < 2
ଶ
ଷ
, if 2 ≤ ݔ < 5
ଵଵ
ଵଶ
, if 5 ≤ ݔ < 9
ଽଵ
ଽ
, if 9 ≤ ݔ < 14
1, if ݔ ≥ 14
.
(ii) The set of discontinuity points of ܨ is ܦ = ሼ2, 5, 9, 14ሽ. Moreover
ܲሺሼܺ = 2ሽሻ = ܨሺ2ሻ– ܨሺ2 −ሻ =
ଶ
ଷ
,
ܲሺሼܺ = 5ሽሻ = ܨሺ5ሻ– ܨሺ5 −ሻ =
ଵ
ସ
,
ܲሺሼܺ = 9ሽሻ = ܨሺ9ሻ– ܨሺ9 −ሻ =
ଵ
ଷଶ
,
22. 22
ܲሺሼܺ ൌ 14ሽሻ = ܨሺ14ሻ– ܨሺ14 −ሻ =
ହ
ଽ
,
and ܲሺሼܺ ∈ ܦሽሻ = ܲሺሼܺ = 2ሽሻ + ܲሺሼܺ = 5ሽሻ + ܲሺሼܺ = 9ሽሻ + ܲሺሼܺ = 14ሽሻ = 1.
Therefore the r.v. ܺ is of discrete type with support ܵ = ሼ2, 5, 9, 14ሽ.
(iii) Clearly the p.m.f. of ܺ is given by
݂ሺݔሻ = ܲሺሼܺ = ݔሽሻ =
ە
ۖ
ۖ
۔
ۖ
ۖ
ۓ
ଶ
ଷ
, if ݔ = 2
ଵ
ସ
, if ݔ = 5
ଵ
ଷଶ
, if ݔ = 9
ହ
ଽ
, if ݔ = 14
0, otherwise
.
▄
Example 4.4
A r.v. ܺ has the p.m.f.
݂ሺݔሻ = ൝
ܿ
ሺ2ݔ − 1ሻሺ2ݔ + 1ሻ
, if ݔ ∈ ሼ1, 2, 3, ⋯ ሽ
0, otherwise
,
where ܿ ∈ ℝ.
(i) Find the value of constant ܿ;
(ii) For positive integers ݉ and ݊, such that ݉ < ݊, evaluate ܲሺሼܺ < ݉ + 1ሽሻ, ܲሺሼܺ ≥
݉ሽሻ, ܲሺሼ݉ ≤ ܺ < ݊ሽሻ and ܲሺሼ݉ < ܺ ≤ ݊ሽሻ;
(iii) Determine the d.f. of ܺ.
Solution.
(i) Let ܵ be the support of ܺ so that ܵ = ሼݔ ∈ ℝ: ݂ሺݔሻ > 0ሽ and ∑ ݂ሺݔሻ = 1௫ ∈ௌ
.
Clearly, ܵ = ሼ1, 2, 3, … ሽ and
c
ሺ2݅ − 1ሻሺ2݅ + 1ሻ
= 1
ஶ
ୀଵ
⇒ lim
݊→∞
ܿ
ሺ2݅ − 1ሻሺ2݅ + 1ሻ
= 1
ୀଵ
⇒
ܿ
2
lim
݊→∞
1
2݅ − 1
−
1
2݅ + 1
൨
ୀଵ
= 1
24. 24
ܨሺݔሻ ൌ ܲሺሼܺ ൏ ݅ + 1ሽሻ =
2݅
2݅ + 1
. ሺusingሺiiሻሻ
Therefore,
ܨሺݔሻ = ൝
0, if ݔ < 1
2݅
2݅ + 1
, if ݅ ≤ ݔ < ݅ + 1, ݅ = 1, 2, 3, ⋯
. ▄
Definition 4.3
(i) A random variable ܺ is said to be of continuous type if its distribution function ܨ is
continuous everywhere.
(ii) A random variable ܺ with distribution function ܨ is said to be of absolutely
continuous type if there exists an integrable function ݂: ℝ → ℝ such that
݂ሺݔሻ ≥ 0, ∀ݔ ∈ ℝ, and
ܨሺݔሻ = න ݂௫ሺtሻ݀,ݐ
௫
ିஶ
ݔ ∈ ℝ.
The function ݂ is called the probability density function (p.d.f.) of random variable ܺ
and the set ܵ = ሼݔ ∈ ℝ: ݂ሺݔሻ > 0ሽ is called the support of random variable ܺ (or
of p.d.f. ݂ ). ▄
Note that if ݂ is p.d.f. of an absolutely continuous type r.v. ܺ then ݂ሺݔሻ ≥ 0, ∀ݔ ∈
ℝ and ݂ሺtሻ݀ݐ
ஶ
ିஶ
= ܨሺ∞ሻ = 1, where ܨሺ∞ሻ = lim
∞→ݔ
ܨሺݔሻ.
Example 4.5
Let ܺ be a r.v. having the d.f.
ܨሺݔሻ = ൜
0, if ݔ < 0
1 − ݁ି௫
, if ݔ ≥ 0
.
Clearly ܨ is continuous at every ݔ ∈ ℝ and therefore ܺ is of continuous type. Also
ܨሺݔሻ = ݂
௫
ିஶ
ሺtሻ ݀ݔ ,ݐ ∈ ℝ,
where ݂: ℝ → [0, ∞ሻ is given by
݂ሺݐሻ = ൜
0, if ݐ < 0
݁ି௧
, if ݐ ≥ 0
. ሺ4.5ሻ
It follows that ܺ is also if absolutely continuous type with p.d.f. given by (4.5).
25. 25
Figure 4.3. Plot of p.d.f. ݂ሺݐሻ
▄
Remark 4.2
(i) Suppose that ܺ is a r.v. of continuous type. Then ܲሺሼݔሽሻ ൌ ܲሺሼܺ ൌ ݔሽሻ ൌ ܨሺݔሻ െ
ܨሺݔ െሻ ൌ 0, ∀ݔ ∈ Թ. In general, for any countable set ,ܥ ܲሺሼܺ ∈ ܥሽሻ ൌ ܲሺܥሻ ൌ
ܲሺ⋃ ሼݔሽ௫∈ ሻ ൌ ∑ ܲሺሼݔሽሻ௫∈ ൌ 0.
(ii) Since the p.d.f. ݂ of an absolutely continuous type r.v. ܺ determines its d.f., using
Remark 3.2, it follows that we may study the induced probability space ሺԹ, ࣜଵ, ܲሻ
through the study of p.d.f. ݂.
(iii) Suppose that ܺ is a r.v. of absolutely continuous type. Then, for ݔ ∈ Թ and ݄ 0,
|ܨሺݔ െ ݄ሻ െ ܨሺݔሻ| ൌ ܨሺݔሻ െ ܨሺݔ െ ݄ሻ
ൌ න ݂ሺtሻ ݀ݐ
௫
ିஶ
െ න ݂ሺtሻ ݀ݐ
௫ି
ିஶ
ൌ න ݂ሺtሻ ݀ݐ
௫
௫ି
→ 0, as ݄ ↓ 0,
26. 26
i.e., ܨ is also left continuous on Թ. It follows that if ܺ is an absolutely continuous
type r.v. then its d.f. ܨ is continuous everywhere on Թ and hence ܺ is of continuous
type.
(iv) Let ܺ be a r.v. of absolutely continuous type. Then ܺ is also of continuous type (see
(iii) above) and therefore ܲሺሼܺ ൌ ݔሽሻ ൌ 0, ∀ݔ ∈ ℝ. Consequently,
ܲሺሼܺ < ݔሽሻ = ܲሺሼܺ ≤ ݔሽሻ = ܨሺݔሻ = න ݂ሺݐሻ ݀ݐ
௫
ିஶ
, ݔ ∈ ℝ
ܲሺሼܺ ≥ ݔሽሻ = 1 − ܲሺሼܺ < ݔሽሻ = න ݂ሺݐሻ ݀ݐ
ஶ
௫
, ݔ ∈ ℝ, ሺsince න ݂ሺݐሻ ݀ݐ
ஶ
ିஶ
= 1ሻ
and, for −∞ < ܽ < ܾ < ∞,
ܲሺሼܽ < ܺ ≤ ܾሽሻ = ܲሺሼܽ < ܺ < ܾሽሻ = ܲሺሼܽ ≤ ܺ < ܾሽሻ = ܲሺሼܽ ≤ ܺ ≤ ܾሽሻ
= ܨሺܾሻ − ܨሺܽሻ
= න ݂ሺݐሻ ݀ݐ
ିஶ
− න ݂ሺݐሻ ݀ݐ
ିஶ
= න ݂ሺݐሻ ݀ݐ
= න ݂ሺݐሻܫሺ,ሻሺݐሻ݀ݐ
ஶ
ିஶ
,
where, for a set ܣ ⊆ ℝ, ܫ denotes its indicator function, i.e.,
ܫሺݐሻ = ൜
1, if ݐ ∈ ܣ
0, otherwise
.
In general, for any ܤ ∈ ℬଵ, it can be shown that
ܲሺሼܺ ∈ ܤሽሻ = න ݂ሺtሻ
ஶ
ିஶ
ܫሺtሻ ݀.ݐ
27. 27
Figure 4.4. Probability of a region
(v) We know that if ݄: Թ → Թ is a non-negative integrable function then, for any
countable set ܦሺ് ߶ሻ in Թ, and for െ∞ ܽ ൏ ܾ ∞,
න ݄ሺݐሻ
ܫሺtሻ ݀ݐ ൌ න ݄ሺtሻ
ܫ⋃ ሼ௫ሽೣ∈ವ
ሺݐሻ ݀ݐ
ൌ න ݄ሺݐሻ
൭ ܫሼ௫ሽሺtሻ
௫∈
൱ ݀ݐ
ൌ න ݄ሺtሻ
ୠ
ܫሼ௫ሽሺtሻ݀ݐ
௫∈
ൌ 0, ሺ4.6ሻ
since ݄ሺݐሻܫሼ௫ሽሺtሻ
݀ݐ ൌ 0, ∀ ݔ ∈ Թ.
Now let ܺ be a r.v. of absolutely continuous type with p.d.f. ݂ and d.f. ܨ so that
ܨሺݔሻ ൌ න ݂ܺ
ሺtሻ ݀,ݐ
ݔ
െ∞
ݔ ∈ Թ.
Let ܧ be any countable set and let ݃: Թ → ሾ0, ∞ሻ be any non-negative function such
that ݃ሺݔሻ ൌ ݂ሺݔሻ, ∀ ݔ ∈ ܧ
ൌ Թ െ ܧ and ݃ሺݔሻ ് ݂ሺݔሻ, ∀ ݔ ∈ .ܧ Then, for ݔ ∈ Թ,
ܨሺݔሻ ൌ න ݂ሺtሻ݀ݐ
௫
ିஶ
28. 28
ൌ න ݂ሺtሻൣܫாሺtሻ + ܫாሺtሻ൧݀ݐ
௫
ିஶ
= න ݂ሺݐሻܫாሺݐሻ݀ ݐሺusingሺ4.6ሻሻ
௫
ିஶ
= න ݃ሺݐሻܫாሺݐሻ݀ ݐሺsince ݂ሺݐሻ
௫
ିஶ
ܫாሺݐሻ = ݃ሺݐሻܫாሺݐሻሻ
= න݃ሺݐሻܫாሺtሻ݀ݐ
௫
ିஶ
+ න ݃ሺݐሻܫாሺtሻ݀ݐ
௫
ିஶ
ሺusing ሺ4.6ሻሻ
= න ݃ሺݐሻ ݀ݐ
௫
ିஶ
,
i.e., g is also a p.d.f. of r.v. ܺ. Note that݃ሺݔሻ = ݂ሺݔሻ, ∀ ݔ ∈ ܧ
and ݃ሺݔሻ ≠
݂ሺݔሻ, ∀ ݔ ∈ .ܧ It follows that the p.d.f. of a r.v. of absolutely continuous type is not
unique. In fact if the values of the p.d.f. ݂ of a r.v. ܺ of absolutely continuous type
are changed at a finite number of points with some other non-negative values then
the resulting function is again a p.d.f. of ܺ. In other words a r.v. of absolutely
continuous type has different versions of p.d.f.s. Consequently the support of an
absolutely continuous type r.v. is also not unique and it depends upon the version of
p.d.f. chosen. However it is worth mentioning here that the d.f. of any r.v. is unique.
(vi) Suppose that the d.f. ܨ of a r.v. ܺ is differentiable at every ݔ ∈ ℝ. Then
ܨሺݔሻ = න ܨ
ᇱ
௫
ିஶ
ሺݐሻ݀,ݐ ݔ ∈ ℝ.
It follows that if the d.f. ܨ is differentiable everywhere then the r.v. ܺ is of
absolutely continuous type and one may take its p.d.f. to be ݂ሺݔሻ = ܨܺ
′
ሺݔሻ, ݔ ∈ ℝ.
(vii) Suppose that the d.f. of a r.v. ܺ is differentiable everywhere except on countable set
.ܦ Further suppose that
න ܨ
ᇱ ሺݐሻ ܫሺݐሻ݀ݐ = 1.
ஶ
ିஶ
Then, using a standard result in advanced calculus, it follows that the random
variable ܺ is of absolutely continuous type with a p.d.f.
29. 29
݂ሺݔሻ ൌ ቊ
ܨܺ
′
ሺݔሻ, if ݔ ∉ ܥ
ܽݔ, if ݔ ∈ ܥ
,
where ܽ௫, ݔ ∈ ܥ are arbitrary nonnegative constants. Here, note that
න ܨ
ᇱ ሺݐሻܫሺݐሻ݀ݐ = න ݂ሺݐሻ݀ݐ = 1
ஶ
ିஶ
ஶ
ିஶ
and
ܨሺݔሻ = න ܨ
ᇱ ሺݐሻ ܫሺݐሻ݀ݐ = න ݂ሺݐሻ݀ݔ ,ݐ ∈ ℝ.
௫
ିஶ
௫
ିஶ
(viii) There are random variables that are neither of discrete type nor of continuous type
(and hence also nor of absolutely continuous type). To see this let us consider a r.v.
ܺ having the d.f. ܨ (see Example 3.2 (ii)) given by
ܨሺݔሻ =
ە
ۖۖ
۔
ۖۖ
ۓ
0, if ݔ < 0
௫
ସ
, if 0 ≤ ݔ < 1
௫
ଷ
, if 1 ≤ ݔ < 2
ଷ௫
଼
, if 2 ≤ ݔ <
ହ
ଶ
1, if ݔ ≥
ହ
ଶ
.
The set of discontinuity points of ܨ is ܦ = ቄ1, 2,
ହ
ଶ
ቅ. Since ܦ ≠ ∅ the r.v. is not of
continuous type. Moreover
ܲሺሼܺ ∈ ܦሽሻ = ܲሺሼܺ = 1ሽሻ + ܲሺሼܺ = 2ሽሻ + ܲ ቀቄܺ =
ହ
ଶ
ቅቁ
= [ܨሺ1ሻ − ܨሺ1 −ሻ] + [ܨሺ2ሻ − ܨሺ2 −ሻ] + ܨ ൬
5
2
൰ − ܨ ൬
5
2
−൰൨
=
ଵଵ
ସ଼
< 1,
implying that the r.v. ܺ is also not of discrete type.
(ix) There are random variables which are of continuous type but not of absolutely
continuous type. These random variables are normally difficult to study. ▄
Example 4.6
Consider a r.v. ܺ having the d.f. ܨ (see Example 4.5) given by
ܨሺݔሻ = ൜
0, if ݔ < 0
1 − ݁ି௫
, if ݔ ≥ 0
∙
Clearly ܨ is differentiable everywhere except at ݔ ∈ ܦ = ሼ0ሽ. Also
න ܨ
ᇱ ሺݐሻܫሺݐሻ݀ݐ = න ݁ି௧
݀ݐ = 1.
ஶ
ஶ
ିஶ
30. 30
Using Remark 4.2 (vii) it follows that the r.v. ܺ is of absolutely continuous type and one may
take
݂ሺݔሻ ൌ ൝
0, if ݔ < 0
ܽ, if ݔ = 0 ,
݁ି௫
, if ݔ > 0
as a p.d.f. of ܺ; here ܽ is an arbitrary non-negative constant. In particular one may take
݂ሺݔሻ = ൜
0, if ݔ ≤ 0
݁ି௫
, if ݔ > 0
as a p.d.f. of ܺ. ▄
Note that the p.d.f. ݂ of a r.v. ܺ of absolutely continuous type satisfies the following two
properties:
(i) ݂ሺݔሻ ≥ 0, ∀ ݔ ∈ ℝ;
(ii) ݂ሺtሻ ݀ݐ
ஶ
ିஶ
= lim
∞→ݔ
ܨሺݔሻ = 1.
The following theorem establishes that any function ݃: ℝ → [0, ∞] satisfying the above two
properties is a p.d.f. of some r.v. of absolutely continuous type.
Theorem 4.3
Suppose that there exists a non-negative function ݃: ℝ → ℝ satisfying:
(i) ݃ሺݔሻ ≥ 0, ∀ ݔ ∈ ℝ;
(ii) ݃ሺݐሻ݀ݐ = 1
ஶ
ିஶ
.
Then there exists an absolutely continuous type random variable ܺ on some probability space
ሺߗ, ℬଵ, ܲ) such that the p.d.f. ܺ is ݃.
Proof. Define the set function ܲ: ℬଵ → ℝ by
ܲሺܤሻ = න ݃ሺݐሻܫሺݐሻ ݀,ݐ
ஶ
ିஶ
ܤ ∈ ℬଵ ∙
It is easy to verify that ܲ is a probability measure on ℬଵ, i.e.,ሺℝ, ℬଵ, ܲሻ is a probability space.
Define ܺ: ℝ → ℝ by ܺሺ߱ሻ = ߱, ߱ ∈ ℝ. Clearly ܺ is a random variable on the probability
space ሺℝ, ℬଵ, ܲሻ. The space (ℝ, ℬଵ, ܲሻ is also the probability space induced by ܺ. Clearly, for
ݔ ∈ ℝ,
ܨሺݔሻ = ܲሺሺ−∞, ]ݔሻ
31. 31
ൌ ܲሺሺെ∞, ]ݔሻ
= න ݃ሺtሻ
ஶ
ିஶ
ܫሺିஶ,௫]ሺtሻ ݀ݐ
= න ݃ሺݐሻ݀ݐ
௫
ିஶ
.
It follows that ܺ is of absolutely continuous type and ݃ is the p.d.f. of ܺ. ▄
Example 4.7
Let ܺ be r.v. with the d.f.
ܨሺݔሻ =
ە
ۖ
۔
ۖ
ۓ
0, if ݔ < 0
௫మ
ଶ
, if 0 ≤ ݔ < 1
௫
ଶ
, if 1 ≤ ݔ < 2
1, if ݔ ≥ 2
.
Show that the r.v. ܺ is of absolutely continuous type and find the p.d.f. of ܺ.
Solution. Clearly ܨ is differentiable everywhere except at points 1 and 2. Let ܦ = ሼ1, 2ሽ, so
that
න ܨ
ᇱ ሺݐሻܫሺݐሻ݀ݐ = න ݐ݀ ݐ + න
1
2
ଶ
ଵ
݀ݐ = 1.
ଵ
ஶ
ିஶ
Using Remark 4.2 (vii) it follows that the r.v. ܺ is of absolutely continuous type with a p.d.f.
݂ሺݔሻ =
ە
ۖ
۔
ۖ
ۓ
,ݔif 0 ≤ ݔ < 1
ܽ, if ݔ = 1
ଵ
ଶ
, if 1 < ݔ < 2
ܾ, if ݔ = 2
0, otherwise
,
where ܽ and ܾ are arbitrary nonnegative constants. In particular a p.d.f. of ܺ is
݂ሺݔሻ = ቐ
,ݔif 0 < ݔ < 1
ଵ
ଶ
, if 1 < ݔ < 2
0, otherwise
.
▄
32. 32
Example 4.8
Let ܺ be an absolutely continuous type r.v. with p.d.f.
݂ሺݔሻ ൌ ቊ
݇ െ | ,|ݔif ||ݔ <
ଵ
ଶ
0, otherwise
,
where ݇ ∈ ℝ.
(i) Find the value of constant k;
(ii) Evaluate:
ܲሺሼܺ < 0ሽሻ, ܲሺሼܺ ≤ 0ሽሻ, ܲ ቀቄ0 < ܺ ≤
ଵ
ସ
ቅቁ , ܲ ቀቄ0 ≤ ܺ <
ଵ
ସ
ቅቁ and ܲ ቀቄ−
ଵ
଼
≤ ܺ ≤
ଵ
ସ
ቅቁ;
(iii) Find the d.f. of ܺ.
Solution.
(i) Since ݂ is a p.d.f.
න ݂ሺݔሻ
ஶ
ିஶ
݀ݔ = 1
⇒ න ሺ݇ − ||ݔሻ
ଵ
ଶൗ
ିଵ
ଶൗ
݀ݔ = 1
⇒ ݇ =
5
4
∙
Also, for ݇ =
ହ
ସ
, ݂ሺݔሻ ≥ 0, ∀ ݔ ∈ ℝ.
(ii) Since the r.v. ܺ is of absolutely continuous type, ܲሺሼܺ = ݔሽሻ = 0, ∀ ݔ ∈ ℝ (see
Remark 4.2 (iv)).Therefore
ܲሺሼܺ < 0ሽሻ = ܲሺሼܺ ≤ 0ሽሻ = ݂
ିஶ
ሺݔሻ݀ݔ = ቀ
ହ
ସ
+ ݔቁ ݀ݔ =
ଵ
ଶ
ିଵ
ଶൗ
,
ܲ ቀቄ0 < ܺ ≤
ଵ
ସ
ቅቁ = ܲ ቀቄ0 ≤ ܺ <
ଵ
ସ
ቅቁ = ݂
ଵ
ସൗ
ሺݔሻ݀ݔ = ቀ
ହ
ସ
− ݔቁ ݀ݔ =
ଽ
ଷଶ
ଵ
ସൗ
,
and
ܲ ൬−
1
8
≤ ܺ ≤
1
4
൰ = න ݂
ଵ
ସൗ
ିଵ
଼ൗ
ሺݔሻ݀ݔ
33. 33
ൌ න ൬
5
4
+ ݔ൰ ݀ݔ +
ିଵ
଼ൗ
න ൬
5
4
− ݔ൰
ଵ
ସൗ
݀ݔ
=
55
128
∙
(iii) Clearly, for ݔ < −
ଵ
ଶ
, ܨሺݔሻ = 0 and, for ݔ ≥
ଵ
ଶ
, ܨሺݔሻ = 1. For −
ଵ
ଶ
≤ ݔ < 0,
ܨሺݔሻ = න ݂ሺtሻ
௫
ିஶ
݀ݐ
ܨሺݔሻ = න ൬
5
4
+ t൰
௫
ିଵ
ଶൗ
݀ݐ
=
௫మ
ଶ
+
ହ
ସ
ݔ +
ଵ
ଶ
,
and, for 0 ≤ ݔ <
ଵ
ଶ
,
ܨሺݔሻ = න ݂ሺtሻ
௫
ିஶ
݀ݐ
= න ൬
5
4
+ t൰ ݀ݐ + න ൬
5
4
− t൰
௫
݀ݐ
ି
భ
మ
= −
ݔଶ
2
+
5
4
ݔ +
1
2
∙
Therefore the d.f. of ܺ is
ܨሺݔሻ =
ە
ۖ
۔
ۖ
ۓ
−
0 if ݔ < −
ଵ
ଶ
௫|௫|
ଶ
+
ହ
ସ
ݔ +
ଵ
ଶ
, if −
ଵ
ଶ
≤ ݔ <
ଵ
ଶ
1, if ݔ ≥
ଵ
ଶ
.
▄
Theorem 4.4
Let ܨ be the distribution function of a random variable ܺ. Then ܨ can be decomposed as
ܨ(ݔ) = ߙܨௗ(ݔ) + (1 − ߙ)ܨ(ݔ), ݔ ∈ ℝ, where ߙ ∈ ሾ0,1ሿ, ܨௗ is a distribution function of
some random variable of discrete type and ܨ is a distribution function of some random
variables of continuous type.
34. 34
Proof. Let ܦ denote the set of discontinuity points of ܨ. We will prove the result for the case
when ܦ is finite. The idea of the proof for the case when ܦ is countably infinite is similar but
slightly involved. First suppose that ܦ ൌ ߶. In this case the result follows trivially by taking
ߙ ൌ 0 and ܨ ≡ ܨ. Now suppose that ܦ = ሼܽଵ, ܽଶ, … , ܽሽ for some ݊ ∈ ℕ.Without loss of
generality let −∞ < ܽଵ < ܽଶ < ⋯ < ܽ < ∞.
Define
= ܲ(ሼܺ = ܽሽ) = ܨ௫(ܽ) − ܨ(ܽ −), ݅ = 1, 2, … , ݊,
so that > 0, ݅ = 1, … , ݊.
Let ߙ = ∑
ୀଵ so that ߙ ∈ (0, 1ሿ. Define ܨௗ: ℝ → ℝ by
ܨௗ(ݔ) =
ە
۔
ۓ
0, if ݔ < 0
∑
ୀଵ
ߙ
if ܽ ≤ ݔ < ܽାଵ, ݅ = 1, … , ݊ − 1.
1, if ݔ ≥ ܽ
Clearly ܨௗ is non-decreasing, right continuous ܨௗ(−∞) = 0 and ܨௗ(∞) = 1 . The set of
discontinuity points of ܨௗ is ሼܽଵ, … , ܽሽ and
ሾܨௗ(ܽ) − ܨௗ(ܽ −)ሿ
ୀଵ
= ቊ
∑ ୨
ୀଵ
ߙ
−
∑
ିଵ
ୀଵ
ߙ
ቋ
ୀଵ
=
1
ߙ
ୀଵ
= 1.
It follows that ܨௗ is a d.f. of some r.v. of discrete type. If ߙ = 1 then the result follows on taking
ܨௗ ≡ ܨ. Now suppose that ߙ ∈ (0, 1).
Define ܨ: ℝ → ℝ by
ܨ(ݔ) =
ܨ(ݔ) − ߙܨௗ(ݔ)
1 − ߙ
, ݔ ∈ ℝ.
For ܣ ⊆ ℝ, let ܵ(ܣ) = ሼ݅ ∈ ሼ1, … , ݊ሽ: ܽ ∈ ܣሽ. Then, for −∞ < ݔ < ݕ < ∞,
ܨௗ(ݕ) − ܨௗ(ݔ) =
ߙ
∈ௌ((ିஶ,௬ሿ)
−
ߙ
∈ௌ((ିஶ,௫ሿ)
35. 35
ൌ
ߙ
,
∈ௌ((௫,௬ሿ)
ܨ(ݕ) − ܨ(ݔ) = ܲ(ሼݔ < ܺ ≤ ݕሽ)
≥
∈ௌ((௫,௬ሿ)
= ߙ൫ܨௗ(ݕ) − ܨௗ(ݔ)൯,
where, for ܣ ⊆ ℝ, ∑ = 0 ∈ௌ() , if ܵ(ܣ) = ߶.
Therefore, for −∞ < ݔ < ݕ < ∞,
ܨ(ݕ) − ܨୡ(ݔ) =
ܨ(ݕ) − ܨ(ݔ) − ߙ൫ܨௗ(ݕ) − ܨௗ(ݔ)൯
1 − ߙ
≥ 0,
i.e., ܨୡ is non-decreasing. Note that ܨ(ܽ) − ܨ(ܽ −) = ߙ൫ܨௗ(ܽ) − ܨௗ(ܽ −)൯ = , ݅ =
1, … , ݊ and ܨ(ݔ) − ܨ(ݔ −) = 0, if ݔ ∉ {ܽଵ, … , ܽ}. It follows that
ܨ(ݔ) − ܨୡ(ݔ −) =
ܨ()ݔ − ܨ(ݔ −) − ߙ൫ܨௗ()ݔ − ܨௗ(ݔ −)൯
1 − ߙ
= 0, ∀ ݔ ∈ ℝ,
i.e., ܨୡ is continuous everywhere. Since ܨ(−∞) = ܨௗ(−∞) = 0 and ܨ(∞) = ܨௗ(∞) = 1 we
also have ܨୡ(−∞) = 0 and ܨ(∞) = 1. Therefore ܨ is a d.f. of some r.v. of continuous type.
Hence the result follows. ▄
Example 4.9
Let ܺ be a r.v. having the d.f. ܨ (see Example 3.2 (iii)) given by
ܨ(ݔ) =
ە
ۖۖ
۔
ۖۖ
ۓ
0, if ݔ < 0
௫
ସ
, if 0 ≤ ݔ < 1
௫
ଷ
, if 1 ≤ ݔ < 2
ଷ௫
଼
, if 2 ≤ ݔ <
ହ
ଶ
1, if ݔ ≥
ହ
ଶ
.
Decompose ܨ asܨ(ݔ) = ߙܪௗ(ݔ) + (1 − ߙ)ܪ(ݔ), ݔ ∈ ℝ, where ߙ ∈ ሾ0,1ሿ, ܪௗ is a d.f. of
some r.v. ܺௗ of discrete type and ܪ is a d.f. of some r.v. ܺ of continuous type.
37. 37
Figure 4.5. Plot of distribution function ܪௗሺݔሻ
Figure 4.6. Plot of distribution function ܪሺݔሻ
▄
Problems
1. Let ࣜଵ denote the Borel sigma-field of subsets of Թ and let െ∞ ൏ ݔ ൏ ݕ ൏ ∞. Define
ࣜሾ௫,௬ሿ ൌ ሼሾ,ݔ ݕሿ ∩ :ܤ ܤ ∈ ࣜଵሽ. Show that:
(i) ሼܽሽ ∈ ࣜଵ, ∀ ܽ ∈ Թ;
(ii) If ܥ is a countable subset of Թ, then ܥ ∈ ࣜଵ;
38. 38
(iii) ࣜሾ௫,௬ሿ is a sigma-field of subsets of ሾ,ݔ ݕሿ.
2. Let ߗ be a given set and let ܺ: ߗ → ℝ be a given function. Define ܺିଵ
: ࣪(ℝ) → ࣪(ߗ)
by ܺିଵ(ܤ) = ሼ߱ ∈ ߗ: ܺ(߱) ∈ ܤሽ, where, for a set ܵ, ࣪(ܵ) denotes the power set of ܵ.
Let ,ܣ ܤ ∈ ࣪(ℝ) and let ܣఈ ∈ ࣪(ℝ), ߙ ∈ ߉, where ߉ ⊆ ℝ is an arbitrary index set.
Show that:
(i) ܺିଵ(ܣ − ܤ) = ܺିଵ(ܣ) − ܺିଵ(ܤ);
(ii) ܺିଵ(ܤ) = ൫ܺିଵ(ܤ)൯
;
(iii) ܺିଵ(⋃ ܣఈఈ∈௸ ) = ⋃ ܺିଵ
ఈ∈௸ (ܣఈ);
(iv) ܺିଵ(⋂ ܣఈఈ∈௸ ) = ⋂ ܺିଵ
ఈ∈௸ (ܣఈ);
(v) ܣ ∩ ܤ = ߶ ⇒ ܺିଵ(ܣ) ∩ ܺିଵ(ܤ) = ߶.
3. Let (ߗ, ℱ, ܲ) be a probability space and let ܺ: ߗ → ℝ be a function. In each of the
following cases, verify whether or not ܺ is a r.v..
(i) ߗ = ሼ−2, −1, 0, 1, 2, 3ሽ, ℱ = ሼϕ, Ω, ሼ0ሽ, ሼ−1, 1ሽ, ሼ−2, −1, 1, 2, 3ሽ, ሼ−2, 0, 2, 3ሽ,
ሼ−1, 0, 1ሽ, ሼ−2, 2, 3ሽሽ and ܺ(߱) = ߱ଶ
, ߱ ∈ ߗ;
(ii) ߗ = ሼ߱ଵ, ߱ଶ, ߱ଷ, ߱ସሽ, ℱ = ሼ߶, ߗ, ሼ߱ଵሽ, ሼ߱ଶሽ, ሼ߱ଶ, ߱ଷ, ߱ସሽ, ሼ߱ଵ, ߱ଷ, ߱ସሽ, ሼ߱ଵ, ߱ଶሽ,
ሼ߱ଷ, ߱ସሽሽ, ܺ(߱ଵ) = 0, ܺ(߱ଶ) = ܺ(߱ଷ) = 1 and ܺ(߱ସ) = 2;
(iii) ߗ = ሾ0,1ሿ, ℱ = ℬሾ,ଵሿ, where ℬሾ,ଵሿ is as defined in Problem 1, and
ܺ(߱) ൞
߱, if ߱ ∈ 0,
1
2
൨
߱ −
1
2
, if ߱ ∈ ൬
1
2
, 1൨
.
4. Let (ߗ, ℱ, ܲ) be a probability space and let ܺ: ߗ → ℝ be a r.v.. In each of the following
cases determine whether or not ܻ: ߗ → ℝ is a r.v.:
(i) ܻ(߱) = |ܺሺ߱ሻ|, ߱ ∈ ߗ;
(ii) ܻ(߱) = ൫ܺ(߱)൯
ଶ
, ߱ ∈ ߗ;
(iii) ܻ(߱) = ඥܺ(߱), ߱ ∈ ߗ, where ܺିଵ
൫(−∞, 0)൯ = ߶;
(iv) ܻ(߱) = max(ܺ(߱), 0) , ߱ ∈ ߗ;
(v) ܻ(߱) = max(−ܺ(߱), 0) , ߱ ∈ ߗ.
5. Consider a random experiment of two independent tosses of a coin so that the sample
space is ߗ = ሼHH, HT, TH, TTሽ with obvious interpretations of outcomes
HH, HT, TH and TT. Let ℱ = ࣪(ߗ) (the power set of ߗ) and let ܲ(∙) be a probability
measure defined on ℱ such that ܲ(ሼHHሽ) = ଶ
, ܲ(ሼHTሽ) = ܲ(ሼTHሽ) = (1 − ) and
ܲ(ሼTTሽ) = (1 − )ଶ
, where ∈ (0,1). Define the function ܺ: ߗ → ℝ by ܺ(ሼHHሽ) =
2, ܺ(ሼHTሽ) = ܺ(ሼܶܪሽ) = 1 and ܺ(ሼTTሽ) = 0, i.e., ܺ(߱) denotes the number of Hs
(heads) in ߱. Show that ܺ a r.v. and find the probability space (ℝ, ℬଵ, ܲ) induced by ܺ.
39. 39
6. A card is drawn at random from a deck of 52 playing cards so that the sample space
consists of names of 52 cards (e.g., jack of heart, ace of spade, etc,). Let ℱ ൌ ࣪ሺߗሻ (the
power set of ߗ). Define ܺ: ߗ → ℝ by
ܺ(߱) =
ە
ۖ
۔
ۖ
ۓ
5, if ߱ is an ace
4, if ߱ is a king
3, if ߱ is a queen
2, if ߱ is a jack
1, otherwise
.
Show that ܺ is a r.v. and find the probability space (ℝ, ℬଵ, ܲ) induced by ܺ.
7. Let ܺଵ, ܺଶ and ܺଷ be three random variables with respective distribution functions
ܨଵ, ܨଶandܨଷ, where
ܨଵ(ݔ) = ൞
0, if ݔ < −1
ݔ + 2
4
, if − 1 ≤ ݔ < 1
1, if ݔ ≥ 1
; ܨଶ(ݔ) =
ە
ۖ
۔
ۖ
ۓ
0, if ݔ < −1
ݔ + 1
4
, if − 1 ≤ ݔ < 0
ݔ + 3
4
, if 0 ≤ ݔ < 1
1, if ݔ ≥ 1
;
and
ܨଷ(ݔ) =
ە
ۖ
ۖ
۔
ۖ
ۖ
ۓ
0, if ݔ < −2
1
3
, if − 2 ≤ ݔ < 0
1
2
, if 0 ≤ ݔ < 5
1
2
+
(ݔ − 5)ଶ
2
, if 5 ≤ ݔ < 6
1, if ݔ ≥ 6
.
(i) Sketch the graph of ܨଵ(ݔ) and compute ܲ ቀቄ−
ଵ
ଶ
< ܺଵ ≤
ଵ
ଶ
ቅቁ , ܲ(ሼܺଵ = 0ሽ), ܲ(ሼܺଵ =
1ሽ), ܲ(ሼ−1 ≤ ܺଵ < 1ሽ) and ܲ(ሼ−1 < ܺଵ < 1ሽ);
(ii) Compute ܲ ቀቄ
ଵ
ସ
≤ ܺଶ ≤
ଷ
ସ
ቅቁ , ܲ ቀቄܺଶ ≥
ଵ
ଶ
ቅቁ , ܲ(ሼܺଶ ≥ 0ሽ) and ܲ ቀቄ0 < ܺଶ ≤
ଵ
ଶ
ቅቁ;
(iii) Compute ܲ(ሼ−2 ≤ ܺଷ < 5ሽ), ܲ ቀቄ0 < ܺଷ <
ଵଵ
ଶ
ቅቁ and the conditional probability
ܲ ቀቄ
ଷ
ଶ
< ܺଷ ≤
ଵଵ
ଶ
ቅ |ሼܺଷ 2ሽቁ.
8. Do the following functions define distribution functions?
40. 40
ሺi) ܨଵ(ݔ) = ൞
0, if ݔ < 0
,ݔif 0 ≤ ݔ ≤
ଵ
ଶ
;
1, if ݔ >
ଵ
ଶ
(ii) ܨଶ(ݔ) = ൜
0, if ݔ < 0
1 − ݁ି௫
, if ݔ ≥ 0
;
and
(iii) ܨଷ(ݔ) =
ଵ
ଶ
+
୲ୟ୬ షభ(௫)
గ
, −∞ < ݔ < ∞.
9. Let :ܨ ℝ → ℝ be defined by
)ݔ(ܨ = ൝
0, if ݔ < 0
1 −
2
3
݁ି
ೣ
మ −
1
3
݁ିቂ
ೣ
మ
ቃ
, if ݔ ≥ 0
,
where , for ݕ ∈ ℝ, ሾݕሿ denotes the largest integer ≤ .ݕ Show that ܨ is a d.f. of some r.v.
ܺ. Compute ܲ(ሼܺ > 4ሽ), ܲ(ሼܺ = 4ሽ), ܲ(ሼܺ ≥ 4ሽ), ܲ(ሼܺ = 3ሽ) and ܲ(ሼ3 ≤ ܺ < 6ሽ).
10. Let )∙(ܨ and )∙(ܩ be two distribution functions. Verify whether or not the following
functions are distribution functions:
(i) )ݔ(ܪ = )ݔ(ܨ + ;)ݔ(ܩ (ii) )ݔ(ܪ = max൫,)ݔ(ܨ )ݔ(ܩ൯ ; (iii) )ݔ(ܪ = min൫,)ݔ(ܨ )ݔ(ܩ൯.
11. (i) Let ܨଵ(∙), ⋯ , ܨ(∙) be distribution functions and let ܽଵ, ⋯ , ܽ be positive real
numbers satisfying ∑ ܽ
ୀଵ = 1. Show that ܩ(ݔ) = ∑ ܽ
ୀଵ ܨ(ݔ) is also a d.f.;
(ii) If ܨ(∙) is a d.f. and ߙ is a positive real constant, then show that ܩ(ݔ) = ൫)ݔ(ܨ൯
ఈ
and ܪ(ݔ) = 1 − ൫1 − ܨ(ݔ)൯
ఈ
are also distribution functions.
12. Do there exist real numbers ߙ, ߚ, ߛ and ߜ such that the following functions become
distribution functions?
(i) ܨ(ݔ) =
ە
ۖۖ
۔
ۖۖ
ۓ
0, if ݔ < 0
௫మ
ଶ
, if 0 ≤ ݔ < 0
ଵ
ଶ
+ ߙ(ݔ − 1)ଶ
, if 1 ≤ ݔ ≤ 2
ߚ +
(௫ିଶ)ర
, if 2 < ݔ ≤ 3
1, if ݔ > 3
; (ii) ܩ(ݔ) = ቊ
0, if ݔ ≤ 0
ߛ + ߜ݁ି
ೣమ
మ , if ݔ > 0
.
13. Do the following functions define probability mass functions of some random variables
of discrete type?
41. 41
ሺi) ݂ଵ(ݔ) = ቊ
௫
ଶ
, if ݔ ∈ ሼ−1, 0, 1, 2ሽ
0, otherwise
; (ii) ݂ଶ(ݔ) = ቊ
షభ
௫!
, if ݔ ∈ ሼ0, 1, 2, ⋯ ሽ
0, otherwise
;
(iii) ݂ଷ(ݔ) = ൝
ቀ
50
ݔ
ቁ ቀ
ଵ
ସ
ቁ
௫
ቀ
ଷ
ସ
ቁ
ହି௫
, if ݔ ∈ ሼ1, 2, ⋯ , 50ሽ
0, otherwise
.
14. For each of the following, find the value of constant ܿ so that ݂(∙) is a p.m.f. of some
discrete type r.v. (say ܺ). Also, for each of the following, find ܲ(ሼܺ > 2ሽ), ܲ(ሼܺ < 4ሽ),
and ܲ(ሼ1 < ܺ < 2ሽ):
(i) ݂(ݔ) = ൜
ܿ(1 − )௫
, if ݔ ∈ ሼ1, 2, 3, ⋯ ሽ
0, otherwise
; (ii) ݂(ݔ) = ቊ
ఒೣ
௫!
, if ݔ ∈ ሼ1, 2, ⋯ ሽ
0, otherwise
;
here ∈ (0,1) and ߣ > 0 are fixed constants.
15. Do the following functions define probability density functions of some random
variables of absolutely continuous type?
(i) ݂ଵ(ݔ) = ቊ
ଽା௫
ଵ଼
, if − 10 < ݔ < 10
0, otherwise
; (ii) ݂ଶ(ݔ) = ቊ
൫௫మାଵ൯షೣ
ଶ
, if ݔ > 0
0, otherwise
;
(iii) ݂ଷ()ݔ = ൝
2 + cos ݔ
2ߨ
, if 0 < ݔ < ߨ
0, otherwise
.
16. In each of the following, find the value of constant ܿ so that ݂(∙) is a p.d.f. of some r.v.
(say ܺ) of absolutely continuous type. Also, for each of the following, find ܲ(ሼܺ >
3ሽ), ܲ(ሼܺ ≤ 3ሽ), and ܲ(ሼ3 < ܺ < 4ሽ):
(i) ݂(ݔ) = ൜ܿ݁ݔି௫మ
, if ݔ > 0
0, otherwise
; (ii) ݂(ݔ) = ൜ܿ݁ݔି(௫ିଶ)
, if ݔ > 2
0, otherwise
.
17. (i) Let ܺ be a discrete type r.v. with support ܵ = ሼ0, 1, 2, 3, 4ሽ, ܲ(ሼܺ = 0ሽ) =
ܲ(ሼܺ = 1ሽ) =
ଵ
ଵ
, ܲ(ሼܺ = 2ሽ) = ܲ(ሼܺ = 3ሽ) = ܲ(ሼܺ = 4ሽ) =
ସ
ଵହ
. Find the d.f. ܺ and
sketch its graph.
(ii) Let the r.v. ܺ have the p.m.f.
42. 42
݂ሺݔሻ ൌ ൝
ݔ
5050
, if ݔ ∈ ሼ1, 2, ⋯ ,100ሽ
0, otherwise
.
Show that the d.f. of ܺ is
݂(ݔ) = ൞
0, if ݔ < 1
ሾݔሿ(ሾݔሿ + 1)
10100
, if 1 ≤ ݔ < 100
1, if ݔ ≥ 100
.
Also compute ܲ(ሼ3 < ܺ < 50ሽ).
18. For each of the following p.d.f.s of some r.v. (say ܺ) of absolutely continuous type, find
the d.f. and sketch its graph. Also compute ܲ(ሼ|ܺ| ൏ 1ሽ) and ܲ(ሼܺଶ
< 9ሽ).
(i) ݂(ݔ) = ቊ
௫మ
ଵ଼
, if − 3 < ݔ < 3
0, otherwise
; (ii) ݂(ݔ) = ቊ
௫ାଶ
ଵ଼
, if − 2 < ݔ < 4
0, otherwise
.
(iii) ݂(ݔ) = ቊ
ଵ
ଶ௫మ , if ||ݔ 1
0, otherwise
.
19. (i) Let ܺ be a r.v. of absolutely continuous type with p.d.f.
݂(ݔ) = ൜
ܿݔଶ
, if − 1 < ݔ < 1
0, otherwise
.
Compute the values of ܿ, ܲ(ሼܺ = 0ሽ), ܲ(ሼܺ > 0ሽ), ܲ(ሼܺ > 1/2ሽ), ܲ(ሼ|ܺ|
1/2ሽ), ܲ(ሼ1/2 < ܺ < 3/4ሽ), ܲ(ሼ1/2 < ܺ < 2ሽ) and the conditional probability
ܲ(ሼܺ < 3/4ሽ|ሼܺ 1/2ሽ);
(ii) Let ܺ be a r.v. of absolutely continuous type with p.d.f.
݂(ݔ) = ൜ܿ(ݔ + 1)݁ିఒ௫
, if ݔ > 0
0, otherwise
,
where ߣ > 0 is a given constant. Compute the values of ܿ, ܲ(ሼܺ = 2ሽ), ܲ(ሼܺ >
2ሽ), ܲ(ሼܺ > 1ሽ), ܲ(ሼ1 < ܺ < 3ሽ), ܲ(ሼ|ܺ െ 2| 1ሽ) and the conditional probability
ܲ(ሼܺ < 3ሽ|ሼܺ 1ሽ).
20. Let ܺ be a r.v. with d.f. ܨ(∙). In each of the following cases determine whether ܺ is of
discrete type or of absolutely continuous type. Also find the p.d.f./p.m.f. of ܺ:
43. 43
ሺi) ܨ(ݔ) =
ە
ۖۖ
۔
ۖۖ
ۓ
0, if ݔ < −2
ଵ
ଷ
, if − 2 ≤ ݔ < 0
ଵ
ଶ
, if 0 ≤ ݔ < 5
ଷ
ସ
, if 5 ≤ ݔ < 6
1, if ݔ ≥ 6
; (ii) ܨ(ݔ) = ൜
0, if ݔ < 0
1 − ݁ି௫
, if ݔ ≥ 0
.
21. Let the r.v. ܺ have the d.f.
ܨ(ݔ) =
ە
ۖ
۔
ۖ
ۓ
0, if ݔ < 0
ݔ
3
, if 0 ≤ ݔ < 1
2
3
, if 1 ≤ ݔ < 2
1, if ݔ ≥ 2
.
Show that ܺ is neither of discrete type nor of absolutely continuous type.
22. For the three d.f.s considered in Problems 20 and 21, find the decomposition
ܨ(ݔ) = ߙܨௗ(ݔ) + (1 − ߙ)ܨ(ݔ), ݔ ∈ ℝ, where ߙ ∈ ሾ0,1ሿ, ܨௗ is a d.f. of some r.v. of
discrete type and ܨ is a continuous d.f..