Probability Theory (Math W4155) - Spring 2015

The purpose of this course is to provide a mathematically rigorous introduction to the basic notions and results of probability theory. We shall discuss probability spaces and random variables, measure theory and integration, probabilistic concepts such as independence, conditional expectation or moments, fundamental results like the law of large numbers and the central limit theorem, and basic models such as random walks and Markov chains.

General Information

Exercises

There will be weekly homework assignments, generally assigned on Tuesdays and due the following Tuesday by 10:00am in the box next to 417 Math. Late homework will not be accepted. Graded homework will delivered to the tray next to 520 Math, generally by Thursday. Your lowest two homework scores will be dropped, and it is expected that this will take care of any homework you may fail to hand in due to illness, travel, bad luck, and so on. You are encouraged to discuss the homework with fellow students, but you must write your solutions individually. Exercises and Solutions are posted on Courseworks.

Syllabus

The syllabus is tentative and may change during the semester.
Please consult the Academic Calendar for important dates such as the last day to drop the class.

I. Basics
1. Probability Spaces S 1.1-14; R 1.1-9, 2.1
2. Discrete Random Variables S 4.1-3
3. General Random Variables
a) Transformation of Probability Spaces R 3.1-3
b) Uniqueness of Probability Measures R 2.2-3
c) Probability on the Real Line S 4.1-2,7.1
d) Expectation S 4.3, 8.5; R 5.1-6
4. Some Probabilistic Inequalities S 4.6; R 6.6

II. Dependence and Independence
1. Conditional Probability and Distribution S 2.1-13
2. Independence S 5.2, 8.3; R 4.1-2, 4.5
3. (In)dependence and Correlation S 5.3, 5.11
4. Product Measure and Fubini's Theorem S 5.1-4, 8.1-4, 8.17; R 5.7-9
5. Random Walk and Gambling S 2.11, 5.6, 5.18, 5.20

III. Limit Theorems
1. The Weak Law of Large Numbers S 5.8; R 6.1-3, 7.2
2. The Strong Law of Large Numbers R 7.5
3. The Central Limit Theorem S 7.5, 8.9

IV. Markov Chains
1. The Markov Property S 9.1-2
2. Hitting Times S 9.3
3. The Strong Markov Property
4. Recurrence and Transience S. 9.5
5. Convergence to Equilibrium S. 9.4-5
6. Applications