Probability & Statistics

Random variables, distributions, Bayes theorem, information theory, and estimation

1.

Probability Basics WIP

Fundamental concepts of probability theory

2.

Probability Note 2 WIP

Probability theory continued — joint distributions, expectations, and transformations

3.

Bayesian Inference WIP

Bayesian approach to statistical inference

4.

Information Theory

Entropy, Information Gain, Gini Impurity, Cross-Entropy, KL-Divergence

5.

MLE & MAP Estimation WIP

Maximum Likelihood Estimation and Maximum A Posteriori estimation

6.

Probability Theory

Axioms, random variables, distributions, expectations, covariance, and change of variables