Manipulate probabilities using the sum rule, product rule, and Bayes' theorem - Work with discrete and continuous distributions in NumPy - Estimate parameters from data using MLE and MAP - Compute and interpret entropy, cross-entropy, and KL divergence - Apply mutual information to measure statistic