Linear algebra (vectors, matrices, decompositions) - Calculus (gradients, optimization) - Probability and statistics (distributions, estimation, hypothesis testing) - Optimization theory (gradient descent, convex optimization)