The lottery ticket hypothesis suggests that much of the network's capacity is redundant. Regularization works partly by suppressing these redundant pathways. - Dropout can be seen as a stochastic way to search for winning tickets---it forces the network to find robust subnetworks.