Glossary

Key practical tips:

Always call `model.train()` before training and `model.eval()` before evaluation. This is the most common dropout-related bug (as we noted in Chapter 12 regarding batch normalization). - Dropout interacts with batch normalization. The conventional wisdom is to **not** use dropout in the same block a

Learn More

Related Terms