Glossary

Training loop

forward pass, loss computation, backward pass, optimizer step, gradient accumulation, (2) **Evaluation** — periodic evaluation on a validation set with custom metrics, (3) **Logging** — integration with TensorBoard, Weights & Biases, and other logging frameworks, (4) **Checkpointing** — automatic mo

Learn More

Related Terms