Network connectivity is unreliable or unavailable - Latency requirements are extreme (autonomous vehicle decisions in milliseconds) - Privacy requirements prohibit sending data to the cloud - The model is small enough to run on constrained hardware