As models move to devices, developers need better ways to optimize them for constrained environments.
Create tooling that automatically quantizes, prunes, and compiles models for specific hardware targets.
Sell to mobile/app developers incorporating AI features.
Start with support for popular model architectures and common mobile chipsets.
Risk is hardware vendors releasing their own optimized toolchains.