ExecuTorch for On-Device PyTorch

ExecuTorch is a PyTorch-native framework for deploying models to edge devices. A typical path starts with a PyTorch model and example inputs, exports the program, lowers it through edge-specific representations, and produces an artifact for the ExecuTorch runtime. The runtime is designed to be embedded into applications and can execute on platforms such as Android, iOS, desktop, and embedded systems depending on build and backend support. A backend delegate lets a hardware or software backend execute operations it supports. A model may be lowered entirely to a backend or partitioned so supported subgraphs use a delegate while other operations stay in the runtime. This provides flexibility, but partition boundaries can add data movement or synchronization. Unsupported operators, dynamic behavior, tensor constraints, or custom operations may prevent export or delegation. Export is not the same as training or conversion into a universal artifact. It captures a program for specified inputs and constraints. Input shapes, dtypes, control flow, and model state should be tested. The resulting artifact may need a backend-specific build and runtime libraries. Device vendors and backend maintainers expose different operator coverage and accelerator support; do not infer capabilities from the ExecuTorch name alone. A reliable workflow begins with a small exported model and reference outputs. Compare runtime predictions with eager PyTorch, then integrate preprocessing and postprocessing into the app. Profile cold load, warm latency, memory, binary size, and energy on target devices. Test fallback behavior if a delegate is unavailable. Benchmark across devices and OS versions that matter to users. ExecuTorch can reduce the gap between PyTorch development and on-device inference, while developers still own application lifecycle, model updates, data privacy, and performance. Pin versions and preserve the export inputs and configuration. A successful export is a milestone, not proof of equivalent outputs or production readiness.