Skip to content

Selective operator build workflow for multiple models in a single runtime environment #18104

@nyari-kovacs-arm

Description

@nyari-kovacs-arm

🚀 The feature, motivation and pitch

ExecuTorch provides several mechanisms for selective operator compilation (e.g. EXECUTORCH_SELECT_OPS_MODEL, EXECUTORCH_SELECT_OPS_YAML). These workflows appear to be primarily designed around building a runtime for a single model.

In deployments where a single runtime must support multiple models, each model may require a different set of operators. Currently this typically requires manually extracting and merging operator sets from multiple models before building.

It would be able to provide multiple models or YAML files as input for operator extraction, or to document a recommended workflow for building a runtime that supports multiple models.

This would simplify common scenarios where one ExecuTorch runtime needs to execute several models.

Alternatives

Have been using a solution by merging multiple YAML files outside of Executorch, so that is a usable workaround.

Additional context

No response

RFC (Optional)

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNot as big of a feature, but technically not a bug. Should be easy to fix

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions