Skip to content

[cuda backend] share AOTI weights by FQN across methods - #21823

Open
Gasoonjia wants to merge 1 commit into
rm-sha-mul-loadfrom
codex/cuda-fqn-weight-sharing
Open

[cuda backend] share AOTI weights by FQN across methods#21823
Gasoonjia wants to merge 1 commit into
rm-sha-mul-loadfrom
codex/cuda-fqn-weight-sharing

Conversation

@Gasoonjia

Copy link
Copy Markdown
Contributor

Summary

Currently we store weight in method granularity: if two methods do not share identical weight we have to keep two weight copies, even if they may just one tensor different.

This PR stores the weight in tensor granularity: we store the weight pickle format and use FQN as the key for each tensor. With this PR weight can be shared across different methods even if they are partially overlapped.

@pytorch-bot

pytorch-bot Bot commented Aug 13, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21823

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Unrelated Failure

As of commit b7d877f with merge base e60faa2 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following job failed but was likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 13, 2026
@Gasoonjia
Gasoonjia force-pushed the codex/cuda-fqn-weight-sharing branch from 071b477 to b7d877f Compare August 13, 2026 22:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant