Skip to content

[Docs] Add BYOC external library dispatch architecture documentation#19395

Merged
MasterJH5574 merged 2 commits intoapache:mainfrom
tlopex:doc221
Apr 12, 2026
Merged

[Docs] Add BYOC external library dispatch architecture documentation#19395
MasterJH5574 merged 2 commits intoapache:mainfrom
tlopex:doc221

Conversation

@tlopex
Copy link
Copy Markdown
Member

@tlopex tlopex commented Apr 12, 2026

Add an architecture document (docs/arch/external_library_dispatch.rst) for TVM's BYOC (Bring Your Own Codegen) mechanism, covering the end-to-end pipeline for offloading operator subgraphs to external libraries (cuBLAS, CUTLASS, cuDNN, DNNL)

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new architectural document, external_library_dispatch.rst, which provides a detailed overview of the External Library Dispatch (BYOC) pipeline in TVM Relax. The documentation covers pattern registration, partitioning, code generation, and runtime execution, and is integrated into the main architecture index. Feedback focused on technical accuracy: correcting the pipeline diagram to show that partitioning happens on high-level Relax IR before the LegalizeOps pass, and updating the C++ FFI example to use GetGlobal with an existence check instead of GetGlobalRequired.

@MasterJH5574 MasterJH5574 merged commit e22be4e into apache:main Apr 12, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants