Skip to content

Commit 3bc59a2

Browse files
committed
Update blog
1 parent b5e791d commit 3bc59a2

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

content/blog/2025-10-10-1760088945.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -84,4 +84,9 @@ At fp32:
8484
- IREE (CUDA): 5.4 ms / it
8585
- IREE (Vulkan): 12.8 ms / it
8686
```
87-
{{< /details >}}
87+
{{< /details >}}
88+
89+
### Footnote: What about "glue code"?
90+
Glue code is the code connecting the various sub-models with each other (Text Encoder, VAE, Unet, Transformer etc), as well as the scheduling/sampling code (Euler, Heun etc). This code won't be included in the ONNX export (because it isn't part of the model), and therefore won't be compiled by ML compilers. This glue code uses torch for modifying tensors and generating intermediate tensors (random, zeros etc).
91+
92+
Which means this glue code will have to be ported to C++ (in order to avoid python and torch's installation size overhead). That's a decent amount of work. Projects like [stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp) implement them in C++ but are those lines are fairly entangled with the rest of the codebase.

0 commit comments

Comments
 (0)