Replies: 1 comment
-
|
Would be awesome to support this! attn_output = einsum(attn_weights, v, "b h s t, b h t d -> b s (h d)") |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I mostly use this lib for tensor computing, and I find it really useful. However, I find that I always need to write several lines of code to implement a simple idea. One example is tensor the product (Kronecker product).
wher I compute b as the kronecker product of a:$b= a\otimes a$ , and I feel this is unnecessarily complicated. I think it would be wonderful if rearrange is supported in einsum.
Beta Was this translation helpful? Give feedback.
All reactions