### Problem Description Current transformers discard this layer, however, this is required for vllm if mtp is enabled ### Reproduction Steps ~ ### Environment Information _No response_ ### Error Logs ```shell ``` ### Additional Context _No response_
Problem Description
Current transformers discard this layer, however, this is required for vllm if mtp is enabled
Reproduction Steps
~
Environment Information
No response
Error Logs
Additional Context
No response