Skip to content

DeepSeek-V4-Pro-IQ2XXS quant no longer working well on single Mac Studio 512 #331

@links486

Description

@links486

While running deepseek-v4-pro with the latest commit (477c0e8 at the time of writing) on a single 512GB Mac Studio, generation was so slow it was basically unusable. Watching mactop, it looked like memory was rapidly allocating/deallocating with high CPU usage observed on the ds4-server process too.

Reverting to the commit prior to 3c3ad4c returned things to normal.

Temporary workaround for anyone else experiencing this:

  1. git checkout ba00a8a88c4c5810a3d1fed6b7b8fa2b44b82fdc
  2. make clean
  3. make

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions