Skip to content

Migrate geneformer to the V2 104M model #110

Description

@rcannood

Follow-up to #106, which pinned the huggingface downloads to 42dbf0ae (2025-06-13) so the existing 95M model keeps working.

Upstream has moved on. ctheodoris/Geneformer@main now offers Geneformer-V1-10M, Geneformer-V2-104M, Geneformer-V2-104M_CLcancer and Geneformer-V2-316M, and the dictionaries are *_gc104M.pkl. The gf-*-i4096 layout the component knows about is gone.

Migrating means:

  • new --model choices, and dropping the gf-<layers>-<dataset>-i<input_size> name parsing in src/methods/geneformer/script.py, since the V2 directories do not encode those the same way
  • the dictionaries_subfolder branch on 95M/30M needs a 104M arm
  • dropping the revision pin once the component targets main's layout

Worth deciding deliberately rather than drifting into it: V2 is a different model, so scores are not comparable with previous runs. Whoever picks this up should say in the PR whether the intent is to replace the 95M results or to report both.

Also relevant: #96, which proposed exactly this migration when the breakage was first reported.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions