Skip to content

Latest commit

 

History

History
39 lines (30 loc) · 6.04 KB

File metadata and controls

39 lines (30 loc) · 6.04 KB

Additional Models for Web-SSL

In response to community feedback, we are open-sourcing a few additional models that are not part of the official release. Please note that we cannot accommodate every request.

SSL Head Weights

We provide the original teacher checkpoints from SSL pretraining for those who want to examine the SSL heads or continue SSL pretraining with our models. We only provide PyTorch format for these models. Note that these models are exactly the same as the official model weights, except with the original checkpoint key names, and SSL heads included. See the main README for model and data notes.

To load the models for SSL, please refer to the original DINOv2 codebase, e.g. this function as a starting point. You will need to adjust your config to use the right model architecture.

Model Patch Size Resolution Data SSL Weights
webssl-dino300m-full2b-224 14x14 224x224 2B (MC-2B) Full Teacher / Heads Only
webssl-dino1b-full2b-224 14x14 224x224 2B (MC-2B) Full Teacher / Heads Only
webssl-dino2b-full2b-224 14x14 224x224 2B (MC-2B) Full Teacher / Heads Only
webssl-dino3b-full2b-224 14x14 224x224 2B (MC-2B) Full Teacher / Heads Only
webssl-dino5b-full2b-224 14x14 224x224 2B (MC-2B) Full Teacher / Heads Only
webssl-dino7b-full8b-224 14x14 224x224 8B (MC-2B) Full Teacher / Heads Only
webssl-dino7b-full8b-378 14x14 378x378 8B (MC-2B) Full Teacher / Heads Only
webssl-dino7b-full8b-518 14x14 518x518 8B (MC-2B) Full Teacher / Heads Only
webssl-dino300m-light2b-224 14x14 224x224 2B (MC-2B light) Full Teacher / Heads Only

| webssl-dino2b-light2b-224 | 14x14 | 224x224 | 2B (MC-2B light) | Full Teacher / Heads Only | | webssl-dino2b-heavy2b-224 | 14x14 | 224x224 | 2B (MC-2B heavy) | Full Teacher / Heads Only | | webssl-dino3b-light2b-224 | 14x14 | 224x224 | 2B (MC-2B light) | Full Teacher / Heads Only | | webssl-dino3b-heavy2b-224 | 14x14 | 224x224 | 2B (MC-2B heavy) | Full Teacher / Heads Only |

ImageNet-1K Pretrained Models

We provide the DINO ViT-1B to 3B models trained on ImageNet-1k in PyTorch format. We do not recommend using these models in practice, as they will not perform well compared to our official Web-SSL model family trained on web-scale images. Please also note that these Web-SSL variants were trained by us for the purpose of ablations, and are not related to the official DINO/v2/v3 releases.

Model Patch Size Resolution Data Encoder Weights SSL Weights
webssl-dino1b-in1k-224 14x14 224x224 IN-1k Link Full Teacher / Heads Only
webssl-dino2b-in1k-224 14x14 224x224 IN-1k Link Full Teacher / Heads Only
webssl-dino3b-in1k-224 14x14 224x224 IN-1k Link Full Teacher / Heads Only