[COCO Segmentation] test-dev 2017 evaluation sever unavailable and Codabench do not have COCO benchmark

[hvpng]

Hi COCO team,

This is related to cocodataset/cocoapi#691.

I'm facing the same issue for the instance segmentation (mask) task specifically. The evaluation server at https://codalab.lisn.upsaclay.fr/competitions/7383 now returns "Submissions have been disabled by admins" when attempting to submit.

To summarize the current state:

• competitions.codalab.org - fully suspended
• codalab.lisn.upsaclay.fr/competitions/7383 (segm) - submissions disabled
• codalab.lisn.upsaclay.fr/competitions/7384 (bbox) - submissions disabled
• CodaBench - no active COCO competition found

This makes it impossible to report test-dev2017 results for publication, which is a significant blocker for the research community.

Could the COCO team (@cocodataset) provide any update on:

1. Whether there is a currently active server for test-dev2017 evaluation?
2. If a migration to CodaBench or another platform is planned, what is the expected timeline?

Thank you for your work on maintaining this benchmark.

[Didayolo]

Hi @hvpng,

As a Codabench administrator, I just want to jump in to add some information:

• Migrating the benchmark from CodaLab to Codabench is technically doable, and even simple and straightforward.
• We keep the responsablity of deciding to migrate to the new server in the hands of the organizers, we do not interfer with this decision.
• If COCO organizers want to migrate the benchmark to Codabench, but do not want to perform the migration, they can simply ask us and we'll perform the migration for them.