Install uv. Clone this repository, then from the root directory:
uv run python -m saev --helpYou also need yek and lychee for generating docs.
If you want to do any of the web interface work, you need elm, elm-format, tailwindcss and bun.
benchmark.py <- Launch script for benchmarking models on tasks.
report.py <- Launch script for producing the report.json file.
biobench/ <- Source code for benchmarking.
beluga/
__init__.py
download.py
fishnet/
__init__.py
download.py
...
config.py
registry.py
reporting.py
schema.sql
third_party_models.py
docs/
api/
assets/
data/
research/
todo/
index.html
web/
src/
Leaderboard.elm
index.html
main.css
See AGENTS.md.
- Run
just test. - Check that there are no regressions. Unless you are certain tests are not needed, the coverage % should either stay the same or increase.
- Run
just docs. - Fix any missing doc links.
Be polite, kind and assume good intent.