Repositories list

• cmu-paper-reviewer

  Public
  Code repository for the "CMU Paper Reviewer System", a agentic system that generates reviews for academic papers.

  Python

  •11 fork•33 stars•00 issues•00 pull requests•Updated Apr 29, 2026Apr 29, 2026

• prometheus-eval

  Public
  Evaluate your LLM's response with Prometheus and GPT4 💯

  pythonevaluationgpt4+ 6

  pythonevaluationgpt4llmllmopsvllmlitellmllm-as-a-judgellm-as-evaluator

  Python

  •

  Apache License 2.0

  •7070 forks•1.1k1.1k stars•1212 issues•22 pull requests•Updated Apr 25, 2025Apr 25, 2025

• scaling-evaluation-compute

  Public
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"

  00 forks•1212 stars•11 issue•00 pull requests•Updated Mar 25, 2025Mar 25, 2025

• prometheus-vision

  Public
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-…

  Python

  •

  Apache License 2.0

  •77 forks•8585 stars•33 issues•00 pull requests•Updated Sep 13, 2024Sep 13, 2024

• .github

  Public
  Organization README for prometheus-eval

  00 forks•00 stars•00 issues•00 pull requests•Updated Jun 11, 2024Jun 11, 2024

• leaderboard

  Public
  BiGGen-Bench Leaderboard

  Python

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 4, 2024Jun 4, 2024

• prometheus-eval.github.io

  Public
  Documentation and blogposts for Prometheus

  11 fork•00 stars•00 issues•00 pull requests•Updated May 1, 2024May 1, 2024

• prometheus

  Public
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-graine…

  Python

  •

  MIT License

  •1717 forks•315315 stars•44 issues•00 pull requests•Updated Nov 11, 2023Nov 11, 2023