Official code for ACL2025 "🔍 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models"
-
Updated
Dec 22, 2025 - JavaScript
#
retrieval-evaluation
Here are 13 public repositories matching this topic...
Official codebase for the ACL 2025 Findings paper: Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval.
information-retrieval bert bm25 passage-retrieval ndcg text-embedding amharic-corpus mrr roberta amharic-nlp huggingface-transformers colbert multilingual-nlp low-resource-nlp dense-retrieval amharic-language retrieval-evaluation academic-benchmark
-
Updated
Jul 26, 2025 - Jupyter Notebook
smallevals — CPU-fast, GPU-blazing fast offline retrieval evaluation for RAG systems with tiny QA models.
qa chroma question-generation weaviate qa-generation milvus vector-database qdrant chromadb rag-evaluation tiny-llm retrieval-evaluation offline-evaluation retrieval-metrics
-
Updated
Dec 4, 2025 - Python
image-reconstruction neuroscience pytorch medical-imaging neuroimaging nsd fmri representation-learning clip uncertainty-estimation probabilistic-modeling multimodal-learning self-supervised-learning brain-decoding contrastive-learning stable-diffusion openclip retrieval-evaluation vision-reconstruction
-
Updated
Apr 21, 2026 - Python
Deterministic RAG evaluation toolkit -- retrieval metrics (recall, precision, MRR), corpus overlap detection, and CI regression gating without model calls.
-
Updated
Apr 13, 2026 - Python
Visual RAPTOR ColBERT Integration System - Multimodal document retrieval with SigLIP, PyMuPDF, and evaluation metrics.
information-retrieval evaluation-metrics raptor document-retrieval pymupdf multimodal-retrieval document-embeddings image-embeddings knowledge-tree pdf-processing colbert siglip vision-language-models multimodal-rag rag-benchmarks retrieval-evaluation hierarchical-retrieval
-
Updated
Oct 24, 2025 - Python
A systems-level analysis of static RAG pipelines, isolating ingestion, retrieval, and ranking boundaries to expose structural failure modes before generation.
information-retrieval evaluation ranking chunking system-design rag ai-systems failure-modes hybrid-retrieval retrieval-augmented-generation retrieval-evaluation llm-systems
-
Updated
Jan 24, 2026
A controlled experiment evaluating whether hybrid (dense + sparse) retrieval surfaces evidence that dense-only RAG systems misrank—without changing generation behavior.
-
Updated
Jan 23, 2026 - Python
Research-grade neuro-symbolic RAG framework where retrieval is a policy, not a vector search, built for evaluation, ablation, and reliability analysis.
information-retrieval semantic-search umap bm25 hierarchical-clustering faiss rag neuro-symbolic ablation-study hybrid-retrieval knowledge-retrieval retrieval-evaluation llm-systems graph-retrieval
-
Updated
Jan 4, 2026 - Python
Frozen three-run probe of notebook parity under a fixed Anthropic live path, comparing text_ledger, chart_only_ledger, and chart_plus_text_ledger on retrieval, prediction, mechanism, and control.
-
Updated
Apr 7, 2026 - Python
QPP for Clarification Need Prediction in context-grounded multi-turn Conversation. Clean implementations of QPP baselines suitable for multi-turn conversational dataset with ranked documents (opt.). Designed to detect ambiguous search queries.
natural-language-processing chatbot-framework statistical-models conversational-agents query-understanding query-performance-prediction retrieval-augmented-generation retrieval-evaluation multi-turn-conversation
-
Updated
Apr 22, 2026 - Python
📚 Build an offline multimodal RAG system that retrieves grounded answers from diverse document types with full citation support, all in one unified interface.
qa xapian faiss weaviate qa-generation milvus sentence-transformers qdrant crossencoder chromadb tiny-llm shtf retrieval-evaluation docker-model-runner retrieval-metrics
-
Updated
Apr 22, 2026 - TypeScript
Local-first memory infrastructure for coding workflows: deterministic retrieval, explainable traces, MCP/REST/SDK interfaces, and standalone browser-first operation.
python knowledge-graph python-sdk observability codex rag local-first standalone-app hybrid-search local-ai ollama ai-memory gemini-cli mcp-server agent-memory claude-code retrieval-evaluation context-engineering mcp-memory memory-infrastructure
-
Updated
Mar 3, 2026 - Python
Improve this page
Add a description, image, and links to the retrieval-evaluation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the retrieval-evaluation topic, visit your repo's landing page and select "manage topics."