BEIR
Heterogeneous retrieval benchmark for zero-shot evaluation.
Aperçu
BEIR evaluates retrieval models across eighteen datasets from different domains, without training on them. It solves the problem that a model tuned for one collection looks excellent on it and generalises poorly, which is invisible when you only test where you trained. It exists as the benchmark that made general-purpose retrieval a measurable claim rather than an assumed one.
Graphe des technologies
Comment BEIR se rattache au reste de la pile.
Utilise et dépend de
- MTEB benchmark Benchmarks MTEB based on BEIR High ✓ source
Appliqué à
- AI Search application Applications BEIR used for AI Search High ✓ source
- Embedding concept Techniques BEIR used for Embedding High ✓ source