评估
模型质量如何被衡量：基准测试、排行榜、人类偏好，以及每一种各自可以被怎么刷分。读任何公开数字时都需要的背景。
6 technologies
- LLM-as-a-Judge technique Using a capable model to score another model's output.
- LM Evaluation Harness tool Standard harness for running language model benchmarks.
- Ragas tool Evaluation library that scores retrieval and answer quality separately.
- LangSmith tool Tracing and evaluation for model applications, showing each step of a run.
- DeepEval library Open-source framework of tests for model applications.
- TruLens library Instrumentation and feedback functions for evaluating model applications.