Phi
Microsoft's small models trained mainly on curated textbook-quality data.
Обзор
Phi is a family of small language models trained on a deliberately narrow, high-quality corpus of textbooks and exercises rather than on a web-scale crawl. It solves the assumption that capability requires scale, showing that data selection can substitute for a large part of it. It exists because it reframes the question from how much data to what kind of data, and the answer is useful when the budget is a single GPU.
Граф технологий
Как Phi связана с остальным стеком.
Использует и зависит от
- Transformer architecture Algorithms Phi based on Transformer High ✓ source
Инструменты
ПО, которое реализует Phi или интегрируется с ним.
Infrastructure
Альтернативы
Сравнения
Подробные сопоставления с альтернативами выше.