Phi
Microsoft's small models trained mainly on curated textbook-quality data.
Resumen
Phi is a family of small language models trained on a deliberately narrow, high-quality corpus of textbooks and exercises rather than on a web-scale crawl. It solves the assumption that capability requires scale, showing that data selection can substitute for a large part of it. It exists because it reframes the question from how much data to what kind of data, and the answer is useful when the budget is a single GPU.
Grafo de tecnologías
Cómo se conecta Phi con el resto del stack.
Usa y depende de
- Transformer architecture Algorithms Phi based on Transformer High ✓ source
Herramientas
Software que implementa o se integra con Phi.
Infrastructure
Alternativas
Comparativas
Comparativas detalladas con las alternativas anteriores.