Phi
Microsoft's small models trained mainly on curated textbook-quality data.
Visão geral
Phi is a family of small language models trained on a deliberately narrow, high-quality corpus of textbooks and exercises rather than on a web-scale crawl. It solves the assumption that capability requires scale, showing that data selection can substitute for a large part of it. It exists because it reframes the question from how much data to what kind of data, and the answer is useful when the budget is a single GPU.
Grafo de tecnologias
Como Phi se liga ao resto do stack.
Usa e depende de
- Transformer architecture Algorithms Phi based on Transformer High ✓ source
Ferramentas
Software que implementa ou se integra com Phi.
Infrastructure
Alternativas
Comparações
Comparações detalhadas com as alternativas acima.