Ray
Distributed execution framework for scaling Python workloads.
Visão geral
Ray turns ordinary Python functions and classes into distributed tasks and actors with a scheduler that handles placement, failure and state. It solves the problem that scaling a training or inference job across machines otherwise means rewriting it around a cluster API. It exists as the substrate several training and serving systems are built on, which is why it appears beneath them rather than beside them.
Grafo de tecnologias
Como Ray se liga ao resto do stack.
Aplicado a
- Inference concept Infrastructure Ray used for Inference High ✓ source
- Pretraining technique Techniques Ray used for Pretraining High ✓ source
Ferramentas
Software que implementa ou se integra com Ray.