NVIDIA CUDA
NVIDIA's parallel computing platform, the layer most AI software is written against.
Resumen
CUDA is NVIDIA's programming model and toolchain for running general computation on its GPUs, and it is the layer that PyTorch, TensorRT and most inference servers ultimately call. It solves the problem of expressing parallel work without writing raw GPU assembly. It exists as the practical reason NVIDIA dominates AI hardware: the performance advantage is reinforced by an ecosystem that only targets its chips, which is a moat no competitor's benchmark can remove on its own.
Grafo de tecnologías
Cómo se conecta NVIDIA CUDA con el resto del stack.
Usa y depende de
- TensorRT-LLM tool Infrastructure TensorRT-LLM depends on NVIDIA CUDA High ✓ source
Usado por
- JAX framework Frameworks NVIDIA CUDA used by JAX High ✓ source
- PyTorch framework Frameworks NVIDIA CUDA used by PyTorch High ✓ source
- TensorFlow framework Frameworks NVIDIA CUDA used by TensorFlow High ✓ source