NVIDIA CUDA
NVIDIA's parallel computing platform, the layer most AI software is written against.
Überblick
CUDA is NVIDIA's programming model and toolchain for running general computation on its GPUs, and it is the layer that PyTorch, TensorRT and most inference servers ultimately call. It solves the problem of expressing parallel work without writing raw GPU assembly. It exists as the practical reason NVIDIA dominates AI hardware: the performance advantage is reinforced by an ecosystem that only targets its chips, which is a moat no competitor's benchmark can remove on its own.
Technologiegraph
Wie NVIDIA CUDA mit dem übrigen Stack zusammenhängt.
Nutzt und hängt ab von
- TensorRT-LLM tool Infrastructure TensorRT-LLM depends on NVIDIA CUDA High ✓ source
Genutzt von
- JAX framework Frameworks NVIDIA CUDA used by JAX High ✓ source
- PyTorch framework Frameworks NVIDIA CUDA used by PyTorch High ✓ source
- TensorFlow framework Frameworks NVIDIA CUDA used by TensorFlow High ✓ source