Safetensors
File format for model weights designed to avoid arbitrary code execution.
Обзор
Safetensors stores tensors in a format that can be memory-mapped and read without executing anything, unlike frameworks that deserialise weights by running code. It solves a security problem and a performance one: loading a checkpoint should not be able to run arbitrary code, and it should not require reading the whole file into memory first. It exists because model weights are now downloaded from public hubs at a volume where both matter.
Граф технологий
Как Safetensors связана с остальным стеком.
Применяется к
- Inference concept Infrastructure Safetensors used for Inference High ✓ source
Инструменты
ПО, которое реализует Safetensors или интегрируется с ним.