FineWeb
Filtered and deduplicated web corpus with a published processing pipeline.
Обзор
FineWeb is a 15-trillion-token web corpus derived from Common Crawl, released together with the exact filtering and deduplication steps used to produce it. It solves the problem that most published corpora document their contents but not their construction, leaving any difference in results unattributable. It exists as a corpus built to be reproducible, which makes it usable as a baseline rather than just as data.
Граф технологий
Как FineWeb связана с остальным стеком.
Использует и зависит от
- Common Crawl dataset Datasets FineWeb based on Common Crawl High ✓ source
Применяется к
- Pretraining technique Techniques FineWeb used for Pretraining High ✓ source
Альтернативы
-
Colossal Clean Crawled Corpus
dataset
Альтернатива для FineWeb · source
Сравнения
Подробные сопоставления с альтернативами выше.