FineData

FineData on Hugging Face Daily Papers: 2 papers, 2 in the top 3 of their day, 1 paper of the day.

1. FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language 55 upvotes, #2 of 2025-06-26
2. The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale 72 upvotes, #1 of 2024-06-26

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.