DOLMA Files

Data and tools for generating and inspecting OLMo pre-training data

This is an exact mirror of the DOLMA project, hosted at https://github.com/allenai/dolma. SourceForge is not affiliated with DOLMA. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-06-25	421 Bytes	0
v1.2.1 source code.tar.gz	2025-06-25	17.1 MB	0
v1.2.1 source code.zip	2025-06-25	17.4 MB	2
Totals: 3 Items		34.4 MB	2

What's Changed

FIM script modifications by @regan-huff in https://github.com/allenai/dolma/pull/258
Adding tool to reshard npy files based on maximum desired size. by @soldni in https://github.com/allenai/dolma/pull/269

New Contributors

@regan-huff made their first contribution in https://github.com/allenai/dolma/pull/258

Full Changelog: https://github.com/allenai/dolma/compare/v1.2.0...v1.2.1

Source: README.md, updated 2025-06-25

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

MongoDB Atlas | Run databases anywhere

Ensure the availability of your data with coverage across AWS, Azure, and GCP on MongoDB Atlas—the multi-cloud database for every enterprise.

MongoDB Atlas allows you to build and run modern applications across 125+ cloud regions, spanning AWS, Azure, and Google Cloud. Its multi-cloud clusters enable seamless data distribution and automated failover between cloud providers, ensuring high availability and flexibility without added complexity.

Learn More

Recommended Projects

Activepieces
Open Source AI Automation
7-Zip
A free file archiver for extremely high compression
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
Apache OpenOffice
The free and Open Source productivity suite
Clonezilla
A partition and disk imaging/cloning program

DOLMA Files

Data and tools for generating and inspecting OLMo pre-training data

Get an email when there's a new version of DOLMA

What's Changed

New Contributors