Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
v0.15.3	2026-02-06		0
core_v0.15.2	2026-01-08		0
core_v0.15.1	2026-01-07		0
core_v0.15.0	2025-12-05		0
core_v0.14.0	2025-10-08		0
Totals: 5 Items			0

Other Useful Business Software

Build on Google Cloud with $300 in Free Credit

New to Google Cloud? Get $300 in free credit to explore Compute Engine, BigQuery, Cloud Run, Vertex AI, and 150+ other products.

Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query exabytes in BigQuery, or build AI apps with Vertex AI and Gemini. Once your credits are used, keep building with 20+ products with free monthly usage, including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. Sign up to start building right away.

Start Free Trial

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Recommended Projects

GPT Neo
An implementation of model parallel GPT-2 and GPT-3-style models
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs
BertViz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
MiniMind
Train a 26M-parameter GPT from scratch in just 2h
Curated Transformers
PyTorch library of curated Transformer models and their components

Megatron Files

Ongoing research training transformer models at scale

Get an email when there's a new version of Megatron