Ongoing research training transformer models at scale
This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM.
SourceForge is not affiliated with Megatron.
Megatron is a trademark of NVIDIA CORPORATION.
Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.
Build generative AI apps with Vertex AI Studio. Switch between models without switching platforms.
Start Free
Powerful App Monitoring Without Surprise Bills
AppSignal starts at $23/month with all features included. No overages, no hidden fees. 30-day free trial.
Tired of monitoring tools that punish you for scaling? AppSignal offers transparent, predictable pricing with every feature unlocked on every plan. Track errors, monitor performance, detect anomalies, and manage logs across Ruby, Python, Node.js, and more. Trusted by developers since 2012 with free dev-to-dev support. No credit card required to start your 30-day trial.