DeepSpeed

DeepSpeed

Microsoft
MXNet

MXNet

The Apache Software Foundation
+
+

Related Products

  • Vertex AI
    783 Ratings
    Visit Website
  • RunPod
    180 Ratings
    Visit Website
  • Cloudflare
    1,903 Ratings
    Visit Website
  • Qloo
    23 Ratings
    Visit Website
  • Dragonfly
    16 Ratings
    Visit Website
  • Fraud.net
    56 Ratings
    Visit Website
  • OORT DataHub
    13 Ratings
    Visit Website
  • PackageX OCR Scanning
    46 Ratings
    Visit Website
  • Nexo
    16,471 Ratings
    Visit Website
  • Evertune
    1 Rating
    Visit Website

About

DeepSpeed is an open source deep learning optimization library for PyTorch. It's designed to reduce computing power and memory use, and to train large distributed models with better parallelism on existing computer hardware. DeepSpeed is optimized for low latency, high throughput training. DeepSpeed can train DL models with over a hundred billion parameters on the current generation of GPU clusters. It can also train up to 13 billion parameters in a single GPU. DeepSpeed is developed by Microsoft and aims to offer distributed training for large-scale models. It's built on top of PyTorch, which specializes in data parallelism.

About

A hybrid front-end seamlessly transitions between Gluon eager imperative mode and symbolic mode to provide both flexibility and speed. Scalable distributed training and performance optimization in research and production is enabled by the dual parameter server and Horovod support. Deep integration into Python and support for Scala, Julia, Clojure, Java, C++, R and Perl. A thriving ecosystem of tools and libraries extends MXNet and enables use-cases in computer vision, NLP, time series and more. Apache MXNet is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision-making process have stabilized in a manner consistent with other successful ASF projects. Join the MXNet scientific community to contribute, learn, and get answers to your questions.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Deep learning model developers

Audience

Developers and researchers requiring an open-source deep learning framework for research prototyping and production

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Microsoft
Founded: 1975
United States
www.deepspeed.ai/

Company Information

The Apache Software Foundation
Founded: 1999
United States
mxnet.apache.org

Alternatives

Alternatives

GPT-NeoX

GPT-NeoX

EleutherAI
AWS Neuron

AWS Neuron

Amazon Web Services
Caffe

Caffe

BAIR

Categories

Categories

Integrations

AWS Elastic Fabric Adapter (EFA)
AWS Marketplace
Amazon EC2 Inf1 Instances
Amazon EC2 P4 Instances
Amazon Elastic Inference
Amazon SageMaker Debugger
Cake AI
Cameralyze
Comet LLM
Flower
GPUonCLOUD
Google Cloud Deep Learning VM Image
Gradient
Guild AI
Horovod
LeaderGPU
MLReef
Nurix
PyTorch
Python

Integrations

AWS Elastic Fabric Adapter (EFA)
AWS Marketplace
Amazon EC2 Inf1 Instances
Amazon EC2 P4 Instances
Amazon Elastic Inference
Amazon SageMaker Debugger
Cake AI
Cameralyze
Comet LLM
Flower
GPUonCLOUD
Google Cloud Deep Learning VM Image
Gradient
Guild AI
Horovod
LeaderGPU
MLReef
Nurix
PyTorch
Python
Claim DeepSpeed and update features and information
Claim DeepSpeed and update features and information
Claim MXNet and update features and information
Claim MXNet and update features and information