PanGu-αHuawei
|
||||||
Related Products
|
||||||
About
MindSpore is an open source deep learning framework developed by Huawei, designed to facilitate easy development, efficient execution, and deployment across cloud, edge, and device environments. It supports multiple programming paradigms, including both object-oriented and functional programming, allowing users to define AI networks using native Python syntax. MindSpore offers a unified programming experience that seamlessly integrates dynamic and static graphs, enhancing compatibility and performance. It is optimized for various hardware platforms, including CPUs, GPUs, and NPUs, and is particularly well-suited for Huawei's Ascend AI processors. MindSpore's architecture comprises four layers, the model layer, MindExpression (ME) for AI model development, MindCompiler for optimization, and the runtime layer supporting device-edge-cloud collaboration. Additionally, MindSpore provides a rich ecosystem of domain-specific toolkits and extension packages, such as MindSpore NLP.
|
About
PanGu-α is developed under the MindSpore and trained on a cluster of 2048 Ascend 910 AI processors. The training parallelism strategy is implemented based on MindSpore Auto-parallel, which composes five parallelism dimensions to scale the training task to 2048 processors efficiently, including data parallelism, op-level model parallelism, pipeline model parallelism, optimizer model parallelism and rematerialization. To enhance the generalization ability of PanGu-α, we collect 1.1TB high-quality Chinese data from a wide range of domains to pretrain the model. We empirically test the generation ability of PanGu-α in various scenarios including text summarization, question answering, dialogue generation, etc. Moreover, we investigate the effect of model scales on the few-shot performances across a broad range of Chinese NLP tasks. The experimental results demonstrate the superior capabilities of PanGu-α in performing various tasks under few-shot or zero-shot settings.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Data scientists, AI researchers, and developers in need of a tool for building and deploying AI models across various platforms and devices
|
Audience
AI developers interested in a powerful large language model
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationMindSpore
Founded: 2019
China
www.mindspore.cn/
|
Company InformationHuawei
Founded: 1987
China
arxiv.org/abs/2104.12369
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Ascend Cloud Service
Docker
Huawei Cloud
Huawei Cloud ModelArts
Python
|
Integrations
Ascend Cloud Service
Docker
Huawei Cloud
Huawei Cloud ModelArts
Python
|
|||||
|
|
|