Download
Bolt is a high-performance deep learning inference framework developed by Huawei Noah's Ark Lab. It is designed to optimize and accelerate the deployment of deep learning models across various hardware platforms. Bolt is a light-weight library for deep learning. Bolt, as a universal deployment tool for all kinds of neural networks, aims to automate the deployment pipeline and achieve extreme acceleration. Bolt has been widely deployed and used in many departments of HUAWEI company, such as 2012 Laboratory, CBG and HUAWEI Product Lines. If you have questions or suggestions, you can submit issue.
Features
- Supports multiple hardware architectures, including CPUs, GPUs, and NPUs
- Provides optimized operators for efficient computation
- Offers model quantization for reduced memory usage and faster inference
- Includes a model conversion tool for compatibility with various frameworks
- Supports dynamic shape inference for flexible input sizes
- Open-source with a focus on performance optimization
Project Samples
License
MIT LicenseFollow Bolt NLP
Other Useful Business Software
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Bolt NLP!
