Download
neural-speed is an innovative library developed by Intel to enhance the efficiency of Large Language Model (LLM) inference through low-bit quantization techniques. By reducing the precision of model weights and activations, neural-speed aims to accelerate inference while maintaining model accuracy, making it suitable for deployment in resource-constrained environments.
Features
- Low-bit quantization for LLMs
- Accelerates inference performance
- Maintains model accuracy
- Suitable for resource-constrained environments
- Developed by Intel
- Supports various LLM architectures
- Open-source library
- Comprehensive documentation
- Facilitates efficient AI deployments
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow Neural Speed
Other Useful Business Software
Build AI Apps with Gemini 3 on Vertex AI
Vertex AI gives developers access to Gemini 3—Google’s most advanced reasoning and coding model—plus 200+ foundation models including Claude, Llama, and Gemma. Build generative AI apps with Vertex AI Studio, customize with fine-tuning, and deploy to production with enterprise-grade MLOps. New customers get $300 in free credits.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Neural Speed!
