AutoGPTQ Files

An easy-to-use LLMs quantization package with user-friendly apis

This is an exact mirror of the AutoGPTQ project, hosted at https://github.com/AutoGPTQ/AutoGPTQ. SourceForge is not affiliated with AutoGPTQ. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2023-11-09	768 Bytes	0
v0.5.1_ Patch release source code.tar.gz	2023-11-09	7.4 MB	0
v0.5.1_ Patch release source code.zip	2023-11-09	7.5 MB	0
Totals: 3 Items		14.9 MB	0

Mainly fixes Windows support.

What's Changed

Update README and version following 0.5.0 release by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/397
Fix windows support by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/407
Fix quantize method with None mask by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/408
Improve message about buffer size in exllama v1 backend by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/410
Fix windows (no triton) and cpu-only support by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/411
Fix workflows to use pip instead of conda by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/419

Full Changelog: https://github.com/PanQiWei/AutoGPTQ/compare/v0.5.0...v0.5.1

Source: README.md, updated 2023-11-09

Other Useful Business Software

Our Free Plans just got better! | Auth0 Icon

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Context for your AI agents Icon

Context for your AI agents

Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.

Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.

Try for free

Recommended Projects

NNCF
Neural Network Compression Framework for enhanced OpenVINO
Bolt NLP
Bolt is a deep learning library with high performance
Text Generation Inference
Large Language Model Text Generation Inference
SetFit
Efficient few-shot learning with Sentence Transformers
OpenLLM
Operating LLMs in production