AutoGPTQ Files

What's Changed

• Precise PyTorch version by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/421
• Fix triton unexpected keyword by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/423
• Add support for Yi models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/413
• Add support for Xverse models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/417
• Allow fp32 input to GPTQ linear by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/437
• Fix typos in tests by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/438
• Update _base.py - Remote (.bin) model load fix by @Shades-en in https://github.com/PanQiWei/AutoGPTQ/pull/465
• make build successful on Jetson device(L4T) by @mikeshi80 in https://github.com/PanQiWei/AutoGPTQ/pull/470
• Add option to disable qigen at build by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/471
• Stop trying to convert a list to int in setup.py when trying to retrieve cores_info by @wemoveon2 in https://github.com/PanQiWei/AutoGPTQ/pull/474
• Only make_quant on inside_layer_modules. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/479
• Add support for DeciLM models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/481
• Support for StableLM Epoch models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/444
• Add support for Mixtral models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/480
• Fix compatibility with transformers 4.36 by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/483

New Contributors

• @Shades-en made their first contribution in https://github.com/PanQiWei/AutoGPTQ/pull/465
• @mikeshi80 made their first contribution in https://github.com/PanQiWei/AutoGPTQ/pull/470
• @wemoveon2 made their first contribution in https://github.com/PanQiWei/AutoGPTQ/pull/474

Full Changelog: https://github.com/PanQiWei/AutoGPTQ/compare/v0.5.1...v0.6.0