| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2023-12-15 | 1.9 kB | |
| v0.6.0_ Mixtral, StableLM, DeciLM, Yi support, Transformers 4.36 compatibility source code.tar.gz | 2023-12-15 | 7.4 MB | |
| v0.6.0_ Mixtral, StableLM, DeciLM, Yi support, Transformers 4.36 compatibility source code.zip | 2023-12-15 | 7.5 MB | |
| Totals: 3 Items | 15.0 MB | 0 | |
What's Changed
- Precise PyTorch version by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/421
- Fix triton unexpected keyword by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/423
- Add support for Yi models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/413
- Add support for Xverse models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/417
- Allow fp32 input to GPTQ linear by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/437
- Fix typos in tests by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/438
- Update _base.py - Remote (.bin) model load fix by @Shades-en in https://github.com/PanQiWei/AutoGPTQ/pull/465
- make build successful on Jetson device(L4T) by @mikeshi80 in https://github.com/PanQiWei/AutoGPTQ/pull/470
- Add option to disable qigen at build by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/471
- Stop trying to convert a list to int in setup.py when trying to retrieve cores_info by @wemoveon2 in https://github.com/PanQiWei/AutoGPTQ/pull/474
- Only make_quant on inside_layer_modules. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/479
- Add support for DeciLM models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/481
- Support for StableLM Epoch models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/444
- Add support for Mixtral models. by @LaaZa in https://github.com/PanQiWei/AutoGPTQ/pull/480
- Fix compatibility with transformers 4.36 by @fxmarty in https://github.com/PanQiWei/AutoGPTQ/pull/483
New Contributors
- @Shades-en made their first contribution in https://github.com/PanQiWei/AutoGPTQ/pull/465
- @mikeshi80 made their first contribution in https://github.com/PanQiWei/AutoGPTQ/pull/470
- @wemoveon2 made their first contribution in https://github.com/PanQiWei/AutoGPTQ/pull/474
Full Changelog: https://github.com/PanQiWei/AutoGPTQ/compare/v0.5.1...v0.6.0