Package Usage: pypi: auto-gptq
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
16 versions
Latest release: environ 2 ans ago
35 dependent packages
124 645 downloads last month
View more package details: https://packages.ecosystem.code.gouv.fr/registries/pypi.org/packages/auto-gptq