New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Please support quantization #195

Open

jxz542189 opened this issue Feb 27, 2025 · 1 comment

Labels

feature request

jxz542189 commented Feb 27, 2025

🚀 The feature, motivation and pitch

目前支持awq、gptq量化嘛？如果支持，请问有没有对应的脚本可以参考，如果不支持的话，有没有规划支持呢，感谢

Alternatives

No response

Additional context

No response

jxz542189 added the feature request label

Collaborator

wangxiyuan commented Feb 28, 2025

It'll be done in 2025 H1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment