-
Notifications
You must be signed in to change notification settings - Fork 93
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug Fix] Fix test that requre GPU #1096
Conversation
👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review. Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
left a comment but LGTM otherwise
08ce927
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
SUMMARY: Nightly tests uses gpus, ci tests dont. In the set up of `tests/llmcompressor/transformers/obcq/test_consecutive_runs.py`, a bug was found where `quantization_config` was always passed. This will result in an error if the model from the config file is not optimized. We are passing in dense model, so it fails. TEST PLAN: Run the failing test, make sure it passes! Signed-off-by: Rahul Tuli <[email protected]>
SUMMARY:
Nightly tests uses gpus, ci tests dont.
In the set up of
tests/llmcompressor/transformers/obcq/test_consecutive_runs.py
, a bug was found wherequantization_config
was always passed. This will result in an error if the model from the config file is not optimized.We are passing in dense model, so it fails.
TEST PLAN:
Run the failing test, make sure it passes!