Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Smoothquant] Phi3 Vision Mappings #1089

Merged
merged 1 commit into from
Jan 23, 2025
Merged

Conversation

kylesayrs
Copy link
Collaborator

Purpose

  • Provide phi3 vision smoothquant mappings so that users who use the phi3 vision model from the multimodal blog post don't run into an issue

Changes

  • Add PHI3_VISION_SMOOTHQUANT_MAPPINGS
  • Add smoothquant to phi3 vision example

Testing

  • Ran examples/multimodal_vision/phi3_vision_example.py to completion

Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs kylesayrs self-assigned this Jan 22, 2025
Copy link

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

@kylesayrs kylesayrs added the ready When a PR is ready for review label Jan 22, 2025
@kylesayrs kylesayrs requested a review from rahul-tuli January 22, 2025 21:59
@dsikka dsikka merged commit 138bdaa into main Jan 23, 2025
7 of 8 checks passed
@dsikka dsikka deleted the kylesayrs/phi3_vision_smoothquant branch January 23, 2025 00:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready When a PR is ready for review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants