Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Audio] Add whisper fp8 dynamic example #1111

Merged
merged 1 commit into from
Jan 29, 2025
Merged

[Audio] Add whisper fp8 dynamic example #1111

merged 1 commit into from
Jan 29, 2025

Conversation

kylesayrs
Copy link
Collaborator

@kylesayrs kylesayrs commented Jan 28, 2025 •
edited
Loading

Purpose

  • Add example of quantizing multimodal model with FP8 dynamic

Changes

  • Add whisper FP8 example, collaborated with @mgoin

Testing

  • Ran example to mention

@github-actions GitHub Actions
Copy link

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

@kylesayrs kylesayrs changed the title add whisper fp8 dynamic example [Audio] Add whisper fp8 dynamic example Jan 28, 2025
@kylesayrs kylesayrs added the ready When a PR is ready for review label Jan 28, 2025
@kylesayrs kylesayrs marked this pull request as ready for review January 28, 2025 20:32
@mgoin mgoin merged commit 999d660 into main Jan 29, 2025
8 checks passed
@mgoin mgoin deleted the kylesayrs/multimodal-fp8 branch January 29, 2025 23:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mgoin mgoin mgoin approved these changes

Assignees

@mgoin mgoin

@kylesayrs kylesayrs

Labels
ready When a PR is ready for review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@kylesayrs @mgoin