Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Audio] Whisper Example and Readme #1106

Merged
merged 28 commits into from
Jan 29, 2025
Merged

[Audio] Whisper Example and Readme #1106

merged 28 commits into from
Jan 29, 2025

Conversation

kylesayrs
Copy link
Collaborator

@kylesayrs kylesayrs commented Jan 28, 2025 •
edited
Loading

Purpose

  • Show example of quantizing whisper audio model

Changes

  • Add whisper audio model example
  • Add traceable whisper definition (only need to comment out a value error check)
  • The embedded audio is achieved using github attached files. While there's no official word on how long these files are maintained, if it is found that the file is deleted at some point, then we can replace it with a link to the file uploaded to the repo.

Testing

Successfully quantized whisper models and generated reasonable sample outputs

@kylesayrs
WIP
470b425 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
WIP: traceable, sample generation WIP
5276c9f 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
WIP: working, need to change ds split
898f86e 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
readme todo
8ca9b6d 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
split to peoples_speech dataset
98aca16 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
use cleanup example, add todo check
7067c3f 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
qwen2, need to add traceability
0848fb6 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
WIP
fbb6322 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
use model_input_names
f5daa3d 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
remove debug statements
fa69e8a 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
simplify example, fix tokenizer condition
504c7dc 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
shorten
e2f3735 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
restore example
9b34135 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
support audio datasets
2f3a416 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
mask decoder_input_ids
74283e8 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
Merge branch 'kylesayrs/audio-datasets' into kylesayrs/audio_examples
742dd6e
@kylesayrs
update example sample
36ec9f0 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
asdf
d11af96 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
plug in readme
f1bd1d2 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
Merge remote-tracking branch 'origin' into kylesayrs/audio_examples
3c9af2e
@kylesayrs
add readme
0cbf97c 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
remove qwen2_audio
0f37e28 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
remove test
7faa7f3 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs kylesayrs added the ready When a PR is ready for review label Jan 28, 2025
@kylesayrs kylesayrs self-assigned this Jan 28, 2025
@kylesayrs kylesayrs marked this pull request as draft January 28, 2025 18:01
@kylesayrs
try link
a79ffba 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs
use attachments
83ad6e6 
Signed-off-by: Kyle Sayers <[email protected]>
@kylesayrs kylesayrs marked this pull request as ready for review January 28, 2025 20:02
@kylesayrs
add smoothquant
1fa3d8c 
Signed-off-by: Kyle Sayers <[email protected]>
mgoin
mgoin approved these changes Jan 29, 2025
View reviewed changes
Copy link
Member

@mgoin mgoin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very nice work!!

@mgoin mgoin merged commit 7fc4a67 into main Jan 29, 2025
7 checks passed
@mgoin mgoin deleted the kylesayrs/whisper_audio_example branch January 29, 2025 23:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mgoin mgoin mgoin approved these changes

Assignees

@kylesayrs kylesayrs

Labels
ready When a PR is ready for review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@kylesayrs @mgoin