New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add WhisperModel to transformers #19166
Merged
Merged
Changes from 2 commits
Commits
Show all changes
167 commits
Select commit
Hold shift + click to select a range
cd94d03
simplify loop
ArthurZucker 569338e
Merge branch 'main' of https://github.com/huggingface/transformers in…
ArthurZucker 46b0ebe
add featur extractor
ArthurZucker af9d14f
add model
ArthurZucker 00cdcbe
start conversion
ArthurZucker a916bf1
add dropout
ArthurZucker 7ebda7d
initial commit of test files
ArthurZucker 974235f
copnversion for all models
ArthurZucker 40c42ab
update processor for correct padding
ArthurZucker 792d964
update feature extraction
ArthurZucker 339f95c
update integration test logits match
ArthurZucker 3a26273
fmnt: off for the logits
ArthurZucker ad5f990
on the fly mel bank
ArthurZucker d58b7a0
small nit
ArthurZucker c61258b
update test
ArthurZucker 6acc131
update tokenizer
ArthurZucker 71b3be8
nit feature extraction
ArthurZucker b4983e4
update
ArthurZucker e66815a
update tokenizer test
ArthurZucker a980ccc
adds logit processor and update tokenizer to get supress tokens
ArthurZucker 001dff2
style
ArthurZucker 81a7099
clean convert
ArthurZucker cbf1b4a
revert to original modeling tf utils
ArthurZucker b2d0e5d
Merge branch 'main' of https://github.com/huggingface/transformers in…
ArthurZucker 66237cb
Update
ArthurZucker d2cfce3
update
ArthurZucker ca2a225
nit
ArthurZucker 5afbaad
clean convert file
ArthurZucker 9ce0bc9
update tests and nits
ArthurZucker 16033a5
quality
ArthurZucker 1f95255
slow generation test
ArthurZucker 830528a
ffn_dim to allow customization
ArthurZucker 9fc86bc
update readme
ArthurZucker 0497d0f
add to toctreee
ArthurZucker 57cb281
start fixing integration tests
ArthurZucker a27eb00
update tests and code
ArthurZucker ef6e08e
fix feature extractor
ArthurZucker fc5ce23
fix config tests common
ArthurZucker 655e460
update code to fix tests
ArthurZucker d7dcfbd
fix feature exctractor
ArthurZucker c64e8a6
nit feature extraction
ArthurZucker edce53e
update test for new feature extractor
ArthurZucker e661aef
style
ArthurZucker 2859221
add absrtact
ArthurZucker 9a69dbd
large logits wioth custom decoder input ids
ArthurZucker 6f1858d
wraap around is otrch available
ArthurZucker ac40d6d
fix feature extractor
ArthurZucker f8f7463
correct logits for whisper small.en
ArthurZucker 5540472
nit
ArthurZucker 71ac3f7
fix encoder_attentino_mask
ArthurZucker 5f4a1f9
some fixes
patrickvonplaten cda4759
remove unnecessary inputs
patrickvonplaten 7b892dd
nits
ArthurZucker d49614b
add normalizer file
ArthurZucker 171e034
update etst tokenization
ArthurZucker cae0269
fix attention mask not defined
ArthurZucker de47019
Add model to README
NielsRogge 9a8f99f
Fix doc tests
NielsRogge 12b1ca5
fix generate
ArthurZucker b4c0cb9
remove uncoder attention mask useless
ArthurZucker f6b7550
update test modeling whisper
ArthurZucker 8c96dfd
update condfig to add second non supress tokens
ArthurZucker 378841c
nits on feature exrtactor
ArthurZucker 3a2c411
nit for test tokenizers
ArthurZucker 4dfbba1
update etsts
ArthurZucker 0a39f49
update tests
ArthurZucker 1fd1d52
update tokenization test
ArthurZucker 2a900f4
fixup
ArthurZucker d16d3e1
invalidated hf token. Clean convert openai to whisper
ArthurZucker f62fd14
fix logit tests
ArthurZucker d4efa53
fixup
ArthurZucker 4fe81c6
Merge pull request #1 from NielsRogge/add-whisper
ArthurZucker cf156ce
clean merge
ArthurZucker 570941b
revert toc_tree changes
ArthurZucker 261c1f2
remove useless LogitProcessor
ArthurZucker d65e755
Update whisper .mdx
ArthurZucker aa95777
update config file doc
ArthurZucker 0a23c18
update configuration docstring
ArthurZucker 5300956
update test tokenization
ArthurZucker afcf30d
update test tokenization
ArthurZucker 03f11d8
update tokenization whisper
ArthurZucker 017010f
update feature extraction
ArthurZucker 9f0f332
nit test name
ArthurZucker fde6e99
style
ArthurZucker 9cca7eb
quality
ArthurZucker fa69008
remove get suppress tokens and update non_speech tokens global variables
ArthurZucker 69e2dce
Update src/transformers/models/whisper/feature_extraction_whisper.py
ArthurZucker 4243f7d
clean modeling whisper and test
ArthurZucker 044e371
fix large test
ArthurZucker 1268f4b
Add multilingual audio test, and translate test
ArthurZucker 1578988
style
ArthurZucker 8387ce8
fix larg multilingual test
ArthurZucker 6b14b67
nits
ArthurZucker cafe5f1
Update docs/source/en/model_doc/whisper.mdx
ArthurZucker bbf35b1
add copied from for attention layer
ArthurZucker 40284ef
remove attention masks in doc
ArthurZucker ebb79e9
add english normalizer
ArthurZucker 2fce16c
Merge branch 'add-whisper' of https://github.com/ArthurZucker/transfo…
ArthurZucker 1b6a09c
update tokenization test
ArthurZucker 5ca9dcb
remove copied from in whisper attention : no bias in k_proj only
ArthurZucker d0cf660
wrap around dependencies in english normalizer
ArthurZucker 378b84b
style
ArthurZucker a71ead9
correct import generation logits
ArthurZucker bdc1259
for now, wrap feature extractor with torch
ArthurZucker bd99c23
Update src/transformers/models/whisper/convert_openai_whisper_to_tfms.py
ArthurZucker e204a51
Update src/transformers/models/whisper/configuration_whisper.py
ArthurZucker 7fa70db
Update docs/source/en/model_doc/whisper.mdx
ArthurZucker 5d95201
Merge branch 'main' of https://github.com/huggingface/transformers in…
ArthurZucker 5d62a99
remove torch depencies for feature extraction and style
ArthurZucker 96be7b5
Merge branch 'add-whisper' of https://github.com/ArthurZucker/transfo…
ArthurZucker f448015
fixup
ArthurZucker 62b2572
nit
ArthurZucker 351c942
update logitds
ArthurZucker 6adeabe
style
ArthurZucker 4b07c61
nit
ArthurZucker a276b07
nits and fix final tests
ArthurZucker 07dd529
add `is_more_itertools_available` to utils
ArthurZucker bbafa58
quality
ArthurZucker 07164fa
add begin supress tokens, supress tokens to generate args and config
ArthurZucker fd0c7e9
clean supressTokensLogitProcessor in generation logits
ArthurZucker 1f4fe24
Nit naming
ArthurZucker 848f1c3
add supressTokensAtBegin
ArthurZucker 2498086
udpate tests, supress tokens to None or correct values
ArthurZucker 3269d57
nit and style
ArthurZucker 6b2ebd4
update RAG to fit test and generate_logit
ArthurZucker dff15c2
add copy pasted statment on english normalizer
ArthurZucker 7c51de1
add arguments to config_common_kwargs
ArthurZucker da99700
Update src/transformers/generation_utils.py
ArthurZucker af1beac
Update src/transformers/generation_logits_process.py
ArthurZucker 8277239
Update src/transformers/models/whisper/configuration_whisper.py
ArthurZucker 7b5e793
Apply suggestions from code review
ArthurZucker 325d088
revert changes based on reviews
ArthurZucker 2f88dc8
update doc and nits
ArthurZucker 2724add
Merge branch 'add-whisper' of https://github.com/ArthurZucker/transfo…
ArthurZucker 8df5a58
more nits
ArthurZucker cef34fd
last nits
ArthurZucker 90c9180
update test configuration common
ArthurZucker 72e86ed
add BART name in decoder attention mask documentation
ArthurZucker 7d69c3c
Update src/transformers/models/whisper/modeling_whisper.py
ArthurZucker 7cf0df0
Merge branch 'add-whisper' of https://github.com/ArthurZucker/transfo…
ArthurZucker 84c25dc
style
ArthurZucker bbf84b1
nit
ArthurZucker f2ac0f5
nit
ArthurZucker 93e9b2a
add english.json file to git
ArthurZucker e6ee5b5
nits on documentation
ArthurZucker a6361d4
nit
ArthurZucker f92b9a8
nits
ArthurZucker 8d40196
last styling
ArthurZucker 392563e
add main toctree file
ArthurZucker 2911736
Merge branch 'main' of https://github.com/huggingface/transformers in…
ArthurZucker 009cdef
remove sentence piece dependency
ArthurZucker ef83269
clean init file
ArthurZucker 78d1ed2
fix tokenizer that has no dependencies on sentencepiece
ArthurZucker f572f5f
update whisper init file, nit
ArthurZucker 837a410
remove english.json file
ArthurZucker ede09a4
add get decoder prompt id
ArthurZucker 529746a
revert changes and add forced logit processor
ArthurZucker d403c9d
nit
ArthurZucker b82fe09
clean normalizer
ArthurZucker ff8aa6c
remove protected
ArthurZucker 40461a9
update
ArthurZucker c5a2581
Update src/transformers/models/whisper/configuration_whisper.py
ArthurZucker 2c61839
update based on review
ArthurZucker 9eb7cc3
Merge branch 'add-whisper' of https://github.com/ArthurZucker/transfo…
ArthurZucker 135be7d
Update src/transformers/models/whisper/configuration_whisper.py
ArthurZucker 8e047f9
add batched tests
ArthurZucker 3ea5d78
Merge branch 'add-whisper' of https://github.com/ArthurZucker/transfo…
ArthurZucker File filter
Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice!