Prompt tuning documentation #3541
Merged
+156
−1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Virginia Adams <vadams@nvidia.com>
ericharper
reviewed
Jan 27, 2022
ericharper
added a commit
that referenced
this pull request
Jan 31, 2022
* Started prompt tuning doc Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update prompt_tuning.rst * Update models.rst * Update models.rst * Update and rename megatron_finetuning.rst to megatron_downstream_tasks.rst * Update intro.rst * Update intro.rst * Update and rename megatron_downstream_tasks.rst to megatron_finetuning.rst * Update megatron_finetuning.rst * Delete prompt_tuning.rst * Update README.rst * Update docs/source/nlp/megatron_finetuning.rst Co-authored-by: Eric Harper <complex451@gmail.com>
titu1994
added a commit
that referenced
this pull request
Jan 31, 2022
* update branch Signed-off-by: ericharper <complex451@gmail.com> * Fix the tutorial notebooks bug (#3465) * fix checkpoint loading and model config file Signed-off-by: Yi Dong <yidong@nvidia.com> * fix style Signed-off-by: Yi Dong <yidong@nvidia.com> * Fix checkpoint converter in O2 style (#3486) * Fix checkpoint converter in O2 style Signed-off-by: Yu Yao <yuya@nvidia.com> * Fix style Signed-off-by: Yu Yao <yuya@nvidia.com> Co-authored-by: Yu Yao <yuya@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Remove pickled features from tarred dataset (#3491) Signed-off-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: ekmb <ebakhturina@nvidia.com> * adding missing init files (#3505) Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * typos (#3504) * typos Signed-off-by: ekmb <ebakhturina@nvidia.com> * link fix Signed-off-by: ekmb <ebakhturina@nvidia.com> * update titanet conf (#3507) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix link to NGC page for ASR (#3512) Signed-off-by: smajumdar <titu1994@gmail.com> * vad typo fix (#3490) * remove always broken ptl link Signed-off-by: fayejf <fayejf07@gmail.com> * fix typo Signed-off-by: fayejf <fayejf07@gmail.com> * Add verification helper function and update docs (#3514) * Add verification helper function and update docs Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * typo fixes Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * fixed the num_classes bug of conv decoder. (#3525) * fixed the num_classes bug. Signed-off-by: Vahid <vnoroozi@nvidia.com> * added logging info. Signed-off-by: Vahid <vnoroozi@nvidia.com> * Enforce utf-8 on all file r/w (#3520) * Update paths to subtask Signed-off-by: smajumdar <titu1994@gmail.com> * Enforce utf-8 on all file r/w Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fixed section typo (#3522) Signed-off-by: Virginia Adams <vadams@nvidia.com> * Pushing updated WFST Tutorial to r1.6.0 (#3521) Signed-off-by: tbartley94 <tbartley@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> * Fixed duplicate cell bug (#3518) Signed-off-by: Virginia Adams <vadams@nvidia.com> * WFST tutorial update (#3531) * Pushing updated WFST Tutorial to r1.6.0 Signed-off-by: tbartley94 <tbartley@nvidia.com> * Hopefully final corrections to WFST tutorials. Signed-off-by: tbartley94 <tbartley@nvidia.com> * [TTS] Fix bug in inference tts notebook (#3532) * fix bug in inference tts notebook Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Update Inference_ModelSelect.ipynb * fix space Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * remove space Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Prompt tuning documentation (#3541) * Started prompt tuning doc Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update prompt_tuning.rst * Update models.rst * Update models.rst * Update and rename megatron_finetuning.rst to megatron_downstream_tasks.rst * Update intro.rst * Update intro.rst * Update and rename megatron_downstream_tasks.rst to megatron_finetuning.rst * Update megatron_finetuning.rst * Delete prompt_tuning.rst * Update README.rst * Update docs/source/nlp/megatron_finetuning.rst Co-authored-by: Eric Harper <complex451@gmail.com> * Fix nmt resume (#3539) * check for model attr Signed-off-by: ericharper <complex451@gmail.com> * update jenkins test Signed-off-by: ericharper <complex451@gmail.com> * TN bug fix (#3538) * ve and cel fixes Signed-off-by: ekmb <ebakhturina@nvidia.com> * ve and cel fixes Signed-off-by: ekmb <ebakhturina@nvidia.com> * add w to single digit roman and cardinal single digit graph (non det) Signed-off-by: ekmb <ebakhturina@nvidia.com> * isn't fix Signed-off-by: ekmb <ebakhturina@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * fix bug in tutorial (#3546) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Update nvidia container check (#3535) * update nvidia container check Signed-off-by: ericharper <complex451@gmail.com> * update minor version Signed-off-by: ericharper <complex451@gmail.com> * add check to T5 Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update bert Signed-off-by: ericharper <complex451@gmail.com> * forgot import Signed-off-by: ericharper <complex451@gmail.com> * remove import Signed-off-by: ericharper <complex451@gmail.com> * Fix an issue with wandb not displaying updated config changes (#3552) Signed-off-by: smajumdar <titu1994@gmail.com> * remove extra instance (#3551) Signed-off-by: ericharper <complex451@gmail.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info Signed-off-by: ericharper <complex451@gmail.com> * revert Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Yi Dong <43824965+yidong72@users.noreply.github.com> Co-authored-by: yaoyu-33 <54727607+yaoyu-33@users.noreply.github.com> Co-authored-by: Yu Yao <yuya@nvidia.com> Co-authored-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: ekmb <ebakhturina@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Vahid Noroozi <VahidooX@users.noreply.github.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: tbartley94 <90423858+tbartley94@users.noreply.github.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com>
nithinraok
added a commit
that referenced
this pull request
Feb 2, 2022
* update branch Signed-off-by: ericharper <complex451@gmail.com> * Fix the tutorial notebooks bug (#3465) * fix checkpoint loading and model config file Signed-off-by: Yi Dong <yidong@nvidia.com> * fix style Signed-off-by: Yi Dong <yidong@nvidia.com> * Fix checkpoint converter in O2 style (#3486) * Fix checkpoint converter in O2 style Signed-off-by: Yu Yao <yuya@nvidia.com> * Fix style Signed-off-by: Yu Yao <yuya@nvidia.com> Co-authored-by: Yu Yao <yuya@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Remove pickled features from tarred dataset (#3491) Signed-off-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: ekmb <ebakhturina@nvidia.com> * adding missing init files (#3505) Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * typos (#3504) * typos Signed-off-by: ekmb <ebakhturina@nvidia.com> * link fix Signed-off-by: ekmb <ebakhturina@nvidia.com> * update titanet conf (#3507) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix link to NGC page for ASR (#3512) Signed-off-by: smajumdar <titu1994@gmail.com> * vad typo fix (#3490) * remove always broken ptl link Signed-off-by: fayejf <fayejf07@gmail.com> * fix typo Signed-off-by: fayejf <fayejf07@gmail.com> * Add verification helper function and update docs (#3514) * Add verification helper function and update docs Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * typo fixes Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * fixed the num_classes bug of conv decoder. (#3525) * fixed the num_classes bug. Signed-off-by: Vahid <vnoroozi@nvidia.com> * added logging info. Signed-off-by: Vahid <vnoroozi@nvidia.com> * Enforce utf-8 on all file r/w (#3520) * Update paths to subtask Signed-off-by: smajumdar <titu1994@gmail.com> * Enforce utf-8 on all file r/w Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fixed section typo (#3522) Signed-off-by: Virginia Adams <vadams@nvidia.com> * Pushing updated WFST Tutorial to r1.6.0 (#3521) Signed-off-by: tbartley94 <tbartley@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> * Fixed duplicate cell bug (#3518) Signed-off-by: Virginia Adams <vadams@nvidia.com> * WFST tutorial update (#3531) * Pushing updated WFST Tutorial to r1.6.0 Signed-off-by: tbartley94 <tbartley@nvidia.com> * Hopefully final corrections to WFST tutorials. Signed-off-by: tbartley94 <tbartley@nvidia.com> * [TTS] Fix bug in inference tts notebook (#3532) * fix bug in inference tts notebook Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Update Inference_ModelSelect.ipynb * fix space Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * remove space Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Prompt tuning documentation (#3541) * Started prompt tuning doc Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update prompt_tuning.rst * Update models.rst * Update models.rst * Update and rename megatron_finetuning.rst to megatron_downstream_tasks.rst * Update intro.rst * Update intro.rst * Update and rename megatron_downstream_tasks.rst to megatron_finetuning.rst * Update megatron_finetuning.rst * Delete prompt_tuning.rst * Update README.rst * Update docs/source/nlp/megatron_finetuning.rst Co-authored-by: Eric Harper <complex451@gmail.com> * Fix nmt resume (#3539) * check for model attr Signed-off-by: ericharper <complex451@gmail.com> * update jenkins test Signed-off-by: ericharper <complex451@gmail.com> * TN bug fix (#3538) * ve and cel fixes Signed-off-by: ekmb <ebakhturina@nvidia.com> * ve and cel fixes Signed-off-by: ekmb <ebakhturina@nvidia.com> * add w to single digit roman and cardinal single digit graph (non det) Signed-off-by: ekmb <ebakhturina@nvidia.com> * isn't fix Signed-off-by: ekmb <ebakhturina@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * fix bug in tutorial (#3546) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Update nvidia container check (#3535) * update nvidia container check Signed-off-by: ericharper <complex451@gmail.com> * update minor version Signed-off-by: ericharper <complex451@gmail.com> * add check to T5 Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update bert Signed-off-by: ericharper <complex451@gmail.com> * forgot import Signed-off-by: ericharper <complex451@gmail.com> * remove import Signed-off-by: ericharper <complex451@gmail.com> * Fix an issue with wandb not displaying updated config changes (#3552) Signed-off-by: smajumdar <titu1994@gmail.com> * remove extra instance (#3551) Signed-off-by: ericharper <complex451@gmail.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info Signed-off-by: ericharper <complex451@gmail.com> * revert Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Yi Dong <43824965+yidong72@users.noreply.github.com> Co-authored-by: yaoyu-33 <54727607+yaoyu-33@users.noreply.github.com> Co-authored-by: Yu Yao <yuya@nvidia.com> Co-authored-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: ekmb <ebakhturina@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Vahid Noroozi <VahidooX@users.noreply.github.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: tbartley94 <90423858+tbartley94@users.noreply.github.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com>
fayejf
pushed a commit
that referenced
this pull request
Mar 2, 2022
* Started prompt tuning doc Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update prompt_tuning.rst * Update models.rst * Update models.rst * Update and rename megatron_finetuning.rst to megatron_downstream_tasks.rst * Update intro.rst * Update intro.rst * Update and rename megatron_downstream_tasks.rst to megatron_finetuning.rst * Update megatron_finetuning.rst * Delete prompt_tuning.rst * Update README.rst * Update docs/source/nlp/megatron_finetuning.rst Co-authored-by: Eric Harper <complex451@gmail.com>
fayejf
added a commit
that referenced
this pull request
Mar 2, 2022
* update branch Signed-off-by: ericharper <complex451@gmail.com> * Fix the tutorial notebooks bug (#3465) * fix checkpoint loading and model config file Signed-off-by: Yi Dong <yidong@nvidia.com> * fix style Signed-off-by: Yi Dong <yidong@nvidia.com> * Fix checkpoint converter in O2 style (#3486) * Fix checkpoint converter in O2 style Signed-off-by: Yu Yao <yuya@nvidia.com> * Fix style Signed-off-by: Yu Yao <yuya@nvidia.com> Co-authored-by: Yu Yao <yuya@nvidia.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Remove pickled features from tarred dataset (#3491) Signed-off-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: ekmb <ebakhturina@nvidia.com> * adding missing init files (#3505) Signed-off-by: Yang Zhang <yangzhang@nvidia.com> * typos (#3504) * typos Signed-off-by: ekmb <ebakhturina@nvidia.com> * link fix Signed-off-by: ekmb <ebakhturina@nvidia.com> * update titanet conf (#3507) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * Fix link to NGC page for ASR (#3512) Signed-off-by: smajumdar <titu1994@gmail.com> * vad typo fix (#3490) * remove always broken ptl link Signed-off-by: fayejf <fayejf07@gmail.com> * fix typo Signed-off-by: fayejf <fayejf07@gmail.com> * Add verification helper function and update docs (#3514) * Add verification helper function and update docs Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * typo fixes Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * fixed the num_classes bug of conv decoder. (#3525) * fixed the num_classes bug. Signed-off-by: Vahid <vnoroozi@nvidia.com> * added logging info. Signed-off-by: Vahid <vnoroozi@nvidia.com> * Enforce utf-8 on all file r/w (#3520) * Update paths to subtask Signed-off-by: smajumdar <titu1994@gmail.com> * Enforce utf-8 on all file r/w Signed-off-by: smajumdar <titu1994@gmail.com> Co-authored-by: Eric Harper <complex451@gmail.com> * Fixed section typo (#3522) Signed-off-by: Virginia Adams <vadams@nvidia.com> * Pushing updated WFST Tutorial to r1.6.0 (#3521) Signed-off-by: tbartley94 <tbartley@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> * Fixed duplicate cell bug (#3518) Signed-off-by: Virginia Adams <vadams@nvidia.com> * WFST tutorial update (#3531) * Pushing updated WFST Tutorial to r1.6.0 Signed-off-by: tbartley94 <tbartley@nvidia.com> * Hopefully final corrections to WFST tutorials. Signed-off-by: tbartley94 <tbartley@nvidia.com> * [TTS] Fix bug in inference tts notebook (#3532) * fix bug in inference tts notebook Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Update Inference_ModelSelect.ipynb * fix space Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * remove space Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Prompt tuning documentation (#3541) * Started prompt tuning doc Signed-off-by: Virginia Adams <vadams@nvidia.com> * Update prompt_tuning.rst * Update models.rst * Update models.rst * Update and rename megatron_finetuning.rst to megatron_downstream_tasks.rst * Update intro.rst * Update intro.rst * Update and rename megatron_downstream_tasks.rst to megatron_finetuning.rst * Update megatron_finetuning.rst * Delete prompt_tuning.rst * Update README.rst * Update docs/source/nlp/megatron_finetuning.rst Co-authored-by: Eric Harper <complex451@gmail.com> * Fix nmt resume (#3539) * check for model attr Signed-off-by: ericharper <complex451@gmail.com> * update jenkins test Signed-off-by: ericharper <complex451@gmail.com> * TN bug fix (#3538) * ve and cel fixes Signed-off-by: ekmb <ebakhturina@nvidia.com> * ve and cel fixes Signed-off-by: ekmb <ebakhturina@nvidia.com> * add w to single digit roman and cardinal single digit graph (non det) Signed-off-by: ekmb <ebakhturina@nvidia.com> * isn't fix Signed-off-by: ekmb <ebakhturina@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com> * fix bug in tutorial (#3546) Signed-off-by: Oktai Tatanov <oktai.tatanov@gmail.com> * Update nvidia container check (#3535) * update nvidia container check Signed-off-by: ericharper <complex451@gmail.com> * update minor version Signed-off-by: ericharper <complex451@gmail.com> * add check to T5 Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * update bert Signed-off-by: ericharper <complex451@gmail.com> * forgot import Signed-off-by: ericharper <complex451@gmail.com> * remove import Signed-off-by: ericharper <complex451@gmail.com> * Fix an issue with wandb not displaying updated config changes (#3552) Signed-off-by: smajumdar <titu1994@gmail.com> * remove extra instance (#3551) Signed-off-by: ericharper <complex451@gmail.com> * update branch Signed-off-by: ericharper <complex451@gmail.com> * update package info Signed-off-by: ericharper <complex451@gmail.com> * revert Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Yi Dong <43824965+yidong72@users.noreply.github.com> Co-authored-by: yaoyu-33 <54727607+yaoyu-33@users.noreply.github.com> Co-authored-by: Yu Yao <yuya@nvidia.com> Co-authored-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: ekmb <ebakhturina@nvidia.com> Co-authored-by: Yang Zhang <yzhang123@users.noreply.github.com> Co-authored-by: Evelina <10428420+ekmb@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com> Co-authored-by: fayejf <36722593+fayejf@users.noreply.github.com> Co-authored-by: Vahid Noroozi <VahidooX@users.noreply.github.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com> Co-authored-by: tbartley94 <90423858+tbartley94@users.noreply.github.com> Co-authored-by: Oktai Tatanov <oktai.tatanov@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add prompt tuning to docs