MinJae Kang
92f2fbad50
🌐 [i18n-KO] Translated contributing.md to Korean ( #25877 )
...
* docs: ko-contributing.md
* feat: chatGPT draft
* feat: manual edits
* feat: change linked document
* fix: resolve suggestion
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
* fix: resolve suggestion
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
* fix: resolve suggestion
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
* fix: resolve suggestion
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
* fix: resolve suggestion
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
* fix: resolve suggestion
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
* fix: resolve suggestion
* feat: delete file to resolve error
---------
Co-authored-by: Haewon Kim <ehdvkf02@naver.com >
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
2023-09-12 08:35:29 -07:00
Maria Khalusova
1fe7ce48f1
[docs] Updates to TTS task guide with regards to the new TTS pipeline ( #26095 )
...
* tts guide updates with a pipeline
* Apply suggestions from code review
Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com >
* Update docs/source/en/tasks/text-to-speech.md
Co-authored-by: Vaibhav Srivastav <vaibhavs10@gmail.com >
---------
Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com >
Co-authored-by: Vaibhav Srivastav <vaibhavs10@gmail.com >
2023-09-12 11:29:06 -04:00
MinJae Kang
be9438ed43
🌐 [i18n-KO] Translated llama2.md to Korean ( #26047 )
...
* docs: ko-llama2.md
* feat: chatGPT draft and manul edits
* feat: added inline TOC
* fix: inline TOC
* fix: resolve suggestions
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com >
---------
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com >
2023-09-12 08:04:26 -07:00
Joao Gante
3319eb5490
Generate: legacy mode is only triggered when generation_config is untouched ( #25962 )
2023-09-12 12:08:17 +01:00
Arthur
9cccb3a838
[Persimmon] Add support for persimmon ( #26042 )
...
* intiial commit
* updates
* nits
* update conversion script
* update conversion script
* use path to load
* add tips etc
* some modeling logic
* modeling update
* more nits
* nits
* normal layer norm
* update config and doc
* nits
* update doc remove unused
* update
* fix inits and stuff
* fixup
* revert wrong changes
* updates
* more nits
* add default config values to the configuration file
* fixup happy
* update
* 2 tests left
* update readmes
* more nits
* slow test and more documentation
* update readme
* fix licences
* styling
* use fast if possible when saving tokenizer
* remove todo
* remove tokenization tests
* small last nits
* Apply suggestions from code review
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com >
* nits to skip the timout doctest
* fix integration test
* fix test
* update eos token
* update to allow fast tokenization
* styling
* fix codeLlama as well for the update post processor
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* add more copied from statements
* update
* doc passes doctest
* remove `# final layer norm?`
* change docstring prompot
* update
* Update README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* don't doctest the conversion script as it requires more packages
* don't init a model in the config
* oups
* fix doctest
---------
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com >
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2023-09-12 11:33:27 +02:00
Phuc Van Phan
9cebae64ad
docs: update link huggingface map ( #26077 )
2023-09-11 12:57:04 +01:00
Harheem Kim
d53606031f
🌐 [i18n-KO] Translated llama.md to Korean ( #26044 )
...
* docs: ko-llama.md
* fix: chatgpt draft
* feat: manual edits
* fix: resolve suggestions
2023-09-08 12:38:41 -07:00
Muskan Kumar
02c4a77f57
Added HerBERT to README.md ( #26020 )
...
* Added HerBERT to README.md
* Update README.md to contain HerBERT (#26016 )
* Resolved #26016 : Updated READMEs and index.md to contain Herbert
Updated READMEs and ran make fix-copies
2023-09-07 19:51:45 +01:00
Harheem Kim
fa522d8d7b
🌐 [i18n-KO] Translated llm_tutorial.md to Korean ( #25791 )
...
* docs: ko: llm_tutoroal.md
* feat: chatgpt draft
* fix: manual edits
* fix: resolve suggestions
* fix: resolve suggestions
2023-09-06 07:40:03 -07:00
zspo
3e203f92be
Fix small typo README.md ( #25934 )
...
* fix some samll bugs in readme
* Update docs/README.md
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
2023-09-06 14:07:29 +01:00
Injin Paek
6206f599e1
Add LLaMA resources ( #25859 )
...
* docs: feat: model resources for llama
* fix: resolve suggestion
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com >
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com >
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
2023-09-05 10:50:08 -07:00
raghavanone
1110b565d6
Add TFDebertaV2ForMultipleChoice ( #25932 )
...
* Add TFDebertaV2ForMultipleChoice
* Import newer model in main init
* Fix import issues
* Fix copies
* Add doc
* Fix tests
* Fix copies
* Fix docstring
2023-09-05 17:13:06 +01:00
Julien Chaumond
6316ce8d27
[doc] Always call it Agents for consistency ( #25958 )
2023-09-05 12:27:20 +01:00
Susnato Dhar
52a46dc57b
Add Pop2Piano space demo. ( #25975 )
...
Update pop2piano.md
2023-09-05 11:07:02 +01:00
Matt
034bc5d26a
Add proper Falcon docs and conversion script ( #25954 )
...
* Add proper Falcon docs and conversion script
* Autodetect the decoder architecture instead of using an arg
* Update docs now that we can autodetect
* Fix doc error
* Add doc to toctree
* Quick doc update
2023-09-04 17:18:34 +01:00
Sanchit Gandhi
f435003e0c
[MMS] Fix pip install in docs ( #25949 )
2023-09-04 11:53:41 +01:00
Nino Risteski
d4407a3bd1
Update autoclass_tutorial.md ( #25929 )
...
fixed typos
2023-09-04 11:16:49 +01:00
Nino Risteski
51e1e8120b
Update community.md ( #25928 )
...
fixed a few typos
2023-09-04 11:16:34 +01:00
omahs
0f0e1a2c2b
Fix typos ( #25936 )
...
* fix typo
* fix typo
* fix typo
* fix typos
* fix typos
* fix typo
* fix typo
* fix typo
* fix typos
* fix typo
* fix typo
* fix typo
* fix typos
* fix typos
2023-09-04 11:15:12 +01:00
Nino Risteski
0afa5071bd
Update model_memory_anatomy.md ( #25896 )
...
typo fixes
2023-09-01 12:27:01 -07:00
Arthur
a4dd53d88e
Update-llama-code ( #25826 )
...
* some bug fixes
* updates
* Update code_llama.md
Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.github.com >
* Add co author
Co-authored-by: pcuenca <pedro@latenitesoft.com >
* add a test
* fixup
* nits
* some updates
* fix-coies
* adress comments
* nits
* nits
* fix docsting
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* update
* add int for https://huggingface.co/spaces/hf-accelerate/model-memory-usage
---------
Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.github.com >
Co-authored-by: pcuenca <pedro@latenitesoft.com >
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
2023-09-01 20:40:40 +02:00
Sanchit Gandhi
1fa2d89a9b
[MMS] Update docs with HF TTS implementation ( #25907 )
...
* [MMS] Update docs with HF TTS implementation
* Update docs/source/en/model_doc/mms.md
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com >
* add uromanise to docs
---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com >
2023-09-01 16:50:59 +01:00
Omar Sanseviero
69c5b8f186
Remove broken docs for MusicGen ( #25905 )
...
Update musicgen.md
2023-09-01 15:26:42 +01:00
Matthijs Hollemans
4ece3b9433
add VITS model ( #24085 )
...
* add VITS model
* let's vits
* finish TextEncoder (mostly)
* rename VITS to Vits
* add StochasticDurationPredictor
* ads flow model
* add generator
* correctly set vocab size
* add tokenizer
* remove processor & feature extractor
* add PosteriorEncoder
* add missing weights to SDP
* also convert LJSpeech and VCTK checkpoints
* add training stuff in forward
* add placeholder tests for tokenizer
* add placeholder tests for model
* starting cleanup
* let the great renaming begin!
* use config
* global_conditioning
* more cleaning
* renaming variables
* more renaming
* more renaming
* it never ends
* reticulating the splines
* more renaming
* HiFi-GAN
* doc strings for main model
* fixup
* fix-copies
* don't make it a PreTrainedModel
* fixup
* rename config options
* remove training logic from forward pass
* simplify relative position
* use actual checkpoint
* style
* PR review fixes
* more review changes
* fixup
* more unit tests
* fixup
* fix doc test
* add integration test
* improve tokenizer tests
* add tokenizer integration test
* fix tests on GPU (gave OOM)
* conversion script can handle repos from hub
* add conversion script for all MMS-TTS checkpoints
* automatically create a README for the converted checkpoint
* small changes to config
* push README to hub
* only show uroman note for checkpoints that need it
* remove conversion script because code formatting breaks the readme
* make WaveNet layers configurable
* rename variables
* simplifying the math
* output attentions and hidden states
* remove VitsFlip in flow model
* also got rid of the other flip
* fix tests
* rename more variables
* rename tokenizer, add phonemization
* raise error when phonemizer missing
* re-order config docstrings to match method
* change config naming
* remove redundant str -> list
* fix copyright: vits authors -> kakao enterprise
* (mean, log_variances) -> (prior_mean, prior_log_variances)
* if return dict -> if not return dict
* speed -> speaking rate
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* update fused tanh sigmoid
* reduce dims in tester
* audio -> output_values
* audio -> output_values in tuple out
* fix return type
* fix return type
* make _unconstrained_rational_quadratic_spline a function
* all nn's to accept a config
* add spectro to output
* move {speaking rate, noise scale, noise scale duration} to config
* path -> attn_path
* idxs -> valid idxs -> padded idxs
* output values -> waveform
* use config for attention
* make generation work
* harden integration test
* add spectrogram to dict output
* tokenizer refactor
* make style
* remove 'fake' padding token
* harden tokenizer tests
* ron norm test
* fprop / save tests deterministic
* move uroman to tokenizer as much as possible
* better logger message
* fix vivit imports
* add uroman integration test
* make style
* up
* matthijs -> sanchit-gandhi
* fix tokenizer test
* make fix-copies
* fix dict comprehension
* fix config tests
* fix model tests
* make outputs consistent with reverse/not reverse
* fix key concat
* more model details
* add author
* return dict
* speaker error
* labels error
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* Update src/transformers/models/vits/convert_original_checkpoint.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* remove uromanize
* add docstrings
* add docstrings for tokenizer
* upper-case skip messages
* fix return dict
* style
* finish tests
* update checkpoints
* make style
* remove doctest file
* revert
* fix docstring
* fix tokenizer
* remove uroman integration test
* add sampling rate
* fix docs / docstrings
* style
* add sr to model output
* fix outputs
* style / copies
* fix docstring
* fix copies
* remove sr from model outputs
* Update utils/documentation_tests.txt
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* add sr as allowed attr
---------
Co-authored-by: sanchit-gandhi <sanchit@huggingface.co >
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com >
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
2023-09-01 10:50:06 +01:00
Vibhor Kumar
99fc3ac8ac
Modify efficient GPU training doc with now-available adamw_bnb_8bit optimizer ( #25807 )
...
* Modify single-GPU efficient training doc with now-available adamw_bnb_8bit optimizer
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-08-31 10:55:10 +01:00
Joao Gante
459bc6738c
Docs: fix example failing doctest in generation_strategies.md ( #25874 )
2023-08-30 16:23:44 +01:00
Lysandre Debut
ed290b0837
Remote tools are turned off ( #25867 )
2023-08-30 09:40:39 -04:00
Nino Risteski
1bf2f36daf
Update README.md ( #25832 )
...
deleted unnecessary comma in the Adding a new model section.
2023-08-30 10:52:41 +01:00
Nino Risteski
8c75cfdaee
Update README.md ( #25834 )
...
_toctree.yml file. broken link, now fixed.
2023-08-29 20:02:57 +01:00
Haylee Schäfer
dbc16f4404
Support loading base64 images in pipelines ( #25633 )
...
* support loading base64 images
* add test
* mention in docs
* remove the logging
* sort imports
* update error message
* Update tests/utils/test_image_utils.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
* restructure to catch base64 exception
* doesn't like the newline
* download files
* format
* optimize imports
* guess it needs a space?
* support loading base64 images
* add test
* remove the logging
* sort imports
* restructure to catch base64 exception
* doesn't like the newline
* download files
* optimize imports
* guess it needs a space?
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com >
2023-08-29 19:24:24 +01:00
Sohyun Sim
aade754b27
🌐 [i18n-KO] Translated community.md to Korean ( #25674 )
...
* docs: ko: community.md
* feat: deepl draft
* fix: manual edits
* fix: resolve suggestions
Co-authored-by: Hyeonseo Yun <0525yhs@gmail.com >
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
---------
Co-authored-by: Hyeonseo Yun <0525yhs@gmail.com >
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
2023-08-29 11:47:24 -04:00
heuristicwave
d97fd871e5
🌐 [i18n-KO] Translated add_new_pipeline.md to Korean ( #25498 )
...
* dos: ko: add_new_pipeline.mdx
* feat: chatgpt draft
* fix: manual edits
* docs: ko: add_new_pipeline
Update _toctree
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* Update docs/source/ko/add_new_pipeline.md
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
---------
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
2023-08-29 11:38:44 -04:00
Joao Gante
a35f889acc
Tests: detect lines removed from "utils/not_doctested.txt" and doctest ALL generation files ( #25763 )
2023-08-29 16:15:05 +01:00
MinJae Kang
33aa0af70c
🌐 [i18n-KO] model_memory_anatomy.md to Korean ( #25755 )
...
* docs: ko-model_memory_anatomy.md
* feat: chatgpt draft
* feat: manual edits
* feat: change document title
* feat: manual edits
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: heuristicwave <31366038+heuristicwave@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: heuristicwave <31366038+heuristicwave@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
* fix: resolve suggestion
---------
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
Co-authored-by: heuristicwave <31366038+heuristicwave@users.noreply.github.com >
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
2023-08-29 09:48:51 -04:00
SeongWooChoi
173fa7da9c
🌐 [i18n-KO] Translated peft.md to Korean ( #25706 )
...
* docs: ko: peft.mdx
* feat: chatgpt draft
* fix: manual edits
* fix: resolve suggestions
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: heuristicwave <31366038+heuristicwave@users.noreply.github.com >
* fix: resolve suggestions
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
---------
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: heuristicwave <31366038+heuristicwave@users.noreply.github.com >
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com >
2023-08-29 09:10:00 -04:00
Omar Sanseviero
9525515cd4
Minor wording changes for Code Llama ( #25815 )
...
* Update code_llama.md
* Update code_llama.md
2023-08-29 15:02:57 +02:00
Younes Belkada
dc0c102954
[Docs] More clarifications on BT + FA ( #25823 )
2023-08-29 13:52:25 +02:00
NielsRogge
4c21da5e34
Add ViTDet ( #25524 )
...
* First draft
* Fix READMEs
* Update return_dict
* Add more tests
* Fix docstrings
* Address comments
* Address more comments
* Address more comments
* Address more comments, fix test
* Fix test
2023-08-29 10:03:52 +01:00
Aman Gupta Karmani
39c37fe45c
Fix incorrect Boolean value in deepspeed example ( #25788 )
2023-08-29 09:22:37 +02:00
Arup De
738ecd17d8
Arde/fsdp activation checkpointing ( #25771 )
...
* add FSDP config option to enable activation-checkpointing
* update docs
* add checks and remove redundant code
* fix formatting error
2023-08-29 12:52:14 +05:30
Arthur
de139702a1
[LlamaFamiliy] add a tip about dtype ( #25794 )
...
* add a warning=True tip to the Llama2 doc
* code llama needs a tip too
* doc nit
* build PR doc
* doc nits
Co-authored-by: Lysandre <lysandre@huggingface.co >
---------
Co-authored-by: Lysandre <lysandre@huggingface.co >
2023-08-28 12:07:31 +02:00
Arthur
015f8e110d
[CodeLlama] Add support for CodeLlama ( #25740 )
...
* add all
* Revert "Delete .github directory"
This reverts commit 9b0ff7b052e2b20b629a26fb13606b78a42944d1.
* make conversion script backward compatible
* fixup
* more styling
* copy to llama changes
* fix repo consistency
* nits
* document correct classes
* updates
* more fixes
* nits
* update auto mappings
* add readmes
* smallupdates
* llama-code replace with llama_code
* make fixup
* updates to the testsing suite
* fix fast nits
* more small fixes
* fix decode
* fix template processing
* properly reset the normalizer
* nits processor
* tokenization tests pass
* styling
* last tests
* additional nits
* one test is left
* nits
Co-authored-by faabian <faabian@users.noreply.github.com >
* update failing test
* fixup
* remove decode infilling users should handle it on their onw after generation, padding can be a problem
* update
* make test slow and more meaningfull
* fixup
* doc update
* fixup
* Apply suggestions from code review
* add kwargs doc
* tokenizer requires `requires_backend`
* type requires_backends
* CodeLlama instead of LlamaCode
* more name cahnges
* nits
* make doctests happy
* small pipeline nits
* last nit
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* update
* add codellama to toctree
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2023-08-25 18:57:40 +02:00
Younes Belkada
4b79697865
🚨 🚨 🚨 [Refactor] Move third-party related utility files into integrations/ folder 🚨 🚨 🚨 ( #25599 )
...
* move deepspeed to `lib_integrations.deepspeed`
* more refactor
* oops
* fix slow tests
* Fix docs
* fix docs
* addess feedback
* address feedback
* final modifs for PEFT
* fixup
* ok now
* trigger CI
* trigger CI again
* Update docs/source/en/main_classes/deepspeed.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* import from `integrations`
* address feedback
* revert removal of `deepspeed` module
* revert removal of `deepspeed` module
* fix conflicts
* ooops
* oops
* add deprecation warning
* place it on the top
* put `FutureWarning`
* fix conflicts with not_doctested.txt
* add back `bitsandbytes` module with a depr warning
* fix
* fix
* fixup
* oops
* fix doctests
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2023-08-25 17:13:34 +02:00
Joao Gante
85cf90a1c9
Generate: add missing logits processors docs ( #25653 )
2023-08-25 11:56:17 +01:00
Pedro Cuenca
cb8e3ee25f
Add FlaxCLIPTextModelWithProjection ( #25254 )
...
* Add FlaxClipTextModelWithProjection
This is necessary to support the Flax port of Stable Diffusion XL: fb6d705fb5/text_encoder_2/config.json (L3)martin.muller.me@gmail.com >
Co-authored-by: Juan Acevedo <juancevedo@gmail.com >
* Use FlaxCLIPTextModelOutput
* make fix-copies again
* Apply suggestions from code review
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com >
* Use `return_dict` for consistency with other uses.
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com >
* Fix docstring example.
* Add new model to FlaxCLIPTextModelTest
* Add to IGNORE_NON_AUTO_CONFIGURED list
* Fix naming convention.
---------
Co-authored-by: Martin Müller <martin.muller.me@gmail.com >
Co-authored-by: Juan Acevedo <juancevedo@gmail.com >
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com >
2023-08-25 10:58:14 +02:00
Anthony Susevski
8968fface4
fixed typo in speech encoder decoder doc ( #25745 )
...
fixed typo in speech encoder decoder blog
2023-08-25 09:20:37 +02:00
Wonhyeong Seo
f26099e7b5
🌐 [i18n-KO] Translated visual_question_answering.md to Korean ( #25679 )
...
* docs: ko: visual_question_answering.md
* feat: chatgpt draft
tosquash: add code blocks
* fix: manual edits
~L34 14:25
~L126 16:52
~L224 17:00
~L335 17:11
~EOF 17:18
* fix: self-correction
* amend grammar, phrasing
* docs: add new entry to _toctree.yml
* fix: use terms from glossary
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
---------
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com >
2023-08-24 11:14:58 -07:00
Sylvain Gugger
c2123626aa
Update list of persons to tag ( #25708 )
2023-08-24 10:13:30 +02:00
Yih-Dar
3d1edb6c5d
fix wrong path in some doc ( #25658 )
...
* update
* check
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com >
2023-08-23 08:34:30 +02:00
Wonhyeong Seo
57943630e2
Add Llama2 resources ( #25531 )
...
* docs: feat: model resources for llama2
Co-authored-by: Woojun Jung <hello_984@naver.com >
* fix: add description for dpo and rearrange posts
* docs: feat: add llama2 notebook resources
* style: one liners for each resource
Co-Authored-By: Woojun Jung <46880056+jungnerd@users.noreply.github.com >
Co-Authored-By: Kihoon Son <75935546+kihoon71@users.noreply.github.com >
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Fix typo
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Woojun Jung <hello_984@naver.com >
Co-authored-by: Woojun Jung <46880056+jungnerd@users.noreply.github.com >
Co-authored-by: Kihoon Son <75935546+kihoon71@users.noreply.github.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-08-22 17:14:54 -07:00
