Jason Phang 0041be5b3d LLaMA Implementation (#21955) ...

* LLaMA

* sharding and docs

* tweak

* black

* inits

* ruff

* LLAMA_PRETRAINED_CONFIG_ARCHIVE_MAP

* init

* no checkpoint

* docs

* ruff

* type_vocab_size

* tokenizer fixes

* tokenizer fixes

* Update tokenization_llama.py

* Update tokenization_llama.py

* Update configuration_llama.py

* Update modeling_llama.py

* tokenizer add_bos by default

* licenses

* remove decoder

* norms and mlp

* rope overhaul

* tweaks

* black

* mention OPT implementation

* off-by-one naming

* typo

* fix

* tokenization fix and slicing bug

* padding config

* cleanup

* black

* update tests

* undo typo

* fix vocab caching logic

* ruff

* docbuilder

* attn fix from BlackSamorez

* initial feedback

* typo

* docs

* llama case

* llama case

* load checkpoint docs

* comment about tokenizer

* tokenizer defaults

* clear past_key_values if use_cache=False

* last tweaks

* last tweaks

* last tweaks

* last tweaks

---------

Co-authored-by: Stella Biderman <stellabiderman@gmail.com>

2023-03-16 09:00:53 -04:00

..

internal

[Time-Series] informer model (#21099)

2023-03-07 21:36:38 +01:00

main_classes

[deepspeed docs] Activation Checkpointing (#22099)

2023-03-13 12:52:42 -07:00

model_doc

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

tasks

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

_config.py

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

_toctree.yml

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

accelerate.mdx

✨ update to use interlibrary links instead of Markdown (#18500)

2022-08-08 10:53:52 -05:00

add_new_model.mdx

🚨🚨🚨 Enforce single model initialization (#21431)

2023-02-09 15:46:26 -05:00

add_new_pipeline.mdx

Spanish translation of asr.mdx and add_new_pipeline.mdx (#20569)

2022-12-12 09:23:23 -05:00

add_tensorflow_model.mdx

docs: Resolve many typos in the English docs (#20088)

2022-11-07 09:19:04 -05:00

attention.mdx

Refactor model summary (#21408)

2023-02-15 10:35:14 -08:00

autoclass_tutorial.mdx

Update doc examples feature extractor -> image processor (#20501)

2022-11-30 14:50:55 +00:00

benchmarks.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

bertology.mdx

update: bertology paper (#22012)

2023-03-08 07:54:30 -05:00

big_models.mdx

docs: Resolve many typos in the English docs (#20088)

2022-11-07 09:19:04 -05:00

community.mdx

Fix en documentation typos (#21799)

2023-02-27 08:36:36 +01:00

contributing.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

converting_tensorflow_models.mdx

Docs - Guide to add a new TensorFlow model (#19256)

2022-09-30 20:30:38 +01:00

create_a_model.mdx

Documentation code sample fixes (#21302)

2023-01-25 11:33:39 -05:00

custom_models.mdx

Replace awkward timm link with the expected one (#20109)

2022-11-07 13:57:39 -05:00

debugging.mdx

Spanish translation of the file debugging.mdx (#20566)

2022-12-12 10:38:56 -05:00

fast_tokenizers.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

generation_strategies.mdx

Add: An introductory guide for text generation (#21090)

2023-01-17 12:23:22 -05:00

glossary.mdx

docs: New terms and updates to glossary (#21982)

2023-03-13 19:09:37 -04:00

hpo_train.mdx

update doc for perf_train_cpu_many (#19506)

2022-10-11 22:54:19 -04:00

index.mdx

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

installation.mdx

Can't install tf2 on M1 Chip by default (#22046)

2023-03-09 07:44:58 -05:00

migration.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

model_sharing.mdx

Fix PushToHubCallback import in Share a model docs (#21457)

2023-02-06 09:26:22 -05:00

model_summary.mdx

Refactor model summary (#21408)

2023-02-15 10:35:14 -08:00

multilingual.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

notebooks.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

pad_truncation.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

perf_hardware.mdx

[WIP] [doc] performance/scalability revamp (#15723)

2022-05-16 13:36:41 +02:00

perf_infer_cpu.mdx

add doc for (#20525)

2022-12-01 16:52:13 +01:00

perf_infer_gpu_many.mdx

add doc for (#20525)

2022-12-01 16:52:13 +01:00

perf_infer_gpu_one.mdx

[Doc] Fix int8 docs (#21487)

2023-02-07 15:09:27 +01:00

perf_infer_special.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perf_train_cpu_many.mdx

update cpu related doc (#20444)

2022-11-28 08:54:35 -05:00

perf_train_cpu.mdx

Add perf numbers for perf_train_cpu (#20974)

2023-02-06 09:20:43 -05:00

perf_train_gpu_many.mdx

Fix Typo in Docs for GPU (#20509)

2022-11-30 10:41:18 -05:00

perf_train_gpu_one.mdx

Migrate torchdynamo to torch.compile (#20634)

2022-12-08 11:18:52 -05:00

perf_train_special.mdx

Fix Typo in Docs for GPU (#20509)

2022-11-30 10:41:18 -05:00

perf_train_tpu_tf.mdx

Typos/fixes to link syntax (#21450)

2023-02-07 15:19:19 +00:00

perf_train_tpu.mdx

Fix Typo in Docs for GPU (#20509)

2022-11-30 10:41:18 -05:00

performance.mdx

Fix Typo in Docs for GPU (#20509)

2022-11-30 10:41:18 -05:00

perplexity.mdx

Fix incorrect size of input for 1st strided window length in Perplexity of fixed-length models (#18906)

2022-09-06 15:20:12 -04:00

philosophy.mdx

Update doc examples feature extractor -> image processor (#20501)

2022-11-30 14:50:55 +00:00

pipeline_tutorial.mdx

Update 2 doctest expected values for torch 2.0.0 (#22148)

2023-03-14 09:13:16 +00:00

pipeline_webserver.mdx

Update quality tooling for formatting (#21480)

2023-02-06 18:10:56 -05:00

pr_checks.mdx

Cleanup quality (#21493)

2023-02-07 12:27:31 -05:00

preprocessing.mdx

Updates to computer vision section of the Preprocess doc (#21181)

2023-01-19 08:43:36 -05:00

quicktour.mdx

Fix 2 quicktour file doctest (#21742)

2023-02-23 09:41:28 +01:00

run_scripts.mdx

Just re-reading the whole doc every couple of months 😬 (#18489)

2022-08-06 09:38:55 +02:00

sagemaker.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

serialization.mdx

Add EfficientNet (#21563)

2023-02-20 16:37:11 +03:00

task_summary.mdx

Remove trailing 'extractive' word from en documentation (#21594)

2023-02-13 10:09:00 -05:00

tasks_explained.mdx

Update task summary (#21067)

2023-02-02 11:41:27 -08:00

testing.mdx

[tests] add accelerate marker (#21743)

2023-02-27 12:33:34 +01:00

tf_xla.mdx

Rewrite a couple of lines in the TF XLA doc (#21177)

2023-01-18 17:53:05 +00:00

tokenizer_summary.mdx

Update tokenizer_summary.mdx (#20135)

2022-11-15 01:18:13 +01:00

torchscript.mdx

Breakup export guide (#19271)

2022-10-03 13:18:29 -07:00

training.mdx

Fix code example in training tutorial (#21201)

2023-01-20 07:38:15 -08:00

troubleshooting.mdx

Removed BLIP mention from the troubleshooting guide (#21872)

2023-03-01 08:26:25 -05:00