Jason Phang 0041be5b3d LLaMA Implementation (#21955) ...

* LLaMA

* sharding and docs

* tweak

* black

* inits

* ruff

* LLAMA_PRETRAINED_CONFIG_ARCHIVE_MAP

* init

* no checkpoint

* docs

* ruff

* type_vocab_size

* tokenizer fixes

* tokenizer fixes

* Update tokenization_llama.py

* Update tokenization_llama.py

* Update configuration_llama.py

* Update modeling_llama.py

* tokenizer add_bos by default

* licenses

* remove decoder

* norms and mlp

* rope overhaul

* tweaks

* black

* mention OPT implementation

* off-by-one naming

* typo

* fix

* tokenization fix and slicing bug

* padding config

* cleanup

* black

* update tests

* undo typo

* fix vocab caching logic

* ruff

* docbuilder

* attn fix from BlackSamorez

* initial feedback

* typo

* docs

* llama case

* llama case

* load checkpoint docs

* comment about tokenizer

* tokenizer defaults

* clear past_key_values if use_cache=False

* last tweaks

* last tweaks

* last tweaks

* last tweaks

---------

Co-authored-by: Stella Biderman <stellabiderman@gmail.com>

2023-03-16 09:00:53 -04:00

..

test_module

AutoImageProcessor (#20111)

2022-11-08 19:54:41 +00:00

tf_ops

Check TF ops for ONNX compliance (#10025)

2021-02-15 07:55:10 -05:00

check_config_attributes.py

[Time-Series] informer model (#21099)

2023-03-07 21:36:38 +01:00

check_config_docstrings.py

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

check_copies.py

Apply ruff flake8-comprehensions (#21694)

2023-02-22 09:14:54 +01:00

check_doc_toc.py

Apply ruff flake8-comprehensions (#21694)

2023-02-22 09:14:54 +01:00

check_doctest_list.py

Update quality tooling for formatting (#21480)

2023-02-06 18:10:56 -05:00

check_dummies.py

Cleanup quality (#21493)

2023-02-07 12:27:31 -05:00

check_inits.py

refactor: Make direct_transformers_import util (#21652)

2023-02-16 11:32:32 -05:00

check_model_tester.py

Add a new script to check model testers' config (#22063)

2023-03-13 19:11:19 +01:00

check_repo.py

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

check_self_hosted_runner.py

Update quality tooling for formatting (#21480)

2023-02-06 18:10:56 -05:00

check_table.py

refactor: Make direct_transformers_import util (#21652)

2023-02-16 11:32:32 -05:00

check_task_guides.py

Cleanup more auto mapping names (#21909)

2023-03-03 14:43:44 +01:00

check_tf_ops.py

Check TF ops for ONNX compliance (#10025)

2021-02-15 07:55:10 -05:00

create_dummy_models.py

Update tiny model creation script (#22058)

2023-03-09 19:53:54 +01:00

custom_init_isort.py

Update quality tooling for formatting (#21480)

2023-02-06 18:10:56 -05:00

documentation_tests.txt

Use PyAV instead of Decord in examples (#21572)

2023-03-02 12:30:38 +00:00

download_glue_data.py

Raise exceptions instead of asserts (#13907)

2021-10-07 12:44:23 +05:30

extract_warnings.py

Make Slack CI reporting stronger (#21823)

2023-02-28 17:12:44 +01:00

get_ci_error_statistics.py

Make Slack CI reporting stronger (#21823)

2023-02-28 17:12:44 +01:00

get_github_job_time.py

Make Slack CI reporting stronger (#21823)

2023-02-28 17:12:44 +01:00

get_modified_files.py

exclude deleted files in the fixup script (#21436)

2023-02-03 12:57:02 -05:00

get_test_info.py

Add an utility file to get information from test files (#21856)

2023-03-01 17:53:29 +01:00

notification_service_doc_tests.py

Update quality tooling for formatting (#21480)

2023-02-06 18:10:56 -05:00

notification_service.py

Show the number of huggingface_hub warnings in CI report (#22054)

2023-03-09 15:39:05 +01:00

past_ci_versions.py

Make Slack CI reporting stronger (#21823)

2023-02-28 17:12:44 +01:00

prepare_for_doc_test.py

Add a check regarding the number of occurrences of ``` (#18389)

2022-08-01 14:23:02 +02:00

print_env.py

Print more library versions in CI (#17384)

2022-06-02 10:24:16 +02:00

release.py

Clean README in post release job as well. (#17519)

2022-06-02 07:44:03 -04:00

sort_auto_mappings.py

Automatically sort auto mappings (#17250)

2022-05-16 13:24:20 -04:00

tests_fetcher.py

🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516)

2023-02-28 19:40:57 +01:00

update_metadata.py

Add AutoModelForZeroShotImageClassification (#22087)

2023-03-13 12:46:14 +03:00