HuggingFace_transformer/docs/source/en at 1da1302ec8832e58510801cbbfd506194d8ce7ea - HuggingFace_transformer - Gitea: Git with SSUM

SUMIN/HuggingFace_transformer

Files

History

fxmarty 1da1302ec8 Flash Attention 2 support for RoCm (#27611 )

* support FA2

* fix typo

* fix broken tests

* fix more test errors

* left/right

* fix bug

* more test

* typo

* fix layout flash attention falcon

* do not support this case

* use allclose instead of equal

* fix various bugs with flash attention

* bump

* fix test

* fix mistral

* use skiptest instead of return that may be misleading

* add fix causal arg flash attention

* fix copies

* more explicit comment

* still use self.is_causal

* fix causal argument

* comment

* fixes

* update documentation

* add link

* wrong test

* simplify FA2 RoCm requirements

* update opt

* make flash_attn_uses_top_left_mask attribute private and precise comment

* better error handling

* fix copy & mistral

* Update src/transformers/modeling_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Update src/transformers/modeling_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Update src/transformers/modeling_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Update src/transformers/utils/import_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* use is_flash_attn_greater_or_equal_2_10 instead of is_flash_attn_greater_or_equal_210

* fix merge

* simplify

* inline args

---------

Co-authored-by: Felix Marty <felix@hf.co>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

2023-12-04 21:52:17 +09:00

..

Generate: add missing logits processors docs (#25653 )

2023-08-25 11:56:17 +01:00

[docs] Quantization (#27641 )

2023-11-28 08:41:47 -08:00

Flash Attention 2 support for RoCm (#27611 )

2023-12-04 21:52:17 +09:00

Add SeamlessM4T v2 (#27779 )

2023-11-30 20:24:43 +01:00

_config.py

[Styling] stylify using ruff (#27144 )

2023-11-16 17:43:19 +01:00

_redirects.yml

Extended semantic segmentation to image segmentation (#27039 )

2023-11-23 15:58:21 +00:00

_toctree.yml

Add SeamlessM4T v2 (#27779 )

2023-11-30 20:24:43 +01:00

accelerate.md

Fix typos (#25936 )

2023-09-04 11:15:12 +01:00

add_new_model.md

Update add_new_model.md (#26365 )

2023-09-25 12:58:11 +02:00

add_new_pipeline.md

Update add_new_pipeline.md (#26197 )

2023-09-19 00:41:16 +02:00

add_tensorflow_model.md

Remove utils/documentation_tests.txt (#26213 )

2023-09-18 13:33:01 +02:00

attention.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

autoclass_tutorial.md

Update autoclass_tutorial.md (#25929 )

2023-09-04 11:16:49 +01:00

benchmarks.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

bertology.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

big_models.md

Fix typos (#25936 )

2023-09-04 11:15:12 +01:00

chat_templating.md

Update chat template warnings/guides (#27634 )

2023-11-27 18:40:10 +00:00

community.md

Update community.md (#25928 )

2023-09-04 11:16:34 +01:00

contributing.md

Enable doc in Spanish (#16518 )

2022-04-04 10:25:46 -04:00

create_a_model.md

[docs] fixed links with 404 (#27327 )

2023-11-06 19:45:03 +00:00

custom_models.md

Reorder the code on the Hub to explicit that sharing on the Hub isn't a requirement (#27691 )

2023-11-27 09:38:18 +01:00

custom_tools.md

[doc] Always call it Agents for consistency (#25958 )

2023-09-05 12:27:20 +01:00

debugging.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

fast_tokenizers.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

generation_strategies.md

[docs] navigation improvement between text gen pipelines and text gen params (#26477 )

2023-09-29 09:43:39 +02:00

glossary.md

[docs] Performance docs refactor p.2 (#26791 )

2023-10-24 13:10:06 -04:00

hpo_train.md

Remove-auth-token (#27060 )

2023-11-13 14:20:54 +01:00

index.md

Add SeamlessM4T v2 (#27779 )

2023-11-30 20:24:43 +01:00

installation.md

[docs] Update offline mode docs (#26478 )

2023-09-29 09:42:21 +02:00

llm_tutorial_optimization.md

Generate: Update docs regarding reusing past_key_values in generate (#27612 )

2023-11-21 10:48:14 +00:00

llm_tutorial.md

Generate: update basic llm tutorial (#26937 )

2023-10-19 16:53:28 +01:00

model_memory_anatomy.md

Fix typos (#25936 )

2023-09-04 11:15:12 +01:00

model_sharing.md

Fix typos (#25936 )

2023-09-04 11:15:12 +01:00

model_summary.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

multilingual.md

Fix typo in example code (#25583 )

2023-08-18 07:58:59 +02:00

notebooks.md

Enable doc in Spanish (#16518 )

2022-04-04 10:25:46 -04:00

pad_truncation.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

peft.md

[Peft] modules_to_save support for peft integration (#27466 )

2023-11-14 10:32:57 +01:00

perf_hardware.md

docs: replace torch.distributed.run by torchrun (#27528 )

2023-11-27 16:26:33 +00:00

perf_infer_cpu.md

[docs] Update CPU/GPU inference docs (#26881 )

2023-10-31 09:44:51 -07:00

perf_infer_gpu_one.md

Flash Attention 2 support for RoCm (#27611 )

2023-12-04 21:52:17 +09:00

perf_torch_compile.md

Fix rendering for torch.compile() docs (#25432 )

2023-08-10 13:25:00 +02:00

perf_train_cpu_many.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

perf_train_cpu.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

perf_train_gpu_many.md

docs: replace torch.distributed.run by torchrun (#27528 )

2023-11-27 16:26:33 +00:00

perf_train_gpu_one.md

Reflect RoCm support in the documentation (#27636 )

2023-11-25 00:59:17 +09:00

perf_train_special.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

perf_train_tpu_tf.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

perf_train_tpu.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

performance.md

[docs] Update CPU/GPU inference docs (#26881 )

2023-10-31 09:44:51 -07:00

perplexity.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

philosophy.md

[docs] fixed links with 404 (#27327 )

2023-11-06 19:45:03 +00:00

pipeline_tutorial.md

[ASR Pipe] Improve docs and error messages (#26476 )

2023-09-29 18:32:37 +01:00

pipeline_webserver.md

Suggestions on Pipeline_webserver (#25570 )

2023-08-18 10:17:44 +02:00

pr_checks.md

Docstring check (#26052 )

2023-10-04 15:13:37 +02:00

preprocessing.md

Broken links fixed related to datasets docs (#27569 )

2023-11-17 13:44:09 -08:00

quantization.md

[docs] Quantization (#27641 )

2023-11-28 08:41:47 -08:00

quicktour.md

[TYPO] fix typo/format in quicktour.md (#25519 )

2023-08-16 08:03:23 +02:00

run_scripts.md

docs: replace torch.distributed.run by torchrun (#27528 )

2023-11-27 16:26:33 +00:00

sagemaker.md

[docs] fixed links with 404 (#27327 )

2023-11-06 19:45:03 +00:00

serialization.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

task_summary.md

Fix doctest (#25031 )

2023-07-25 22:10:06 +02:00

tasks_explained.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

testing.md

Device agnostic testing (#25870 )

2023-10-24 16:49:26 +02:00

tf_xla.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

tflite.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

tokenizer_summary.md

Fix typo: Roberta -> RoBERTa (#25302 )

2023-08-03 14:17:30 -07:00

torchscript.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

training.md

Fix semantic error in evaluation section (#27675 )

2023-11-24 12:41:16 +01:00

transformers_agents.md

[doc] Always call it Agents for consistency (#25958 )

2023-09-05 12:27:20 +01:00

troubleshooting.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00