jiqing-feng aff7df8436 enable static cache on TP model (#39164) ...

* enable static cache on TP model

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

* check tp size before init kv cache

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

* fix docstring

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

* add tp tests

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

* fix comment

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

* fix other cache head size

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

---------

Signed-off-by: jiqing-feng <jiqing.feng@intel.com>

2025-07-09 21:14:45 +00:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

commands

[serve] Model name or path should be required (#39178)

2025-07-02 22:06:47 +02:00

deepspeed

Remove script datasets in tests (#38940)

2025-06-25 14:31:20 +00:00

extended

Add Optional to remaining types (#37808)

2025-04-28 14:20:45 +01:00

fixtures

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

fsdp

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

generation

fix flaky test_generate_compile_model_forward (#39276)

2025-07-08 15:36:05 +02:00

models

Add DeepSeek V2 Model into Transformers (#36400)

2025-07-09 17:04:28 +02:00

optimization

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

peft_integration

TST Fix PEFT integration test bitsandbytes config (#39082)

2025-06-27 18:33:11 +02:00

pipelines

Add torchcodec in docstrings/tests for datasets 4.0 (#39156)

2025-07-08 17:06:12 +02:00

quantization

fix xpu failures on PT 2.7 and 2.8 w/o IPEX and enable hqq cases on XPU (#39187)

2025-07-08 10:18:26 +02:00

repo_utils

[modular] Simplify logic and docstring handling (#39185)

2025-07-07 14:52:57 +02:00

sagemaker

Deprecate TF + JAX (#38758)

2025-06-11 17:28:06 +01:00

tensor_parallel

enable static cache on TP model (#39164)

2025-07-09 21:14:45 +00:00

tokenization

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

trainer

Fix many HPU failures in the CI (#39066)

2025-07-03 11:17:27 +02:00

utils

Add torchcodec in docstrings/tests for datasets 4.0 (#39156)

2025-07-08 17:06:12 +02:00

__init__.py

…

causal_lm_tester.py

Refactor DBRX tests to use CausalLMModelTest base classes (#38475)

2025-06-13 16:22:12 +01:00

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Add Idefics2/3 and SmolVLM Fast image processors + improvements for fast image processors (#38157)

2025-06-23 14:17:25 +00:00

test_image_transforms.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_modeling_common.py

skip test_torchscript_* for now until the majority of the community ask for it (#39307)

2025-07-09 15:35:48 +02:00

test_pipeline_mixin.py

No more Tuple, List, Dict (#38797)

2025-06-17 19:37:18 +01:00

test_processing_common.py

Fix multimodal processor get duplicate arguments when receive kwargs for initialization (#39125)

2025-07-02 19:57:15 +08:00

test_sequence_feature_extraction_common.py

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

test_tokenization_common.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00

test_video_processing_common.py

Glm 4 doc (#39247)

2025-07-08 08:22:04 +02:00