Yuxuan Zhang 39ba5f3cc2 GLM-4 Update (#39393) ...

* one commit with full

* Create glm4_moe.md

* Update check_config_docstrings.py

* Update __init__.py

* update

* argue

* argue: router problem

* 1

* Update test_modeling_glm4_moe.py

* Update test_modeling_glm4_moe.py

* Update test_modeling_glm4_moe.py

* Update modular_glm4_moe.py

* update

* use dsv3 pretrainmodel in modular

* update for test

* upodate new modular

* use LlamaAttention and avoid use  CohereAttention cause repeat norm

* update the modular

* update attn modular

* update

* Update modular_glm4_moe.py

* MTP layer is need to ignore

* fix gradient error using with dots_1 method

* Update test_modeling_glm4_moe.py

* Update test_modeling_glm4_moe.py

* Update test_modeling_glm4_moe.py

---------

Co-authored-by: Cyril Vallez <cyril.vallez@huggingface.co>

2025-07-21 13:24:34 +02:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

commands

[serve] Add speech to text (/v1/audio/transcriptions) (#39434)

2025-07-17 14:29:57 +00:00

deepspeed

Remove script datasets in tests (#38940)

2025-06-25 14:31:20 +00:00

extended

Add Optional to remaining types (#37808)

2025-04-28 14:20:45 +01:00

fixtures

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

fsdp

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

generation

[cache] make all classes cache compatible finally (#38635)

2025-07-16 14:00:17 +02:00

models

GLM-4 Update (#39393)

2025-07-21 13:24:34 +02:00

optimization

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

peft_integration

Enable some ruff checks for performance and readability (#39383)

2025-07-17 13:21:59 +00:00

pipelines

fix(pipelines): QA pipeline returns fewer than top_k results in batch mode (#39193)

2025-07-17 10:24:30 +02:00

quantization

Remove residual quantization attribute from dequantized models (#39373)

2025-07-15 17:16:10 +02:00

repo_utils

[modular] speedup check_modular_conversion with multiprocessing (#37456)

2025-07-10 19:07:59 +01:00

sagemaker

Deprecate TF + JAX (#38758)

2025-06-11 17:28:06 +01:00

tensor_parallel

enable static cache on TP model (#39164)

2025-07-09 21:14:45 +00:00

tokenization

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

trainer

Fix tests due to breaking change in accelerate (#39451)

2025-07-17 13:51:50 +01:00

utils

🚨🚨 Fix and simplify attention implementation dispatch and subconfigs handling (#39423)

2025-07-18 13:41:54 +02:00

__init__.py

…

causal_lm_tester.py

Refactor DBRX tests to use CausalLMModelTest base classes (#38475)

2025-06-13 16:22:12 +01:00

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Fix overriding Fast Image/Video Processors instance attributes affect other instances (#39363)

2025-07-12 23:39:06 +00:00

test_image_transforms.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_modeling_common.py

[qwen2 vl] fix packing with all attentions (#39447)

2025-07-21 12:19:15 +02:00

test_pipeline_mixin.py

Enable some ruff checks for performance and readability (#39383)

2025-07-17 13:21:59 +00:00

test_processing_common.py

[chat template] return assistant mask in processors (#38545)

2025-07-18 12:23:20 +00:00

test_sequence_feature_extraction_common.py

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

test_tokenization_common.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_tokenization_mistral_common.py

Add voxtral (#39429)

2025-07-18 00:02:04 +00:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00

test_video_processing_common.py

Fix overriding Fast Image/Video Processors instance attributes affect other instances (#39363)

2025-07-12 23:39:06 +00:00