Yuxuan Zhang af9870265e GLM-4.1V Model support (#38431) ...

* 20250508 Model Architecture

* Update modeling_glm4v.py

* Update modeling_glm4v.py

* Update modeling_glm4v.py

* update 1447

* 0526

* update

* format

* problem

* update

* update with only image embed diff

* Final

* upload

* update

* 1

* upload with ruff

* update

* update

* work

* 1

* 1

* update with new note

* 2

* Update convert_glm4v_mgt_weights_to_hf.py

* Update tokenization_auto.py

* update with new format

* remove rmsnrom

* draft with videos

* draft

* update

* update

* fix for review problem

* try to remove min_pixel

* update

* for test

* remove timestamps

* remove item

* update with remove

* change

* update 2200

* update

* Delete app.py

* format

* update

* Update test_video_processing_glm4v.py

* 1

* 2

* use new name

* Update test_video_processing_glm4v.py

* remove docs

* change

* update for image processors update

* 2108

* 2128

* Update modular_glm4v.py

* 1

* update some

* update

* rename

* 1

* remove tests output

* 2

* add configuration

* update

* Update test_video_processing_glm4v.py

* fix simple forward tests

* update with modular

* 1

* fix more tests

* fix generation test

* fix beam search and init

* modular changed

* fix beam search in case of single-image/video. Fails if multiple visuals per text

* update processor

* update test

* pass

* fix beam search

* update

* param correct

* Update convert_glm4v_mgt_weights_to_hf.py

* 1

* Update test_modeling_glm4v.py

* 4

* 2

* 2123 video process

* 2

* revert

* 1

* 2

* revert processing

* update preprocesor

* changed

* 1

* update

* update

* 6

* update

* update

* update

* Delete tmp.txt

* config

* Update video_processing_glm4v.py

* apply modular correctly

* move functions

* fix order

* update the longest_edge

* style

* simplify a lot

* fix random order of classes

* skip integration tests

* correctly fix the tests

* fix TP plan

---------

Co-authored-by: raushan <raushan@huggingface.co>
Co-authored-by: Cyril Vallez <cyril.vallez@huggingface.co>
Co-authored-by: Cyril Vallez <cyril.vallez@gmail.com>

2025-06-25 10:43:05 +02:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

deepspeed

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

extended

Add Optional to remaining types (#37808)

2025-04-28 14:20:45 +01:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

generation

enable misc test cases on XPU (#38852)

2025-06-18 09:20:49 +02:00

models

GLM-4.1V Model support (#38431)

2025-06-25 10:43:05 +02:00

optimization

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

peft_integration

FIX: Faulty PEFT tests (#37757)

2025-04-28 15:10:46 +02:00

pipelines

[Feature] Support is_split_into_words in the TokenClassificationPipeline. (#38818)

2025-06-23 15:31:32 +00:00

quantization

Fix HQQ model param device transfer issue (#38466)

2025-06-18 15:09:00 +02:00

repo_utils

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

sagemaker

Deprecate TF + JAX (#38758)

2025-06-11 17:28:06 +01:00

tensor_parallel

[TP] Change command in tests to python3 (#38555)

2025-06-03 11:03:33 +00:00

tokenization

Remove isort from dependencies (#38616)

2025-06-05 16:42:49 +00:00

trainer

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

utils

[video processor] support torchcodec and decrease cuda memory usage (#38880)

2025-06-25 08:23:37 +00:00

__init__.py

…

causal_lm_tester.py

Refactor DBRX tests to use CausalLMModelTest base classes (#38475)

2025-06-13 16:22:12 +01:00

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Add Idefics2/3 and SmolVLM Fast image processors + improvements for fast image processors (#38157)

2025-06-23 14:17:25 +00:00

test_image_transforms.py

Fix pad image transform for batched inputs (#37544)

2025-05-08 10:51:15 +01:00

test_modeling_common.py

Fix graph break in torch.compile when using FA2 with attention_mask=None and batch size > 1 (#37332)

2025-06-25 07:58:34 +00:00

test_pipeline_mixin.py

No more Tuple, List, Dict (#38797)

2025-06-17 19:37:18 +01:00

test_processing_common.py

[video processors] support frame sampling within processors (#38105)

2025-06-12 09:34:30 +00:00

test_sequence_feature_extraction_common.py

No more Tuple, List, Dict (#38797)

2025-06-17 19:37:18 +01:00

test_tokenization_common.py

🚨 rm already deprecated pad_to_max_length arg (#37617)

2025-05-01 15:21:55 +02:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00

test_video_processing_common.py

[video processors] support frame sampling within processors (#38105)

2025-06-12 09:34:30 +00:00