Mohamed Mekkouri b262680af4 Add Bitnet model (#37742) ...

* Adding BitNet b1.58 Model

* Add testing code for BitNet

* Fix format issues

* Fix docstring format issues

* Fix docstring

* Fix docstring

* Fix: weight back to uint8

* Fix

* Fix format issues

* Remove copy comments

* Add model link to the docstring

* Fix: set tie_word_embeddings default to false

* Update

* Generate modeling file

* Change config name for automatically generating modeling file.

* Generate modeling file

* Fix class name

* Change testing branch

* Remove unused param

* Fix config docstring

* Add docstring for BitNetQuantConfig.

* Fix docstring

* Update docs/source/en/model_doc/bitnet.md

Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com>

* Update docs/source/en/model_doc/bitnet.md

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update bitnet config

* Update explanation between online and offline mode

* Remove space

* revert changes

* more revert

* spaces

* update

* fix-copies

* doc fix

* fix minor nits

* empty

* small nit

* empty

---------

Co-authored-by: Shuming Ma <shumingma@pku.edu.cn>
Co-authored-by: shumingma <shmingm@gmail.com>
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

2025-04-28 15:08:46 +02:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

deepspeed

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

extended

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

Fix the fsdp config cannot work issue. (#37549)

2025-04-28 10:44:51 +02:00

generation

[causal mask] fix preparation with multi-gpu (#37612)

2025-04-25 09:34:18 +02:00

models

Add Bitnet model (#37742)

2025-04-28 15:08:46 +02:00

optimization

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

peft_integration

Force torch>=2.6 with torch.load to avoid vulnerability issue (#37785)

2025-04-25 16:57:09 +02:00

pipelines

Process inputs directly in apply_chat_template in image-text-to-text pipeline (#35616)

2025-04-23 13:31:33 -04:00

quantization

Add Bitnet model (#37742)

2025-04-28 15:08:46 +02:00

repo_utils

Simplify soft dependencies and update the dummy-creation process (#36827)

2025-04-11 11:08:36 +02:00

sagemaker

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

tensor_parallel

enable tp on CPU (#36299)

2025-03-31 10:55:47 +02:00

tokenization

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

trainer

Force torch>=2.6 with torch.load to avoid vulnerability issue (#37785)

2025-04-25 16:57:09 +02:00

utils

Fix typos in strings and comments (#37799)

2025-04-28 11:39:11 +01:00

__init__.py

…

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Bridgetower fast image processor (#37373)

2025-04-16 22:39:18 +02:00

test_image_transforms.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_modeling_common.py

Fix typos in strings and comments (#37799)

2025-04-28 11:39:11 +01:00

test_modeling_flax_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_modeling_tf_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_pipeline_mixin.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_processing_common.py

Fix typos in strings and comments (#37784)

2025-04-25 13:47:25 +01:00

test_sequence_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_tokenization_common.py

🚨 🚨 Allow saving and loading multiple "raw" chat template files (#36588)

2025-04-11 16:37:23 +01:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00