Yijun Lee e5fd865eba Add Gemma2 GGUF support (#34002) ...

* initial setup for ggml.py

* initial setup of GGUFGemma2Converter class

* Add gemma2 model to gguf.md doc

* Partial work on GGUF_TENSOR_MAPPING

* initial setup of GGUF_TENSOR_MAPPING for Gemma2

* refactor: rename GemmaConvert class to GemmaConverter for naming consistency

* feat: complete gemma2 tensor mapping implementation

* feat: add initial implementation of GGUFGemmaConverter

* feat: complete GGUFGemmaConverter implementation

* feat: add test code for gemma2

* refactor: minor code cleanup

* refactor: minor code cleanup

* fix: resolve suggestions

* Update tests/quantization/ggml/test_ggml.py

Co-authored-by: Isotr0py <2037008807@qq.com>

---------

Co-authored-by: Isotr0py <2037008807@qq.com>

2025-01-03 14:50:07 +01:00

..

agents

Change is_soundfile_availble to is_soundfile_available (#35030)

2025-01-03 14:37:42 +01:00

benchmark

…

bettertransformer

Fixed malapropism error (#26660)

2023-10-09 11:04:57 +02:00

deepspeed

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

extended

[tests] skip tests for xpu (#33553)

2024-09-19 19:28:04 +01:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

FSDP grad accum fix (#34645)

2024-11-15 22:28:06 +01:00

generation

Make test_generate_with_static_cache even less flaky (#34995)

2024-12-20 16:03:26 +01:00

models

Add DINOv2 with registers (#35348)

2024-12-24 13:21:59 +01:00

optimization

fix: Fixed the 1st argument name in classmethods (#31907)

2024-07-11 12:11:50 +01:00

peft_integration

[PEFT] Better Trainer error when prompt learning with loading best model at the end (#35087)

2024-12-11 12:44:39 +01:00

pipelines

Aurevoir PyTorch 1 (#35358)

2024-12-20 14:36:31 +01:00

quantization

Add Gemma2 GGUF support (#34002)

2025-01-03 14:50:07 +01:00

repo_utils

Refactor CI: more explicit (#30674)

2024-08-30 18:17:25 +02:00

sagemaker

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

tokenization

VLM: special multimodal Tokenizer (#34461)

2024-11-04 16:37:51 +01:00

tp

Simplify Tensor Parallel implementation with PyTorch TP (#34184)

2024-11-18 19:51:49 +01:00

trainer

Fix GA loss bugs and add unit test (#35121)

2024-12-09 09:57:41 +01:00

utils

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_configuration_common.py

Load sub-configs from composite configs (#34410)

2024-11-05 11:34:01 +01:00

test_feature_extraction_common.py

Split common test from core tests (#24284)

2023-06-15 07:30:24 -04:00

test_image_processing_common.py

Add compile test for fast image processor (#35184)

2024-12-23 13:12:45 -05:00

test_image_transforms.py

fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)

2024-05-21 13:56:52 +01:00

test_modeling_common.py

Use sdpa_kernel in tests (#35472)

2025-01-03 14:39:52 +01:00

test_modeling_flax_common.py

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

test_modeling_tf_common.py

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

test_pipeline_mixin.py

Add image text to text pipeline (#34170)

2024-10-31 15:48:11 -04:00

test_processing_common.py

Separate chat templates into a single file (#33957)

2024-11-26 14:18:04 +00:00

test_sequence_feature_extraction_common.py

Fix typo (#25966)

2023-09-05 10:12:25 +02:00

test_tokenization_common.py

Separate chat templates into a single file (#33957)

2024-11-26 14:18:04 +00:00