HuggingFace_transformer

Files

Jade Choghari 7176e06b52 Add TextNet (#34979 )

* WIP

* Add config and modeling for Fast model

* Refactor modeling and add tests

* More changes

* WIP

* Add tests

* Add conversion script

* Add conversion scripts, integration tests, image processor

* Fix style and copies

* Add fast model to init

* Add fast model in docs and other places

* Fix import of cv2

* Rename image processing method

* Fix build

* Fix Build

* fix style and fix copies

* Fix build

* Fix build

* Fix Build

* Clean up docstrings

* Fix Build

* Fix Build

* Fix Build

* Fix build

* Add test for image_processing_fast and add documentation tests

* some refactorings

* Fix failing tests

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Introduce TextNet

* Fix failures

* Refactor textnet model

* Fix failures

* Add cv2 to setup

* Fix failures

* Fix failures

* Add CV2 dependency

* Fix bugs

* Fix build issue

* Fix failures

* Remove textnet from modeling fast

* Fix build and other things

* Fix build

* some cleanups

* some cleanups

* Some more cleanups

* Fix build

* Incorporate PR feedbacks

* More cleanup

* More cleanup

* More cleanup

* Fix build

* Remove all the references of fast model

* More cleanup

* Fix build

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Fix Build

* Fix build

* Fix build

* Fix build

* Fix build

* Fix build

* Incorporate PR feedbacks

* Fix style

* Fix build

* Incorporate PR feedbacks

* Fix image processing mean and std

* Incorporate PR feedbacks

* fix build failure

* Add assertion to image processor

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* fix style failures

* fix build

* Fix Imageclassification's linear layer, also introduce TextNetImageProcessor

* Fix build

* Fix build

* Fix build

* Fix build

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Fix build

* Incorporate PR feedbacks

* Remove some script

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Incorporate PR feedbacks

* Fix image processing in textnet

* Incorporate PR Feedbacks

* Fix CI failures

* Fix failing test

* Fix failing test

* Fix failing test

* Fix failing test

* Fix failing test

* Fix failing test

* Add textnet to readme

* Improve readability

* Incorporate PR feedbacks

* fix code style

* fix key error and convert working

* tvlt shouldn't be here

* fix test modeling test

* Fix tests, make fixup

* Make fixup

* Make fixup

* Remove TEXTNET_PRETRAINED_MODEL_ARCHIVE_LIST

* improve type annotation

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* Update tests/models/textnet/test_image_processing_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* improve type annotation

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* space typo

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* improve type annotation

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* Update src/transformers/models/textnet/configuration_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* make conv layer kernel sizes and strides default to None

* Update src/transformers/models/textnet/modeling_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* Update src/transformers/models/textnet/modeling_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* fix keyword bug

* add batch init and make fixup

* Make fixup

* Update integration test

* Add figure

* Update textnet.md

* add testing and fix errors (classification, imgprocess)

* fix error check

* make fixup

* make fixup

* revert to original docstring

* add make style

* remove conflict for now

* Update modeling_auto.py

got a confusion in `timm_wrapper` - was giving some conflicts

* Update tests/models/textnet/test_modeling_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* Update src/transformers/models/textnet/modeling_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* Update tests/models/textnet/test_modeling_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* Update src/transformers/models/textnet/modeling_textnet.py

Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

* add changes

* Update textnet.md

* add doc

* add authors hf ckpt + rename

* add feedback: classifier/docs

---------

Co-authored-by: raghavanone <opensourcemaniacfreak@gmail.com>
Co-authored-by: jadechoghari <jadechoghari@users.noreply.huggingface.co>
Co-authored-by: Niels <niels.rogge1@gmail.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>

2025-01-08 09:52:51 +01:00

internal

Implement AsyncTextIteratorStreamer for asynchronous streaming (#34931 )

2024-12-20 12:08:12 +01:00

main_classes

HIGGS Quantization Support (#34997 )

2024-12-23 16:54:49 +01:00

model_doc

Add TextNet (#34979 )

2025-01-08 09:52:51 +01:00

quantization

HIGGS Quantization Support (#34997 )

2024-12-23 16:54:49 +01:00

tasks

Improved Documentation Of Audio Classification (#35368 )

2024-12-20 09:17:28 -08:00

_config.py

Add optimized PixtralImageProcessorFast (#34836 )

2024-11-28 16:04:05 +01:00

_redirects.yml

Docs / Quantization: Redirect deleted page (#31063 )

2024-05-28 18:29:22 +02:00

_toctree.yml

Add TextNet (#34979 )

2025-01-08 09:52:51 +01:00

accelerate.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

add_new_model.md

Model addition timeline (#33762 )

2024-09-27 17:15:13 +02:00

add_new_pipeline.md

[docs] Follow up register_pipeline (#35310 )

2024-12-20 09:22:44 -08:00

agents_advanced.md

Multiple typo fixes in Tutorials docs (#35035 )

2024-12-02 15:26:34 +00:00

agents.md

Multiple typo fixes in Tutorials docs (#35035 )

2024-12-02 15:26:34 +00:00

attention.md

[Docs] Fix broken links and syntax issues (#28918 )

2024-02-08 14:13:35 -08:00

autoclass_tutorial.md

[docs] Increase visibility of torch_dtype="auto" (#35067 )

2024-12-04 09:18:44 -08:00

benchmarks.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

bertology.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

big_models.md

[docs] Big model loading (#29920 )

2024-04-01 18:47:32 -07:00

chat_templating.md

Fix typo in chat template example (#35250 )

2024-12-12 16:53:21 -08:00

community.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

contributing.md

Enable doc in Spanish (#16518 )

2022-04-04 10:25:46 -04:00

conversations.md

[docs] change temperature to a positive value (#32077 )

2024-07-23 17:47:51 +01:00

create_a_model.md

Enable HF pretrained backbones (#31145 )

2024-06-06 22:02:38 +01:00

custom_models.md

Updated the custom_models.md changed cross_entropy code (#33118 )

2024-08-26 13:15:43 +02:00

debugging.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

deepspeed.md

Fix typos (#31819 )

2024-07-08 11:52:47 +01:00

fast_tokenizers.md

Migrate doc files to Markdown. (#24376 )

2023-06-20 18:07:47 -04:00

fsdp.md

Fix docs typos. (#35465 )

2025-01-02 11:29:46 +01:00

generation_strategies.md

Adaptive dynamic number of speculative tokens (#34156 )

2024-12-05 17:07:33 +01:00

gguf.md

Add Gemma2 GGUF support (#34002 )

2025-01-03 14:50:07 +01:00

glossary.md

Fix typos (#31819 )

2024-07-08 11:52:47 +01:00

how_to_hack_models.md

[Docs] Add Developer Guide: How to Hack Any Transformers Model (#33979 )

2024-10-07 10:08:20 +02:00

hpo_train.md

Trainer - deprecate tokenizer for processing_class (#32385 )

2024-10-02 14:08:46 +01:00

index.md

Add TextNet (#34979 )

2025-01-08 09:52:51 +01:00

installation.md

docs: HUGGINGFACE_HUB_CACHE -> HF_HUB_CACHE (#34904 )

2024-11-26 09:37:18 -08:00

kv_cache.md

[docs] add a comment that offloading requires CUDA GPU (#35055 )

2024-12-04 07:48:34 -08:00

llm_optims.md

Update llm_optims docs for sdpa_kernel (#35481 )

2025-01-06 08:54:31 -08:00

llm_tutorial_optimization.md

[docs] add explanation to release_memory() (#34911 )

2024-11-27 07:47:28 -08:00

llm_tutorial.md

Fix: typo (#33880 )

2024-10-02 09:12:21 +01:00

model_memory_anatomy.md

Enable BNB multi-backend support (#31098 )

2024-09-24 03:40:56 -06:00

model_sharing.md

[docs] update not-working model revision (#34682 )

2024-11-11 07:09:31 -08:00

model_summary.md

model_summary.md - Restore link to Harvard's Annotated Transformer. (#29702 )

2024-03-23 18:29:39 -07:00

modular_transformers.md

Improve modular transformers documentation (#35322 )

2024-12-20 09:16:02 -08:00

multilingual.md

Update all references to canonical models (#29001 )

2024-02-16 08:16:58 +01:00

notebooks.md

Enable doc in Spanish (#16518 )

2022-04-04 10:25:46 -04:00

pad_truncation.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

peft.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

perf_hardware.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

perf_infer_cpu.md

[docs] Increase visibility of torch_dtype="auto" (#35067 )

2024-12-04 09:18:44 -08:00

perf_infer_gpu_multi.md

Fix image preview in multi-GPU inference docs (#35303 )

2024-12-17 09:33:50 -08:00

perf_infer_gpu_one.md

Add diffllama (#34083 )

2025-01-07 11:34:56 +01:00

perf_torch_compile.md

[docs] use device-agnostic instead of cuda (#35047 )

2024-12-03 10:53:45 -08:00

perf_train_cpu_many.md

[doc] use full path for run_qa.py (#34914 )

2024-11-26 09:23:44 -08:00

perf_train_cpu.md

[doc] use full path for run_qa.py (#34914 )

2024-11-26 09:23:44 -08:00

perf_train_gpu_many.md

Multiple typo fixes in Tutorials docs (#35035 )

2024-12-02 15:26:34 +00:00

perf_train_gpu_one.md

Corrected max number for bf16 in transformer/docs (#33658 )

2024-09-25 19:20:51 +02:00

perf_train_special.md

Update all references to canonical models (#29001 )

2024-02-16 08:16:58 +01:00

perf_train_tpu_tf.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

performance.md

Simplify Tensor Parallel implementation with PyTorch TP (#34184 )

2024-11-18 19:51:49 +01:00

perplexity.md

[docs] use device-agnostic API instead of cuda (#34913 )

2024-11-26 09:23:34 -08:00

philosophy.md

[docs] fixed links with 404 (#27327 )

2023-11-06 19:45:03 +00:00

pipeline_tutorial.md

[docs] Increase visibility of torch_dtype="auto" (#35067 )

2024-12-04 09:18:44 -08:00

pipeline_webserver.md

Update all references to canonical models (#29001 )

2024-02-16 08:16:58 +01:00

pr_checks.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

preprocessing.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

quicktour.md

[docs] Increase visibility of torch_dtype="auto" (#35067 )

2024-12-04 09:18:44 -08:00

run_scripts.md

[docs] refine the doc for train with a script (#33423 )

2024-09-12 10:16:12 -07:00

sagemaker.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

serialization.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

task_summary.md

More fixes for doctest (#30265 )

2024-04-16 11:58:55 +02:00

tasks_explained.md

fix: Wrong task mentioned in docs (#34757 )

2024-11-18 18:42:28 +00:00

testing.md

[tests] add XPU part to testing (#34778 )

2024-11-18 09:59:11 -08:00

tf_xla.md

fix(docs): Fixed a link in docs (#32274 )

2024-07-29 10:50:43 +01:00

tflite.md

Update all references to canonical models (#29001 )

2024-02-16 08:16:58 +01:00

tiktoken.md

Updated documentation and added conversion utility (#34319 )

2024-11-25 18:44:09 +01:00

tokenizer_summary.md

[docs] Spanish translation of tokenizer_summary.md (#31154 )

2024-06-03 16:52:23 -07:00

torchscript.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

trainer.md

Fix callback key name (#34762 )

2024-11-18 18:41:12 +00:00

training.md

[docs] Increase visibility of torch_dtype="auto" (#35067 )

2024-12-04 09:18:44 -08:00

troubleshooting.md

Update all references to canonical models (#29001 )

2024-02-16 08:16:58 +01:00