Lysandre Debut e8f90b5397 Split transformers chat and transformers serve (#38443) ...

* Next token

* Split chat and serve

* Support both generation methods

* Style

* Generation Config

* temp

* temp

* Finalize serving.py

Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>

* Finalize chat.py

* Update src/transformers/commands/serving.py

Co-authored-by: célina <hanouticelina@gmail.com>

* Lucain's comments

Co-authored-by: Lucain <lucain@huggingface.co>

* Update

* Last comments on PR

* Better error handling

* Better error handling

* CI errors

* CI errors

* Add tests

* Fix tests

* Fix tests

* [chat] Split chat/serve (built on top of lysandre's PR) (#39031)

* Next token

* Split chat and serve

* Support both generation methods

* Style

* Generation Config

* temp

* temp

* Finalize serving.py

Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>

* Finalize chat.py

* Update src/transformers/commands/serving.py

Co-authored-by: célina <hanouticelina@gmail.com>

* Lucain's comments

Co-authored-by: Lucain <lucain@huggingface.co>

* Update

* Last comments on PR

* Better error handling

* Better error handling

* CI errors

* CI errors

* Add tests

* Fix tests

* Fix tests

* streaming tool call

* abstract tool state; set tool start as eos

* todos

* server working on models without tools

* rm chat's deprecated flags

* chat defaults

* kv cache persists across calls

* add server docs

* link

* Update src/transformers/commands/serving.py

* Apply suggestions from code review

* i love merge conflicts

* solve multi turn with tiny-agents

* On the fly switching of the models

* Remove required positional arg

---------

Co-authored-by: Lysandre <hi@lysand.re>
Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>
Co-authored-by: Lucain <lucain@huggingface.co>

* Protect names

* Fix tests

---------

Co-authored-by: =?UTF-8?q?c=C3=A9lina?= <hanouticelina@gmail.com>
Co-authored-by: Lucain <lucain@huggingface.co>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

2025-06-30 15:10:53 +02:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

commands

Split transformers chat and transformers serve (#38443)

2025-06-30 15:10:53 +02:00

deepspeed

Remove script datasets in tests (#38940)

2025-06-25 14:31:20 +00:00

extended

Add Optional to remaining types (#37808)

2025-04-28 14:20:45 +01:00

fixtures

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

fsdp

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

generation

fix test_compare_unprocessed_logit_scores (#39053)

2025-06-26 18:36:56 +02:00

models

fix UT failures on XPU w/ stock PyTorch 2.7 & 2.8 (#39116)

2025-06-30 11:49:03 +02:00

optimization

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

peft_integration

TST Fix PEFT integration test bitsandbytes config (#39082)

2025-06-27 18:33:11 +02:00

pipelines

Fixes the failing test test_is_split_into_words in test_pipelines_token_classification.py (#39079)

2025-06-27 19:25:32 +01:00

quantization

fix UT failures on XPU w/ stock PyTorch 2.7 & 2.8 (#39116)

2025-06-30 11:49:03 +02:00

repo_utils

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

sagemaker

Deprecate TF + JAX (#38758)

2025-06-11 17:28:06 +01:00

tensor_parallel

fix UT failures on XPU w/ stock PyTorch 2.7 & 2.8 (#39116)

2025-06-30 11:49:03 +02:00

tokenization

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

trainer

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

utils

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

__init__.py

…

causal_lm_tester.py

Refactor DBRX tests to use CausalLMModelTest base classes (#38475)

2025-06-13 16:22:12 +01:00

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Add Idefics2/3 and SmolVLM Fast image processors + improvements for fast image processors (#38157)

2025-06-23 14:17:25 +00:00

test_image_transforms.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_modeling_common.py

skip some test_sdpa_can_dispatch_on_flash (#39092)

2025-06-27 23:08:14 +02:00

test_pipeline_mixin.py

No more Tuple, List, Dict (#38797)

2025-06-17 19:37:18 +01:00

test_processing_common.py

[video processors] support frame sampling within processors (#38105)

2025-06-12 09:34:30 +00:00

test_sequence_feature_extraction_common.py

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

test_tokenization_common.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00

test_video_processing_common.py

[video processors] support frame sampling within processors (#38105)

2025-06-12 09:34:30 +00:00