Yoni Gottesman 082e57e0d4 Fix #34494 assistant tokens when truncated (#34531) ...

* Fix assistant tokens when truncated

* fix test

* fix test

* step

2024-11-05 15:10:15 +00:00

..

__init__.py

Add MarkupLM (#19198)

2022-09-30 08:25:43 +02:00

test_feature_extraction_markuplm.py

Add MarkupLM (#19198)

2022-09-30 08:25:43 +02:00

test_modeling_markuplm.py

Make pipeline able to load processor (#32514)

2024-10-09 16:46:11 +01:00

test_processor_markuplm.py

[Styling] stylify using ruff (#27144)

2023-11-16 17:43:19 +01:00

test_tokenization_markuplm.py

Fix #34494 assistant tokens when truncated (#34531)

2024-11-05 15:10:15 +00:00