bastrob 464d986b6c Add missing Flaubert tokenizer tests (#30492) ...

* add flaubert tokenization test, enrich inheritance in FlaubertTokenizer.

* fix quality code ci

* ensure parameter consistency

* fix ci

* fix copyright year and flatten vocab list.

* fix style

2024-06-05 13:52:16 +02:00

..

__init__.py

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00

test_modeling_flaubert.py

Fix 29807 sinusoidal positional encodings in Flaubert, Informer and XLM (#29904)

2024-04-02 10:27:26 +02:00

test_modeling_tf_flaubert.py

Remove static pretrained maps from the library's internals (#29112)

2024-03-25 10:33:38 +01:00

test_tokenization_flaubert.py

Add missing Flaubert tokenizer tests (#30492)

2024-06-05 13:52:16 +02:00