Arthur 6fc0454b2f [LlamaTokenizerFast] nit update post_processor on the fly (#23855) ...

* Update the processor when changing add_eos and add_bos

* fixup

* update

* add a test

* fix failing tests

* fixup

2023-05-30 16:50:41 +02:00

..

__init__.py

LLaMA Implementation (#21955)

2023-03-16 09:00:53 -04:00

test_modeling_llama.py

Beef up Llama tests (#22314)

2023-03-22 15:20:48 +00:00

test_tokenization_llama.py

[LlamaTokenizerFast] nit update post_processor on the fly (#23855)

2023-05-30 16:50:41 +02:00