Sylvain Gugger 786ced3639 Add versioning system to fast tokenizer files (#12713) ...

* Add versioning system to fast tokenizer files

* Deal with offline mode

* Use staging env in tests

* Style

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Style

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

2021-07-21 08:24:36 -04:00

7.6 KiB

Raw Blame History

View Raw