Files
HuggingFace_transformer/docs/source
Suraj Patil f6e74a63ca Add m2m100 (#10236)
* m2m_100

* no layernorm_embedding

* sinusoidal positional embeddings

* update pos embeddings

* add default config values

* tokenizer

* add conversion script

* fix config

* fix pos embed

* remove _float_tensor

* update tokenizer

* update lang codes

* handle lang codes

* fix pos embeds

* fix spm key

* put embedding weights on device

* remove qa and seq classification heads

* fix convert script

* lang codes pn one line

* fix embeds

* fix tokenizer

* fix tokenizer

* add fast tokenizer

* style

* M2M100MT => M2M100

* fix copyright, style

* tokenizer converter

* vocab file

* remove fast tokenizer

* fix embeds

* fix tokenizer

* fix tests

* add tokenizer tests

* add integration test

* quality

* fix model name

* fix test

* doc

* doc

* fix doc

* add copied from statements

* fix tokenizer tests

* apply review suggestions

* fix urls

* fix shift_tokens_right

* apply review suggestions

* fix

* fix doc

* add lang code to id

* remove unused function

* update checkpoint names

* fix copy

* fix tokenizer

* fix checkpoint names

* fix merge issue

* style
2021-03-06 22:14:16 +05:30
..
2021-02-24 15:19:01 -05:00
2021-03-06 22:14:16 +05:30
2021-02-01 17:55:10 +03:00
2021-02-28 08:27:54 -05:00
2021-03-06 22:14:16 +05:30
2020-12-07 18:36:34 -05:00
2021-01-27 03:20:09 -05:00
2020-04-06 14:32:39 -04:00
2020-12-07 18:36:34 -05:00
2021-03-06 22:14:16 +05:30
2020-12-07 18:36:34 -05:00