7 Commits

Author	SHA1	Message	Date
SaulLu	1025a9b742	add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629) ... * update proto sentencepiece model * Revert "update proto sentencepiece model" This reverts commit b07f671747fec35773d0b3d4788b8b15aefa0229. * add check * add test * Revert "Revert "update proto sentencepiece model"" This reverts commit 46108257b8927b73627ec8f4f3eed53a95fc700d. * test for log level * test for log level 2 * warning at the warning level * clean * format * add explanation in docstring	2022-04-11 11:06:10 +02:00
Sylvain Gugger	3951b9f390	Add utility to find model labels (#16526) ... * Add utility to find model labels * Use it in the Trainer * Update src/transformers/utils/generic.py Co-authored-by: Matt <Rocketknight1@users.noreply.github.com> * Quality Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>	2022-04-04 10:06:57 -04:00
Sylvain Gugger	c595b6e6a9	Make Transformers use cache files when hf.co is down (#16362) ... * Make Transformers use cache files when hf.co is down * Fix tests * Was there a random circleCI failure? * Isolate patches * Style * Comment out the failure since it doesn't fail anymore * Better comment	2022-03-23 15:56:49 -04:00
Sylvain Gugger	4975002df5	Reorganize file utils (#16264) ... * Split file_utils in several submodules * Fixes * Add back more objects * More fixes * Who exactly decided to import that from there? * Second suggestion to code with code review * Revert wront move * Fix imports * Adapt all imports * Adapt all imports everywhere * Revert this import, will fix in a separate commit	2022-03-23 10:26:33 -04:00
Lysandre Debut	eca77f4719	Updates the default branch from master to main (#16326) ... * Updates the default branch from master to main * Links from `master` to `main` * Typo * Update examples/flax/README.md Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>	2022-03-23 03:46:59 -04:00
罗崚骁(LUO Lingxiao)	81643edda5	Support PEP 563 for HfArgumentParser (#15795) ... * Support PEP 563 for HfArgumentParser * Fix issues for Python 3.6 * Add test for string literal annotation for HfArgumentParser * Remove wrong comment * Fix typo * Improve code readability Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * Use `isinstance` to compare types to pass quality check * Fix style Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>	2022-03-17 13:51:37 -04:00
Lysandre Debut	29c10a41d0	[Test refactor 1/5] Per-folder tests reorganization (#15725) ... * Per-folder tests reorganization Co-authored-by: sgugger <sylvain.gugger@gmail.com> Co-authored-by: Stas Bekman <stas@stason.org>	2022-02-23 15:46:28 -05:00