SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
9,680 Commits 5 Branches 239 Tags
bdd690a74da5283cbc893dfd79e1c7c72ec1bcfa
Commit Graph

105 Commits

Author SHA1 Message Date
Leonid Boytsov
c82e017aa9 Misc. fixes for Pytorch QA examples: (#16958) 
1. Fixes evaluation errors popping up when you train/eval on squad v2 (one was newly encountered and one that was previously reported Running SQuAD 1.0 sample command raises IndexError #15401 but not completely fixed).
2. Removes boolean arguments that don't use store_true. Please, don't use these: *ANY non-empty string is being converted to True in this case and this clearly is not the desired behavior (and it creates a LOT of confusion).
3. All no-trainer test scripts are now saving metric values in the same way (with the right prefix eval_), which is consistent with the trainer-based versions.
4. Adds forgotten model.eval() in the no-trainer versions. This improved some results, but not everything (see the discussion in the end). Please, see the F1 scores and the discussion below.
 2022-04-27 08:51:39 -04:00
Jeevesh Juneja
b5c6a63ed9 Correct Logging of Eval metric to Tensorboard (#16825) 
* Correct Logging of Eval metric to Tensorboard

An empty dictionary ``eval_metrics`` was being logged, is replaced by ``eval_metric`` which is the output dictionary of ``metric.compute()``.

* Remove unused variable
 2022-04-19 17:27:54 +02:00
Zachary Mueller
69233cf03b Fix example logs repeating themselves (#16669) 
Move declaration of log streams to before tests, so that results won't get compounded on top of each other
 2022-04-11 16:25:16 -04:00
Ahmed Elnaggar
5e68675755 Fix t5 shard on TPU Pods (#16527) 
* Fix t5 shard on TPU Pods

The current script doesn't work properly on a TPU pod because the global batch is not divided correctly per host.
This pull request fixes this issue by dividing the global batch to each host before it is shared on each host.

* fix style

Co-authored-by: ahmed-elnaggar <ahmed.elnaggar@allianz.com>
 2022-04-11 16:45:20 +02:00
Lysandre Debut
a180efe7fd Dev version 2022-04-06 11:08:12 -04:00
Karim Foda
24a85cca61 Add use_auth to load_datasets for private datasets to PT and TF examples (#16521) 
* fix formatting and remove use_auth

* Add use_auth_token to Flax examples
 2022-04-04 10:27:45 -04:00
Stas Bekman
a73281e3e4 [examples] max samples can't be bigger than the len of dataset (#16501) 
* [examples] max samples can't be bigger than then len of dataset

* do tf and flax
 2022-03-30 12:33:16 -07:00
Yongrae Jo
8049dfa427 Update run_t5_mlm_flax.py (#16421) 
Fix typo in comment: proprocessed -> preprocessed
 2022-03-28 06:00:53 -04:00
Sylvain Gugger
867f3950fa Rename master to main for notebooks links and leftovers (#16397) 2022-03-25 09:12:23 -04:00
Sylvain Gugger
4975002df5 Reorganize file utils (#16264) 
* Split file_utils in several submodules

* Fixes

* Add back more objects

* More fixes

* Who exactly decided to import that from there?

* Second suggestion to code with code review

* Revert wront move

* Fix imports

* Adapt all imports

* Adapt all imports everywhere

* Revert this import, will fix in a separate commit
 2022-03-23 10:26:33 -04:00
Lysandre Debut
eca77f4719 Updates the default branch from master to main (#16326) 
* Updates the default branch from master to main

* Links from `master` to `main`

* Typo

* Update examples/flax/README.md

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2022-03-23 03:46:59 -04:00
Yeb Havinga
91fb62d01c Speedup training by using numpy instead of jnp for batch shuffling (#15963) 
Speedup training by using numpy instead of jnp for batch shuffling

Co-authored-by: Yeb Havinga <y.t.havinga@mgrid.net>
 2022-03-08 12:18:38 +01:00
Patrick von Platen
10b76987fc [FlaxT5 Example] fix flax t5 example pretraining (#15835) 2022-03-04 17:04:43 +01:00
Sylvain Gugger
79d28e80b6 v4.18.0.dev.0 2022-03-03 10:19:58 -05:00
Lysandre Debut
29c10a41d0 [Test refactor 1/5] Per-folder tests reorganization (#15725) 
* Per-folder tests reorganization

Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Stas Bekman <stas@stason.org>
 2022-02-23 15:46:28 -05:00
Sylvain Gugger
d0b5ed110a Harder check for IndexErrors in QA scripts (#15438) 
* Harder check for IndexErrors in QA scripts

* Make test stronger
 2022-02-01 15:49:13 -05:00
Kamal Raj
d2749cf72e Update README.md (#15462) 
fix typo
 2022-02-01 10:04:30 -05:00
Suraj Patil
87918d3221 [examples/Flax] add a section about GPUs (#15198) 
* add a section about GPUs

* Apply suggestions from code review

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2022-01-31 19:20:53 +01:00
Lysandre
eab338104d Docs for version v4.16.0 2022-01-27 13:11:51 -05:00
Lysandre
f87db5e412 Release: v4.16.0
Some checks failed
Release - Conda / build_and_package (push) Has been cancelled
Details
2022-01-27 13:06:33 -05:00
Kamal Raj
d1f5ca1afd [FLAX] glue training example refactor (#13815) 
* refactor run_flax_glue.py

* updated readme

* rm unused import and args typo fix

* refactor

* make consistent arg name across task

* has_tensorboard check

* argparse -> argument dataclasses

* refactor according to review

* fix
 2022-01-19 12:04:51 +01:00
Stas Bekman
762416ffa8 [examples/flax/language-modeling] set loglevel (#15129) 2022-01-13 15:17:28 +01:00
Yih-Dar
9f89fa02ed Add Flax image captioning example (#14864) 
* add image captioning example

* update README

* fix style & quality

* simplify

* apply review suggestions

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Apply review suggestions

* add comments about using np instead jax array

* remove unused lines

* add model creation script

* only support from_pretrained

* fix style

* fix

* not use cache_dir when creating model

* fix tokenizer creation

* update README

* fix quality

* apply suggestion

* simplify some blocks

* Update examples/flax/image-captioning/README.md


* Update examples/flax/image-captioning/run_image_captioning_flax.py

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* apply suggestion

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>
 2022-01-06 14:00:54 +01:00
Patrick von Platen
fa39ff9fc4 Docs for v4.16.0dev0 2021-12-22 20:39:44 +01:00
Patrick von Platen
05fa1a7ac1 Release: v4.15.0
Some checks failed
Release - Conda / build_and_package (push) Has been cancelled
Details
2021-12-22 18:43:15 +01:00
Lysandre
7c9c41f43c Docs for v4.14.0 2021-12-15 18:29:53 +01:00
Lysandre
960d8cb41d Release: v4.14.0
Some checks failed
Release - Conda / build_and_package (push) Has been cancelled
Details
2021-12-15 18:20:35 +01:00
Yih-Dar
a94105f95f Fix preprocess_function in run_summarization_flax.py (#14769) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2021-12-15 11:36:28 +01:00
Benjamin Minixhofer
2a606f9974 Make data shuffling in run_clm_flax.py respect global seed (#13410) 
* use jax and jnp instead of numpy in data_loader

* return batches as np.ndarray
 2021-12-14 11:04:43 +01:00
Suraj Patil
6a025487a6 [Flax examples] remove dependancy on pytorch training args (#14636) 
* use custom training arguments

* update tests
 2021-12-12 09:19:12 +05:30
Lysandre
ab31b3e41b Docs for v4.14.0dev0 2021-12-09 17:09:23 +01:00
Lysandre
4da3a696e4 Release: v4.13.0
Some checks failed
Release - Conda / build_and_package (push) Has been cancelled
Details
2021-12-09 16:55:21 +01:00
Suraj Patil
75ae287aec fix flax examples tests (#14646) 
* make tensorboard optional

* update test_fetcher for flax examples

* make the tests slow
 2021-12-07 00:34:27 +05:30
Suraj Patil
cbe6026536 fix flax example tests (#14643) 2021-12-06 23:14:37 +05:30
Julien Chaumond
6cdc3a7844 [urls to hub] Replace outdated model tags with their now-canonical pipeline types (#14617) 
* Replace outdated model tags with their now-canonical pipeline types

* spam the CI till it's green
 2021-12-06 04:35:01 -05:00
Suraj Patil
c5bd732ac6 Add Flax example tests (#14599) 
* add test for glue

* add tests for clm

* fix clm test

* add summrization tests

* more tests

* fix few tests

* add test for t5 mlm

* fix t5 mlm test

* fix tests for multi device

* cleanup

* ci job

* fix metric file name

* make t5 more robust
 2021-12-06 10:48:58 +05:30
Rahul Nadkarni
8332327dca Fix sentinel token IDs in data collator for Flax T5 pretraining script (#14477) 2021-11-29 17:30:17 +01:00
Kamal Raj
2bd950ca47 [Flax] token-classification model steps enumerate start from 1 (#14547) 
* step start from 1

* Updated cur_step calcualtion
 2021-11-29 21:55:59 +05:30
Nicholas Broad
69e16abf98 Switch from using sum for flattening lists of lists in group_texts (#14472) 
* remove sum for list flattening

* change to chain(*)

* make chain object a list

* delete empty lines

per sgugger's suggestions

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Nicholas Broad <nicholas@nmbroad.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2021-11-22 16:17:26 -05:00
Suraj Patil
85a4bda4f4 bump flax version (#14343) 2021-11-09 22:15:22 +05:30
Lysandre
b8fad022a0 v4.13.0.dev0 2021-10-28 12:56:46 -04:00
Lysandre
62bf536631 Release v4.12.0
Some checks failed
Release - Conda / build_and_package (push) Has been cancelled
Details
2021-10-28 12:09:49 -04:00
Dhananjay Shettigar
319beb64eb #12789 Replace assert statements with exceptions (#13909) 
* #12789 Replace assert statements with exceptions

* fix-copies: made copy changes to utils_qa.py in examples/pytorch/question-answering and examples/tensorflow/question-answering

* minor refactor for clarity
 2021-10-07 09:09:01 -04:00
Yih-Dar
a6ea244f99 Fix: save checkpoint after each epoch and push checkpoint to the hub (#13872) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2021-10-05 16:30:13 +05:30
Suraj Patil
7db2a79b38 [examples/flax] use Repository API for push_to_hub (#13672) 
* use Repository for push_to_hub

* update readme

* update other flax scripts

* update readme

* update qa example

* fix push_to_hub call

* fix typo

* fix more typos

* update readme

* use abosolute path to get repo name

* fix glue script
 2021-09-30 16:38:07 +05:30
Lysandre
11c69b8045 Docs for version v4.11.0 2021-09-27 14:19:38 -04:00
Lysandre
dc193c906d Release: v4.11.0
Some checks failed
Release - Conda / build_and_package (push) Has been cancelled
Details
2021-09-27 14:14:09 -04:00
Kamal Raj
78807d86eb [FLAX] Question Answering Example (#13649) 
* flax qa example

* Updated README:  Added Large model

* added utils_qa.py FULL_COPIES

* Updates:
1. Copyright Year updated
2. added dtype arg
3. passing seed and dtype to load model
4. Check eval flag before running eval

* updated README

* updated code comment
 2021-09-21 18:34:48 +05:30
Avital Oliver
51e5eca612 Add long overdue link to the Google TRC project (#13501) 
* Add long-overdue link to the Google TRC project

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Stefan Schweter <stefan@schweter.it>
 2021-09-14 13:41:55 +05:30
Stefan Schweter
09549aa18c examples: minor fixes in flax example readme (#13502) 2021-09-10 11:45:57 +05:30