SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
d7c8ce57d43499f0042e63d5be2592c641354bad
HuggingFace_transformer/tests
History
Sander Land d7c8ce57d4 Avoid accessing .dataset of a DataLoader in Trainer (#16451) 
* Avoid accessing .dataset of a dataloader

* style

* fix

* cleaning up, reverting some misunderstandings

* black

* add train_dataset argument to get_train_dataloader, and fix other instances of length checks

* flake8

* address comments

* fix bug

* cleanup

* add test

* Update tests/trainer/test_trainer.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* under torch

* merge

* stylistic suggestion

Co-authored-by: Sander Land <sander@chatdesk.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-03-29 15:00:18 -04:00
..
albert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
auto
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
bart
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
barthez
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
bartpho
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
beit
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
benchmark
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
bert
Fix tf.concatenate + test past_key_values for TF models (#15774)
2022-02-25 17:11:46 +01:00
bert_generation
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
bert_japanese
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
bertweet
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
big_bird
Fix missing output_attentions in PT/Flax equivalence test (#16271)
2022-03-29 17:51:48 +02:00
bigbird_pegasus
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
blenderbot
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
blenderbot_small
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
bort
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
byt5
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
camembert
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
canine
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
clip
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
convbert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
convnext
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
cpm
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
ctrl
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
data2vec
Add Data2Vec (#15507)
2022-03-01 11:09:20 +01:00
deberta
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
deberta_v2
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
decision_transformer
Decision transformer gym (#15845)
2022-03-23 16:18:43 -04:00
deepspeed
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
deit
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
detr
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
distilbert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
dit
[Tests] Fix DiT test (#16218)
2022-03-17 10:53:57 +01:00
dpr
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
dpt
Add DPT (#15991)
2022-03-28 16:28:10 +02:00
electra
Fix tf.concatenate + test past_key_values for TF models (#15774)
2022-02-25 17:11:46 +01:00
encoder_decoder
TF: properly handle kwargs in encoder_decoder architectures (#16465)
2022-03-29 18:17:47 +01:00
extended
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
fixtures
Add model like (#14992)
2022-01-24 15:25:10 -05:00
flaubert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
fnet
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
fsmt
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
funnel
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
generation
Fix generation min length (#16206)
2022-03-16 18:49:23 +01:00
glpn
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
gpt2
TF: add beam search tests (#16202)
2022-03-16 15:44:33 +00:00
gpt_neo
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
gptj
Fix some TF GPT-J CI testings (#16454)
2022-03-29 18:04:20 +02:00
herbert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
hubert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
ibert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
imagegpt
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
layoutlm
Fix a TF test name (LayoutLMModelTest) (#16061)
2022-03-11 11:22:36 +01:00
layoutlmv2
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
layoutxlm
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
led
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
longformer
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
luke
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
lxmert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
m2m_100
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
marian
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
maskformer
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
mbart
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
mbart50
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
megatron_bert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
megatron_gpt2
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
mluke
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
mobilebert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
mpnet
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
mt5
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
nystromformer
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
onnx
Add ONNX support for Blenderbot and BlenderbotSmall (#15875)
2022-03-25 17:04:43 +01:00
openai
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
optimization
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
pegasus
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
perceiver
Fix PerceiverMLP and test (#16405)
2022-03-28 14:06:48 +02:00
phobert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
pipelines
Attention mask is important in the case of batching... (#16222)
2022-03-18 10:02:12 +01:00
plbart
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
poolformer
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
prophetnet
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
qdqbert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
rag
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
realm
Fix and improve REALM fine-tuning (#15297)
2022-03-03 14:10:15 +01:00
reformer
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
rembert
Fix tf.concatenate + test past_key_values for TF models (#15774)
2022-02-25 17:11:46 +01:00
resnet
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
roberta
Fix tf.concatenate + test past_key_values for TF models (#15774)
2022-02-25 17:11:46 +01:00
roformer
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
sagemaker
Adapt import to new structure
2022-03-24 14:40:05 -04:00
segformer
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
sew
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
sew_d
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
speech_encoder_decoder
[FlaxSpeechEncoderDecoderModel] Ensure Input and Output Word Embeddings Are **Not** Tied (#16444)
2022-03-28 14:14:10 +02:00
speech_to_text
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
speech_to_text_2
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
splinter
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
squeezebert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
swin
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
t5
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
tapas
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
tokenization
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
trainer
Avoid accessing .dataset of a DataLoader in Trainer (#16451)
2022-03-29 15:00:18 -04:00
transfo_xl
Fixes Loss for TransfoXL when using Trainer API v2 (#16140)
2022-03-17 05:49:24 -04:00
trocr
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
unispeech
[Unispeech] Fix slow tests (#15818)
2022-02-24 19:08:54 +01:00
unispeech_sat
[UniSpeechSat] correct unispeech sat (#15847)
2022-02-28 11:23:13 +01:00
utils
Make Transformers use cache files when hf.co is down (#16362)
2022-03-23 15:56:49 -04:00
van
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
vilt
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
vision_encoder_decoder
TF: properly handle kwargs in encoder_decoder architectures (#16465)
2022-03-29 18:17:47 +01:00
vision_text_dual_encoder
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
visual_bert
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
vit
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
vit_mae
Add TF ViT MAE (#16255)
2022-03-29 18:24:15 +01:00
wav2vec2
[Flax] Improve Robustness of Back-Prop Tests (#16418)
2022-03-28 11:56:54 +02:00
wav2vec2_phoneme
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
wav2vec2_with_lm
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
wavlm
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
xglm
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
xlm
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
xlm_prophetnet
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
xlm_roberta
Reorganize file utils (#16264)
2022-03-23 10:26:33 -04:00
xlm_roberta_xl
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
xlnet
[TFXLNet] Correct tf xlnet generate (#15822)
2022-02-24 19:23:34 +01:00
yoso
[Test refactor 1/5] Per-folder tests reorganization (#15725)
2022-02-23 15:46:28 -05:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_configuration_common.py
Make Transformers use cache files when hf.co is down (#16362)
2022-03-23 15:56:49 -04:00
test_feature_extraction_common.py
Make Transformers use cache files when hf.co is down (#16362)
2022-03-23 15:56:49 -04:00
test_modeling_common.py
Add DPT (#15991)
2022-03-28 16:28:10 +02:00
test_modeling_flax_common.py
Fix missing output_attentions in PT/Flax equivalence test (#16271)
2022-03-29 17:51:48 +02:00
test_modeling_tf_common.py
Make Transformers use cache files when hf.co is down (#16362)
2022-03-23 15:56:49 -04:00
test_sequence_feature_extraction_common.py
[SequenceFeatureExtractor] Rewrite padding logic from pure python to numpy (#13650)
2021-09-21 17:10:13 +03:00
test_tokenization_common.py
Make Transformers use cache files when hf.co is down (#16362)
2022-03-23 15:56:49 -04:00