Fixing question-answering with long contexts (#13873)

* Tmp.

* Fixing BC for question answering with long context.

* Capping model_max_length to avoid tf overflow.

* Bad workaround bugged roberta.

* Fixing name.
This commit is contained in:
Nicolas Patry
2021-10-05 16:08:58 +02:00
committed by GitHub
parent 1b74af76b7
commit 0ddadbf0a8
4 changed files with 189 additions and 88 deletions

View File

@@ -189,6 +189,7 @@ class ReformerModelTester:
def get_pipeline_config(self):
config = self.get_config()
config.vocab_size = 100
config.max_position_embeddings = 100
config.axial_pos_shape = (4, 25)
config.is_decoder = False
return config