Immutability for data collators (#30603)

Browse Source

* immutability fix for seq2seq as well as immutability tests for the collators

* ensure we don't act on none labels and formatting

* remove tf/pt in respective tests as they are not required

* more type error fixes tf/np

* remove todo

* apply suggestions from code review

* formatting / style

...

This commit is contained in:

Anton Vlasjuk

2024-05-08 18:54:49 +02:00

committed by GitHub

parent 5962d62bac

commit 71c1985069

2 changed files with 1047 additions and 29 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

985

tests/trainer/test_data_collator.py

File diff suppressed because it is too large Load Diff