SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Add WSD scheduler (#30231)

Browse Source 
* Added WSD scheduler.

* Added tests.

* Fixed errors.

* Fix formatting.

* CI fixes.
This commit is contained in:
Alexander Visheratin
2024-04-25 07:07:21 -04:00
committed by GitHub
parent 90cb55bf77
commit 7b1170b0fa
6 changed files with 82 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/main_classes/optimizer_schedules.md
View File

@@ -66,6 +66,8 @@ The `.optimization` module provides:
[[autodoc]] get_inverse_sqrt_schedule
[[autodoc]] get_wsd_schedule
### Warmup (TensorFlow)
[[autodoc]] WarmUp