SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

updating examples and doc

Browse Source
This commit is contained in:
thomwolf
2019-07-14 23:20:10 +02:00
parent c490f5ce87
commit 2397f958f9
16 changed files with 601 additions and 667 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/model_doc/bert.rst
View File

@@ -15,10 +15,10 @@ BERT
:members:
``BertAdam``
``AdamW``
~~~~~~~~~~~~~~~~
.. autoclass:: pytorch_transformers.BertAdam
.. autoclass:: pytorch_transformers.AdamW
:members:
``BertModel``

7
docs/source/model_doc/gpt.rst
View File

@@ -15,13 +15,6 @@ OpenAI GPT
:members:
``OpenAIAdam``
~~~~~~~~~~~~~~~~~~
.. autoclass:: pytorch_transformers.OpenAIAdam
:members:
``OpenAIGPTModel``
~~~~~~~~~~~~~~~~~~~~~~~~~

2
docs/source/model_doc/overview.rst
View File

@@ -236,7 +236,7 @@ Learning Rate Schedules
The ``.optimization`` module also provides additional schedules in the form of schedule objects that inherit from ``_LRSchedule``.
All ``_LRSchedule`` subclasses accept ``warmup`` and ``t_total`` arguments at construction.
When an ``_LRSchedule`` object is passed into ``BertAdam`` or ``OpenAIAdam``\ ,
When an ``_LRSchedule`` object is passed into ``AdamW``\ ,
the ``warmup`` and ``t_total`` arguments on the optimizer are ignored and the ones in the ``_LRSchedule`` object are used.
An overview of the implemented schedules: