SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

tiny ppl doc typo fix (#5751)

Browse Source
This commit is contained in:
Joe Davison
2020-07-14 10:39:44 -06:00
committed by GitHub
parent ac921f0385
commit 5d178954c9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/perplexity.rst
View File

@@ -123,7 +123,7 @@ are 512 preceding tokens available to condition on).
stride = 512 stride = 512
lls = [] lls = []
for i in tqdm(range(1, encodings.input_ids.size(1), stride)): for i in tqdm(range(0, encodings.input_ids.size(1), stride)):
begin_loc = max(i + stride - max_length, 0) begin_loc = max(i + stride - max_length, 0)
end_loc = i + stride end_loc = i + stride
input_ids = encodings.input_ids[:,begin_loc:end_loc].to(device) input_ids = encodings.input_ids[:,begin_loc:end_loc].to(device)