SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Sanchit Gandhi
2022-03-10 10:20:37 +01:00
committed by GitHub
parent fde901877a
commit 6c9010ef63
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/research_projects/jax-projects/README.md
View File

@@ -780,7 +780,8 @@ def cross_entropy(logits, labels):
# define a function which will run the forward pass return loss # define a function which will run the forward pass return loss
def compute_loss(params, input_ids, labels): def compute_loss(params, input_ids, labels):
logits = model(input_ids, params=params, train=True) logits = model(input_ids, params=params, train=True)
loss = cross_entropy(logits, onehot(labels)).mean() num_classes = logits.shape[-1]
loss = cross_entropy(logits, onehot(labels, num_classes)).mean()
return loss return loss
``` ```