Migrate metric to Evaluate library for tensorflow examples (#18327)
* Migrate metric to Evaluate library in tf examples Currently tensorflow examples use `load_metric` function from Datasets library , commit migrates function call to `load` function to Evaluate library. Fix for #18306 * Migrate metric to Evaluate library in tf examples Currently tensorflow examples use `load_metric` function from Datasets library , commit migrates function call to `load` function to Evaluate library. Fix for #18306 * Migrate `metric` to Evaluate for all tf examples Currently tensorflow examples use `load_metric` function from Datasets library , commit migrates function call to `load` function to Evaluate library.
This commit is contained in:
3
examples/tensorflow/translation/requirements.txt
Normal file
3
examples/tensorflow/translation/requirements.txt
Normal file
@@ -0,0 +1,3 @@
|
||||
datasets >= 1.4.0
|
||||
tensorflow >= 2.3.0
|
||||
evaluate >= 0.2.0
|
||||
@@ -28,9 +28,10 @@ from typing import Optional
|
||||
import datasets
|
||||
import numpy as np
|
||||
import tensorflow as tf
|
||||
from datasets import load_dataset, load_metric
|
||||
from datasets import load_dataset
|
||||
from tqdm import tqdm
|
||||
|
||||
import evaluate
|
||||
import transformers
|
||||
from transformers import (
|
||||
AutoConfig,
|
||||
@@ -590,7 +591,7 @@ def main():
|
||||
# endregion
|
||||
|
||||
# region Metric and postprocessing
|
||||
metric = load_metric("sacrebleu")
|
||||
metric = evaluate.load("sacrebleu")
|
||||
|
||||
def postprocess_text(preds, labels):
|
||||
preds = [pred.strip() for pred in preds]
|
||||
|
||||
Reference in New Issue
Block a user