Comments (1)
Hi @bnaman50
Yes, I have the same issue.
I think that another solution would be to modify the code in src/evaluate/utils/gradio.py to change the syntax of the depreciated gr.inputs and gr.outputs to use the interface components directly.
For maintaining current available evaluate metrics, the implementation can differ based on the version (an if statement would do).
from evaluate.
Related Issues (20)
- Unable to run pip install evaluate[template] HOT 1
- [FR] Confidence intervals for metrics
- How to pass generation_kwargs to the TextGeneration evaluator ?
- Metrics for multilabel problems don't match the expected format. HOT 2
- [Question]Shall we adding a faster BLEU score calculator?
- Can't load exist dataset for evaluation HOT 1
- Problems during run initial step HOT 12
- SyntaxError: closing parenthesis '}' HOT 3
- Evaluation of empty strings with MAUVE results in error
- Execution of example from the Using the evaluator docs fails due to unspecified tokenizer
- LocalModuleTest.test_load_metric_code_eval fails with "The "code_eval" metric executes untrusted model-generated code in Python."
- Evaluation of form feed symbol with BLEU results in error
- AttributeError: 'CombinedEvaluations' object has no attribute 'evaluation_modules' HOT 2
- [Metrics] ValueError: Expected to find locked file from process x but it doesn't exist.
- AttributeError: module 'evaluate' has no attribute 'load' HOT 7
- Unable to compute f1 score - Throwing Value Error trying to convert a string in non english Language to integer
- How to customize my own evaluator and metrics?
- Add note in repo and docs that library is no longer actively maintained HOT 4
- Benchmark evaluation for language models. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from evaluate.