Comments (3)
@neolizhe, can you define deadline?
My understanding is that a deadline is a due date. I'm not aware of any due dates for this project. There are no deadlines to complete an eval.
Perhaps you mean date? For example, "the date of the last pull request." In this case, you can configure notifications for this project.
from evals.
@neolizhe, can you define deadline?
My understanding is that a deadline is a due date. I'm not aware of any due dates for this project. There are no deadlines to complete an eval.
Perhaps you mean date? For example, "the date of the last pull request." In this case, you can configure notifications for this project.
i mean you can set a date that first dozens of pull requests will be processed. for example, first 200 will be processed before 4/1/23. So i haven't check my pull request status every day.
from evals.
It's hard to set specific deadlines here, the team is working quickly on this but it's a non-trivial amount of work to review, run, and validate these PR's. We will improve the speed overtime with tooling but right now cannot set an expected timeline.
from evals.
Related Issues (20)
- Awaiting GPT4 access HOT 3
- Extracting and analyzing data from scientific articles
- stock picking as model eval HOT 1
- Any website where I can share evaluation results? HOT 7
- Registry path CLI option for oaievalset HOT 1
- Awaiting GPT-4 Access For Further Development HOT 2
- Functions: Support for minItems and maxItems for json schema array
- Access not working HOT 2
- Evaluate `gpt-4-0613` and `gpt-3.5-turbo-0613` yields `invalid_request_during_completion` HOT 3
- You should see GPT-4 API access enabled in your account in the next few days. HOT 1
- closedqa prompt is not adequate for gpt-4-0613
- 国际化的支持 HOT 3
- gpt-4-32k HOT 5
- Expose run_id to code being run within an eval HOT 1
- Code Evals
- Meaning of "elsuite" folder name HOT 2
- Unable to modify match_fn from within modelgraded eval .yaml file
- oaieval hangs a lot HOT 1
- Please approve pull request, changes were made.
- All evals currently in the repo appear only to have dev samples: is this correct? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from evals.