Comments (4)
jmorel
commented on June 25, 2024
I think that from the test framework, the only output we can see is the potential score. Which means in order to add checks on the execution, we'd have to add testtuples pretty much everywhere. This would make tests slower to run. Is this still a thing we want to do?
from substra-tests.
samlesu
commented on June 25, 2024
Yes, indeed currently the only output is the score.
In my point of view if the algo is validated in at least one test it would be enough.
If the model / data samples have not a valid format the train/test tuple will (should) not be able to run successfully.
from substra-tests.
Kelvin-M
commented on June 25, 2024
Is it still relevant @samlesu @jmorel ?
from substra-tests.
samlesu
commented on June 25, 2024
In my opinion we can close it, this ticket is too old :)
from substra-tests.
Related Issues (18)
- CI: Kaniko cache doesn't always work as expected HOT 4
- cp.list_traintuple doesn't return tuple in their creation order HOT 2
- xargs " --no-run-if-empty " does not exist on mac os HOT 4
- Google Cloud disk deletion does not work
- Test fails: test_compute_plan_aggregate_composite_traintuples HOT 1
- Substratest: avoid using string to define tuple status HOT 1
- Tests: mark/skip tests that cannot run without shared folder HOT 2
- Tests test_add_data_sample_located_in_shared_path should failed when no shared folder HOT 1
- Substratest: Asset objects: add validation HOT 1
- Tests: add a fast mode
- Failure on test tests/test_execution_compute_plan.py::test_compute_plan
- Tests: retry task test not working with prod settings HOT 1
- Split session object into client and state HOT 6
- Not compatible with python 3.6
- Separate system vs user tests
- Factory: validate factory content HOT 4
- SUBSTRAT_* global variables HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from substra-tests.