Comments (3)
Aside from the other issue you opened (#16), it's working. We've been pointing people to Henrik's future
documentation here: https://github.com/HenrikBengtsson/future , as parallelizing origami
is now just a matter of specifying a future plan
. @ck37 also requested a parallel example though, so maybe it's worth having a minimal one, just so people can get a sense of how it works before reading more in depth about Henrik's package.
@nhejazi, can you adapt the code here: https://github.com/jeremyrcoyle/origami/blob/master/tests/testthat/test_future_plan.R into an example? At some point, it might also be worth demonstrating that cv_fun
s themselves can create futures, and therefore we can do nested parallelization as in this example: https://github.com/HenrikBengtsson/future#nested-futures-and-evaluation-topologies This will be the mechanism by which the new origami_Superlearner
parallelizes across folds and learners.
from origami.
from origami.
@jeremyrcoyle - The test has been modified (with practically minimal changes) as an example in the cross_validate
function here as of cf2407a. I'm going to close this issue; feel free to re-open.
from origami.
Related Issues (20)
- Error when passing optional arguments to `cross_validate` HOT 10
- Added-value of origami compared to existing packages? HOT 2
- make_folds is unnecessarily slow for big data and v-fold cross-validation HOT 1
- if cv_fun accepts argument x, this conflicts with future_lapply argument x HOT 4
- DOI Issues HOT 1
- clearer code styling in wrappers (via JOSS) HOT 1
- future_lapply(): Please use future_lapply() of the future.apply package HOT 3
- disable globals by default HOT 2
- Broken vignette link in README HOT 1
- Broken link on doc pages HOT 1
- Test conditionally on 'forecast' package - otherwise check error HOT 3
- v-fold cross-validation fails when V = 1 HOT 1
- removed from CRAN due to failing tests in R 3.6+
- Forgotten future.seed = TRUE in future_lapply() HOT 1
- Partial argument names HOT 1
- unequal cluster sizes
- folds_rolling_origin on multivariate data
- Stratified CV brakes in particular setting
- future::values() is defunct and will soon to be removed HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from origami.