Comments (2)
In case anyone else is playing along with what I'm attempting to do, i.e. deploying non nf-core pipelines using download. I had to cut-and-paste the following nf-core stuff into the config to make it work:
params {
// Config options
custom_config_version = 'master'
custom_config_base = "${projectDir}/../configs/"
config_profile_description = null
config_profile_contact = null
config_profile_url = null
config_profile_name = null
}
// Load nf-core custom profiles from different Institutions
try {
includeConfig "${params.custom_config_base}/nfcore_custom.config"
} catch (Exception e) {
System.err.println("WARNING: Could not load nf-core/config profiles: ${params.custom_config_base}/nfcore_custom.config")
}
singularity.cacheDir = "${projectDir}/../singularity-images/"
from tools.
I could gather after carefully reading the commandline output that it tried to download the images from quay.io when in reality the images are hosted on docker.io.
Since nf-core images are primarily hosted on quay.io
, I believe it is a reasonable default, if no explicit -l
/ --container-library
parameter has been specified. The only alternative would be to make this argument mandatory without a default?
The error message was not helpful in immediately identifying this as it only stated that it "failed for unclear reasons."
Admittedly, this is not ideal. Since nf-core download
only operates on the stderr
output of singularity pull
to assess the cause of an error, it is somewhat limited. The registries have different error messages in the response bodies of the request, and it is difficult to keep the regexes/keywords appropriately in sync despite a corresponding test. Please feel free to submit a PR suggesting an appropriate change to the ContainerError
class to make it work in that case.
The better solution would be to make a separate request to the URI prior to trying singularity pull
and utilize the HTTP status codes rather than bits of the response body text. Again, if you feel like implementing this, a PR is more than welcome.
from tools.
Related Issues (20)
- logo generation is inconsistent between github actions runners and local execution
- Schema lint: Handle exceptions for `TypeError`s
- Add option for custom child-template repo HOT 1
- Lint for `assertAll` in `main.nf.test` files
- Positional args warning is misleading
- Print warning if an nf-core module no longer exists.
- Broken link: schema_params HOT 1
- Add a suggestion to re-trigger nf-test when patching a modules
- nf-core download OperationalError: disk I/O error HOT 1
- `nf-core subworkflows test` `--profile` flag doesn't like specifying `docker` or `conda` HOT 1
- Replace `check_max` with `resourceLimits`
- Renaming job name in linting comment workflow HOT 1
- Combining linting and linting-comment workflows
- Nf-core workflow version update HOT 1
- Subworkflow installation bug
- Update linting to support to changes introduced in `nf-schema` HOT 2
- ToDo: Refactor SyncedRepo class and its subclasses ModulesRepo and WorkflowRepo
- nf-core should support private repos that are not on GitHub HOT 2
- Using the nfcore/tools docker image gets permission denied now
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tools.