Comments (6)
It will always launch only one instance. If you are not using spot, it will automatically launch the cheapest instance type from the list that satisfies your requirements. If you are using spot, it will automatically choose the instance type with the highest spot availability (and therefore the one with the best chances to successfully run the job)
from tibanna.
Hm... interesting. It has never failed at this step before. Unfortunately, we are not logging the fleet configuration at this step (we should). Is it using Benchmark to get a possible list of EC2s? Which instance types is it trying to launch? Can you set one manually?
from tibanna.
I think I found the issue. There are duplicate entries in our Benchmark EC2 list. See, e.g., r6a.32xlarge
here:
https://github.com/4dn-dcic/Benchmark/blob/master/src/Benchmark/aws/Amazon%20EC2%20Instance%20Comparison.csv
@clarabakker Please have a look as soon as possible.
from tibanna.
I believe it is using benchmark. I'm not running it with a specific instance_type, just a mem and cpu requirement. I am able to launch 1 TB nodes if I specify the instance type. I'm not sure exactly what instance_type the benchmark system identifies and tries to use.
from tibanna.
Thanks for clarifying. This confirms the issue. If you set mem
and cpu
, Benchmark will pick all instances that fit your requirements from the list above. But of course the list should not contain duplicate entries or the create_fleet
command will fail. As a workaround you can set the instance type directly (as you did). We will clean up the list and release a new version as soon as possible.
from tibanna.
Does create_fleet spawn all ec2 instances that satisfy requirements? If I only have one job, how does it pick which node in that 'fleet' it gets sent to? What happens to the nodes that don't receive the job?
from tibanna.
Related Issues (20)
- S3 Upload Encryption Argument HOT 11
- Minor bug when downloading files containing spaces to EC2 instance
- Tibanna1.0 errors out with Snakemake HOT 1
- Forked repo isn't used on EC2 instances even though it is declared at deployment HOT 3
- MissingInputException with Snakemake and Tibanna HOT 2
- Log Differences between 0.18.3 and 1.0+ HOT 3
- Specifying ECR AWSF_IMAGE in snakemake HOT 1
- Step functions fail for snakemake rules HOT 1
- Tibanna/Snakemake compatibility issue? HOT 4
- Docker image for 1.9.2 doesn't exist HOT 1
- AWS ending python 3.6 support for lambda functions HOT 1
- plot_metrics isn't producing some plots HOT 9
- botocore client error Rate Exceeded HOT 1
- Tibanna instance type error with snakemake HOT 29
- Transfer ownership of Snakemake tibanna plugin HOT 8
- Large amounts of NAT gateway costs HOT 4
- Turn off cloudwatch and costexplorer HOT 6
- KMS Authentication Error in Lambda When Running Tibanna HOT 1
- deploy_unicorn: Pip Install Conflict Error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tibanna.