Support for Multiple Worker Types about concourse-up HOT 3 CLOSED

Hi karlkfi,

You can use the --workers and --worker-size flags on concourse-up deploy to configure the number and type of workers. Supported values for worker types can be found in the docs.

You are correct that setting a custom type would be overwritten by concourse-up if you deployed again. We currently only support t2 and m4 type vms but we would be interested to learn about use cases for other worker types.

from concourse-up.

The use case would be to exercise ML models on GPU instances, like g3 or p3, as part of a pipeline that includes other work on normal m4 instances, like compiling, release building, unit tests, etc.

from concourse-up.

This is not currently something on our roadmap. It is possible to modify the manifest/cloud config to allow whatever vm types are required but this will remove the ability to use concourse-up to update/manage that Concourse going forward as it would revert the manual changes.

from concourse-up.