This project sets up an auto-scaling Slurm cluster
This sample requires the following:
-
CycleCloud must be installed and running.
a. If this is not the case, see the CycleCloud QuickStart Guide for assistance.
-
The CycleCloud CLI must be installed and configured for use.
-
You must have access to log in to CycleCloud.
-
You must have access to upload data and launch instances in your chosen Azure subscription
-
You must have access to a configured CycleCloud "Locker" for Project Storage (Cluster-Init and Chef).
-
You need to build the Slurm RPMs and put them in the
blobs/
directory. There is a script in the cluster-initscratch
directory to build the RPMs on a cloud node. Alternatively, you can run the included./docker-rpmbuild.sh
on a development machine withdocker
installed. Thisdocker-rpmbuild.sh
script will generate the rpm files for CentOS 7.x compatible nodes and place them in theblobs/
directory. -
Optional: To use the
cyclecloud project upload <locker>
command, you must have a Pogo configuration file set up with write-access to your locker.a. You may use your preferred tool to interact with your storage "Locker" instead.
-
Centos 7 with Cyclecloud 6.7.0 has been tested and confirmed working.
The first step is to configure the project for use with your storage locker:
-
Open a terminal session with the CycleCloud CLI enabled.
-
Switch to the Slurm sample directory.
-
Upload the project (including any local changes) to your target locker, run the
cyclecloud project upload
command from the project directory. The expected output looks like this:::
$ cyclecloud project upload
Sync completed!
IMPORTANT
For the upload to succeed, you must have a valid Pogo configuration for your target Locker.
To import the cluster:
-
Open a terminal session with the CycleCloud CLI enabled.
-
Switch to the Slurm directory.
-
Run
cyclecloud import_template Slurm -f templates/slurm_template.txt
. The expected output looks like this:::Keypair: $keypair Cluster nodes: master: off Total nodes: 1
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.