Fabric for a deployable jmeter loadtesting cluster on Digital Ocean

You'll need Fabric, a python deployment tool,the Digital Ocean library (python-digitalocean) and the YAML parser for Python.

sudo easy_install pip
sudo pip install Fabric python-digitalocean PyYAML pyopenssl ndg-httpsclient pyasn1

Its also recommended that you install csshX (or cssh if you're not using Mac)

Tip: Download and install Tugboat CLI as a quick lookup for the digital ocean API

sudo gem install tugboat

Create a yaml file called config.yaml in this directory. Inside it, you should put your Digital Ocean Token and SSH key ID

ssh_key: 123456
token: 77e027c7447f468068a7d4fea41e7149a75a94088082c66fcf555de3977f69d3

Your SSH key ID can be found by using this cURL command with your token:

curl -X GET -H 'Content-Type: application/json' -H 'Authorization: Bearer 77e027c7447f468068a7d4fea41e7149a75a94088082c66fcf555de3977f69d3' "https://api.digitalocean.com/v2/account/keys"

Note: This returns in JSON so you'll need to read through the formatting to find the correct ID value.

Creating a cluster is done in two easy steps:

fab create:cluster_size=2

This will create a two server cluster. There are also other options:

• namespace: used to namespace the names of the servers. Defaults to lr.
• cluster_size: the number of servers to create in the region. Defaults to 1.
• hosting_region: the region to deploy the servers to. Defaults to nyc2.
• server_size: The size of the servers to deploy. Defaults to 1gb.

The create command will write the created servers to the config.yaml file. You can run the command multiple times to deploy multiple servers into different regions or namespaces.

Once a cluster of servers has been created, a command called "cluster" can be used in fabric to run commands in parallel on the servers.

fab cluster setup

This command should install all the requirements onto the servers to allow JMeter to run. Here is what it does at a high level:

• Install Java
• Install JMeter
• Create JMeter user
• Create JMeter directories (home, log)
• Setup password-less SSH access

Now you're all setup to run JMeter as a cluster.

Once you've created a test, you'll want to upload it to all the servers and run it. You can either manually upload the JMeter JMX file:

fab cluster upload:TestPlan.jmx

Or, alternatively you can clone a git repository on the servers (this is useful if your test plan for example uses CSV files):

fab cluster git_clone:[email protected]:wiifm69/loadtest-files.git

The above commands will upload the test plan file TestPlan.jmx to the servers in parallel.

fab csshx

This will output a csshX command that you can run to deploy a cluster of shells that can be commanded by a single red terminal. We'll use this to execute the load test.

On the JMeter servers:

jmeter -n -t ~/TestPlan.jmx

This will kick off the test and run each JMeter server independently.

After the test is complete and you want to get access to the results

fab cluster download_logs

An finally to destroy the servers

fab cluster destroy

The log files will now be locally stored, and you can concatenate them together and then open in JMeter.