Code for paper: Beyond "To Act or Not to Act": Fast Lagrangian Approaches to General Multi-Action Restless Bandits in AAMAS'21

first run bash make_dirs.sh to setup directory structure

Example Usage: python3 adherence_simulation.py -N 5 -n 200 -b 0.1 -s 0 -ws 0 -l 25 -d healthcare -S 4

• N: Number of trials to average over
• n: Number of processes
• b: Budget as a fraction of n
• s, ws: Seeds for random generator streams
• l: Length of simulation
• d: simulation environment
• S: number of states for the arms in the simulation (see specific simulation environments)

Note, the above example command should take about 10 minutes to run.

For a specific policy python3 adherence_simulation.py -N 5 -n 200 -b 0.1 -s 0 -ws 0 -l 25 -d healthcare -S 4 -pc 37

• -pc 0: No actions
• -pc 21: Hawkins
• -pc 24: VfNc
• -pc 27: SampleLam
• -pc 37: BLam0.1
• -pc 38: BLam0.2
• -pc 39: BLam0.3
• -pc 40: BLam0.5