Welcome to SAIDA RL! This is the open-source platform for anyone who is interested in Starcraft I and reinforcement learning to play and evaluate your model and algorithms.

• What is SAIDA RL?
• Basic
• Installation
  • Prerequisites
• Guide
  • Installation
  • Tutorials
  • API
• Environment
  • Agent
  • Scenarios
• Working Examples
• Plan
• Reference

It is a simulator for users to train and evaluate their own algorithms and models in challenging Starcraft I environment. It is not only provide simulator itself, but also provide tutorials, development api document. It is specialized in Starcraft I and provides many scenarios. You can taste very fresh and challenging game and you can try your own idea to make starcraft unit better.

Anyone who are familiar with reinforcement learning entities and how open ai gym works can skip this. In reinforcement learning, there are the environment and the agent. The agent sends actions to the environment, and the environment replies with observations and rewards.

SAIDA RL inherits interface of Env class of gym and provides baseline algorithms and agent source which is independent from Env. But it is up to you whether to use these baseline sources. The following are the Env methods you should know:

You can access three documentations to run a agent in this environment.

Link

Link

Link

We built environment based on openai gym. it consists of interface like below.

Agent we provide is based on keras-rl which is one of top reinforcement learning framework commonly used and we upgraded it by oursevles to support more. But you can use your own agent if you want. We decoupled between agent and environment. there is no dependencies so that, it is compatible with most numerical computation library, such as TensorFlow or Theano. You can use it from Python code, and soon from other languages. If you're not sure where to start, we recommend beginning with the tutorials on our site.

We have various challenging scenarios for you to motivate trying to solve with reinforcement learning algorithms.

we divided algorithms to three categories.

• QLearning

• SARSA

• DQN [1], [2]

• Dueling DQN [9]

• Double DQN [3]

• DRQN [11]

• REINFORCE [14]

• A2C

• DDPG [4]

• RDPG

• PPO [11]

• MADQN

• TD Gradient Lambda

• MADDPG [12]

• MARDPG

• BicNet [13]

Demos for well trained agents' play

for warming up, you can try this problem by yourselves.

Scurege's goal is to reach top area of current map avoiding conflict with observers surrounded

Reaver's goal is to reach bottom area of current map avoiding conflict with drop ship surrounded

Battle between one vulture and one zealot.

Battle between one vulture and two zealot.

• We will update more challenging scenarios.
• Multi Agent algorithms

1. Playing Atari with Deep Reinforcement Learning, Mnih et al., 2013
2. Human-level control through deep reinforcement learning, Mnih et al., 2015
3. Deep Reinforcement Learning with Double Q-learning, van Hasselt et al., 2015
4. Continuous control with deep reinforcement learning, Lillicrap et al., 2015
5. Asynchronous Methods for Deep Reinforcement Learning, Mnih et al., 2016
6. Continuous Deep Q-Learning with Model-based Acceleration, Gu et al., 2016
7. Deep Reinforcement Learning (MLSS lecture notes), Schulman, 2016
8. Dueling Network Architectures for Deep Reinforcement Learning, Wang et al., 2016
9. Reinforcement learning: An introduction, Sutton and Barto, 2011
10. Proximal Policy Optimization Algorithms, Schulman et al., 2017
11. Deep Recurrent Q-Learning for Partially Observable MDPs, M. Hausknecht and P. Stone, 2015
12. Multi-agent actor-critic for mixed cooperative-competitive environments, Lowe, Ryan, et al., 2017
13. Multiagent Bidirectionally-Coordinated Nets Emergence of Human-level Coordination in Learning to Play StarCraft Combat Games, Peng et al., 2017
14. Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning, William et al., 1992