kimbring2 / alphastar_implementation Goto Github PK

Hi there,

When I ran the reinforcement learning, the program was interrupted with the exit code 137 (interrupted by signal 9: SIGKILL),

I found that the memory of the RAM was increasing in the Reinforcement Learning training process, and the training was interrupted when the memory was over 100%.

Step 320

Step 400

Thank you for your help.

according https://ychai.uk/notes/2019/07/21/RL/DRL/Decipher-AlphaStar-on-StarCraft-II/
, the spatial encoder may be not consistant with the description of the paper presented below:

Spatial encoder
Inputs: map, entity_embeddings
Outputs:
embedded_spatial - A 1D tensor of the embedded map
map_skip - output tensors of intermediate computation, used for skip connections.
map: add two features

cameral: whether a location is inside/outside the virtual camera;
scattered entities. Pass entity_embeddings through a size 32 conv1D followed by a ReLU, then scattered into a map layer so that the 32 vector at a specific location corresponds to the units placed there.
Concatenated all planes including camera, scattered_entities, vasibility, entity_owners, buildable, etc. Project to 32 channels by 2D conv with kernel size 1, followed by a ReLU. Then downsampled from 128x128 to 16x16 through 3 conv2D and ReLUs with different channel sizes (i.e., 64, 128, and 128).

embedded_spatial: The ResBlock output is embedded into a 1D tensor of size 256 by a MLP and a ReLU.

when I tried to run python trajectory_generator.py, I got error messages below and got nothing in the saving_path pysc2_dataset/simple64.

RuntimeError: Trying to run '/home/auto/StarCraftII/Versions/Base71663/SC2_x64', but it isn't executable.

Hello, would it be possible to add an open-source license to this code?

when running the alphastar.py, it gives this error: ImportError Canot import Scalar Encoder

Hi, I'm trying to run the supervised training on Windows 10 with the lastest SC II. Unfortuantely the replay files can't be loaded by this line:

info = controller.replay_info(replay_data)

in trajectory_generator.py, with such exception: SC2APIProtocol.ResponseReplayInfo.Error.ParsingError: 'Could not open initData for the replay:~\AppData\Local\Temp\StarCraft II\TempReplayInfo.SC2Replay', while TempReplayInfo.SC2Replay is a temp copy of Simple64 replay.

Is it possible to update the replay files with newest version of SC II? I think it's 5.0.13 now.

when running the alphastar.py env_test.py file in my terminal, it gives this error: IndexError: Cannot choose from an empty sequence

Traceback (most recent call last):
File "C:\Users\JACK\Desktop\AlphaStar_Implementation\run_reinforcement_learning.py", line 77, in
tf.config.experimental.set_memory_growth(physical_devices[0], True)
IndexError: list index out of range

run this project,There is a problem：‘Map 'mini_games\MoveToBeacon.SC2Map' not found.’
I'm sorry to bother you, but I don't know why. Hope you can answer .Thanks

I did download replay files from : https://drive.google.com/drive/folders/1lqb__ubLKLfw4Jiig6KsO-D0e_wrnGWk?usp=sharing,
but when I tried to run python trajectory_generator.py --replay_path [your path]/StarCraftII/Replays/local_Simple64/ --saving_path [your path]/pysc2_dataset/simple64, I got error messages below and got nothing in the saving_path pysc2_dataset/simple64.

OpenGL initialized!
Listening on: 127.0.0.1:18148
Startup Phase 3 complete. Ready for commands.
ConnectHandler: Request from 127.0.0.1:37386 accepted
ReadyHandler: 127.0.0.1:37386 ready
Could not find map name for file: /tmp/sc-k92ku45y/StarCraft II/TempReplayInfo.SC2Replay
Configuring interface options
Configure: raw interface enabled
Configure: feature layer interface enabled
Configure: score interface enabled
Configure: render interface disabled
Launching next game.
Next launch phase started: 2
Next launch phase started: 3
Next launch phase started: 4
Next launch phase started: 5
Next launch phase started: 6
Next launch phase started: 7
Next launch phase started: 8
Starting replay 'TempStartReplay.SC2Replay'
Game has started.
Using default stable ids, none found at: /home/dev/SC2.4.8.2/StarCraftII/stableid.json
Successfully loaded stable ids: GameData\stableid.json
Could not find map name for file: /tmp/sc-k92ku45y/StarCraft II/TempReplayInfo.SC2Replay
player1_race fail
Could not find map name for file: /tmp/sc-k92ku45y/StarCraft II/TempReplayInfo.SC2Replay
Configuring interface options
Configure: raw interface enabled
Configure: feature layer interface enabled
Configure: score interface enabled
Configure: render interface disabled
Launching next game.
Next launch phase started: 2
Next launch phase started: 3
Next launch phase started: 4
Next launch phase started: 5
Next launch phase started: 6
Next launch phase started: 7
Next launch phase started: 8
Starting replay 'TempStartReplay.SC2Replay'
Game has started.
Could not find map name for file: /tmp/sc-k92ku45y/StarCraft II/TempReplayInfo.SC2Replay
player1_race fail
Could not find map name for file: /tmp/sc-k92ku45y/StarCraft II/TempReplayInfo.SC2Replay

OS version is ubuntu16.04, python version is 3.7.7 and other dependencies are installed according to README.

Very good job. Hope to see more of your updates.