RGB observation about minigrid HOT 9 CLOSED

Hi, yes there is. You can call the env.get_obs_render() method to generate images: https://github.com/maximecb/gym-minigrid/blob/master/gym_minigrid/minigrid.py#L1215

Note that this will produce a partial observation still, not a fully observable render. If you want a fully observable render, you can call env.render('rgb_array').

from minigrid.

How do you actually use env.get_obs_render()?

I tried it like this, but got a keyword argument exception on 'mode':

import gym_minigrid
import gym
import numpy as np
import matplotlib.pyplot as plt


env = gym.make("MiniGrid-FourRooms-v0")
obs = env.reset()
env.render()

agent_frame = env.get_obs_render(obs["image"], mode="rgb_array")

plt.imshow(agent_frame)
plt.show()

from minigrid.

I solved the issue by installing gym_minigrid from source. I installed the pip package previously.
@maximecb could you update the pip package?

from minigrid.

Related to that - is there an easy built-in way to mask out those parts of the environment that the agent cannot see from the current position (e.g due to walls, etc)?

EDIT: I see there are built-in methods to mask out cells that are invisible to the agent (https://github.com/maximecb/gym-minigrid/blob/master/gym_minigrid/minigrid.py#L1160). That is then translated to an image of environment via decode here https://github.com/maximecb/gym-minigrid/blob/master/gym_minigrid/minigrid.py#L548 .

It seems that an empty or invisible cell have the same representation (I suppose just black). Am I correct with that? If yes, for the agent an empty and invisible cell do not make a difference. I think though semantically, "visible and empty" cell (known to be empty) should deliver a different perception as "non-visible" cell (uncertain whether empty or whatever). For instance, invisible cells could be rendered as "grayed out", "foggy" etc. What do you folks think?

from minigrid.

Hi @JeniaJitsev, the masking should be enabled by default. You are correct that the agent gets a different perception for empty and invisible cells, but right now there is no special rendering for invisible cells in the RGB render.

from minigrid.

@MarcoMeter Thanks for the heads up. I just pushed a package version 0.0.5 to pip

from minigrid.

Hey @maximecb, thanks for quick response and package update. We can have a look whether there is a straighforward simple way to incorporate an option for rendering of empty vs invisible cells to be different in image observation, so it can be then enabled / disabled given corresponding demand.

from minigrid.

@JeniaJitsev can you open a new issue for this and explain what your use case is. That is, why you want them rendered differently/

from minigrid.

Sure, will do

from minigrid.