tufts-ai-robotics-group / polycraft-novelty-data Goto Github PK

Static dataset collection

Goal: Within 7 days (by 2/18)

Can we use current save screen functionality to gather a dataset of 1000+ images.

Deliverables:

• README describing how the dataset was collected (to bring new folks on project up to speed)
• Code to collect the data
• 1000+ examples of non-novel static scenarios, with associated image (at high resolution as possible) and json
• 1000+ examples of novel static scenarios, with associated image and json

Possible novelties for statics that we can do now:

• Novel objects: Light detector, ... (at least 20 exist currently)
• Novel position of object changes? (object in an unusual location)
• Novel position/view of agent?
• Novel multiplicities of objects? (add 5 rocks instead of 1)?
• Novel combinations of objects? (maybe a lake and a volcano never appear together typically)

Possible novelties that we could do soon:

• Replace textures and colors (by adjusting source files or editing numerical inputs to the renderer)

Agent experience over time dataset collection

Goal: Within 14 days (by 2/25)

Can we alter save screen to capture scenes as agent is running?