Ai2 releases ToyBlocks, a simulated world for studying robot learning

Ai2 has released ToyBlocks, the first of what it calls FoundationWorlds: simulated settings built so researchers can study robot learning under controlled conditions. ToyBlocks centers on a robot arm and blocks on a tabletop, and generates training demonstrations automatically rather than depending on people teleoperating the robot. Skill training runs in Nvidia's Isaac Lab, and a task-and-motion planner sequences those skills into complete demonstrations. The code, data and models are published openly.

The team says the deliberately simple setting still requires reasoning about how blocks interact during pushing, flipping and stacking, and lets researchers shift the mix of training experiences and test on tasks held out of training. Evaluation reports metrics such as execution speed, forces applied and task progress alongside success rates. Ai2 says it plans more complex FoundationWorlds.