tinyworldformer

About

A research project that runs two small neural networks on a Raspberry Pi Pico 2 W. A looped transformer world model predicts the next frame and reward from the current frame and action, and a small actor network picks actions, so the board generates and plays games such as Breakout, Pong and Flappy Bird without the real game. Looping one block with shared weights keeps the model small enough for a microcontroller.