I made a tiny world model game that runs locally on iPad
A prototype game uses a local AI 'world model' to interpret photos and drawings as interactive, controllable gameplay.
A developer known as u/howthefrondsfold has built a novel prototype that pushes the boundaries of local AI and interactive media. The project is a driving game powered by a custom-trained 'world model'—a type of AI that learns to simulate an environment—that runs entirely locally on an iPad. Instead of relying on traditional game engines with pre-built assets, this model attempts to interpret any photograph loaded by the user, transforming it into a navigable, playable game world. The developer describes the current output as 'a bit gloopy,' acknowledging the raw, experimental nature of the visual simulation.
The key innovation is the model's ability to generate interactive gameplay from static, user-provided content. Beyond photos, the prototype includes a feature where users can draw directly onto the screen, and the world model will interpret those sketches as part of the game environment. This creates a unique, generative gameplay loop where the 'world' is defined by the player's own images or artwork. While currently a proof-of-concept, the developer's goal is to evolve this into a full game loop, exploring the creative and unpredictable 'goopiness' of AI-simulated worlds as a core mechanic rather than a bug.
- The game uses a locally-run 'world model' AI, trained by the developer, to simulate gameplay on an iPad without cloud processing.
- Core functionality allows users to input any photo or make a drawing, which the AI interprets to create a controllable driving game environment.
- Described as a 'gloopy' prototype, it highlights the experimental potential of on-device AI for generating dynamic, user-defined interactive experiences.
Why It Matters
It demonstrates a path toward lightweight, creative AI tools that generate interactive content from simple inputs, running entirely on consumer devices.