While browsing the web, I stumbled upon a fascinating development in AI: the ability to play DOOM in the form of generative AI frames. This concept, showcased here, represents a significant leap in the future of gaming.
What you see on that page isn’t the original DOOM game; instead, it’s a real-time simulation made of generative frames. Essentially, each frame of the game is generated by AI in real-time. To simplify, imagine using a local LLM (large language model), such as Stable Diffusion or a similar image generation program. You ask it to generate an image, but instead of just one image, the AI generates every single frame as you play the game. The white paper on the link above explains this process in greater detail.
For instance, you could type, “DOOM, but everything is made of Play-Doh,” and suddenly, you have a fully playable version of DOOM where the entire world is crafted from Play-Doh. If you wanted to see a hyper-realistic version of the game, you could type, “DOOM, but everything is real life,” and the AI would generate a lifelike version of the game. The possibilities for customization are endless. This opens up an entire market of generative games, where anything that anyone can imagine can—and will—be made.
While exploring this idea, I also came across another fascinating example on X (formerly Twitter): Kimmonismus’ post. In this example, it appears that all of the art in the game was generated over pre-existing models, showcasing yet another layer of AI’s capability to augment gaming experiences.
But what if this technology didn’t stop at modifying games like DOOM? What if it extended to personal experiences?
Playing a Simulated Version of Your Childhood
Lately, I’ve been thinking a lot about the potential of AI to simulate real-life experiences. Imagine dusting off an old VHS tape of your childhood, training an AI model on it, and giving it the context to recreate those moments as a fully immersive game. You could relive your childhood but with the interactivity and high-fidelity graphics of the latest AAA games.
It goes beyond nostalgia: picture unboxing an old photo of your grandfather who has passed away. With AI, you could play a simulation of his day-to-day life, immersing yourself in a recreation of his world. It’s a powerful concept that could blend the lines between memories and virtual experiences, offering a new way to engage with the past in an interactive, personal format.
-Circuit Surfer ⎐⎏⎐⎏
