Google DeepMind's Genie: AI for Playable Worlds

Key Points

• 1Genie is a new model that can generate interactive video games from just a text or image prompt.
• 2Genie is a foundation world model trained on videos sourced from the Internet.
• 3Genie consists of an autoregressive dynamics model, a spatiotemporal video tokenizer and a scalable latent action model.
• 4Genie is trained on video-only data, enabling anyone to create virtual worlds.
• 5The model can learn and reproduce controls for in-game characters exclusively from internet videos.