Today, the journal Nature is publishing our latest research, which introduces the first World and Human Action Model (WHAM). The WHAM, which we’ve named “Muse,” is a generative AI model of a video game that can generate game visuals, controller actions, or both.
In our research, we focus on exploring the capabilities that models like Muse need to effectively support human creatives by demonstrating how to develop research insights to support creative uses of generative AI models.
In our research, we focus on exploring the capabilities that models like Muse need to effectively support human creatives by demonstrating how to develop research insights to support creative uses of generative AI models.

Advancing game ideation with Muse: the first World and Human Action Model (WHAM)
Today Nature published Microsoft’s research detailing our WHAM, an AI model that generates video game visuals & controller actions. We are releasing the model weights, sample data, & WHAM Demonstrator on Azure AI Foundry, enabling researchers to build on the work.
www.microsoft.com