We believe that every aspect of the creative process, from systems to objects to pixels, will be impacted by AI – and so will all of the resulting runtime characters, worlds, and experiences.
AI can help you to be more productive while staying fully in control of your vision. It offers the possibility of in-game features and capabilities that couldn’t be built otherwise, potentially revolutionizing player experiences by embedding AI models in the runtime so content reacts and responds to players and users in new ways.
We’re harnessing the power of AI to drive innovation, accelerate content creation, and increase your productivity across games, entertainment, and industrial use cases. We’ve been building a suite of AI tools that promise to accelerate creation time and complement your workflows by finding information and generating draft assets as quickly as typing in a text prompt or scribbling a sketch. From there, you could integrate work with familiar tooling to revise and edit the assets you need at a speed that’s unimaginable with today’s workflows.
Today we’re announcing two new AI products: Unity Muse, an expansive platform for AI-driven assistance during creation, and Unity Sentis, which allows you to embed neural networks in your builds to enable previously unimaginable real-time experiences.
Whether you’re just getting started or already a Unity expert, Muse and Sentis are here to help you open up new avenues of creativity and innovation. We’re committed to working closely with you to explore, validate, and define our AI offerings, which is why both will be available via closed beta at this time. Your feedback is vital for this work and will be actively solicited, considered, and integrated throughout the process.
Unity Muse
Unity Muse is an AI platform that accelerates the creation of real-time 3D applications and experiences like video games and digital twins. The eventual goal of Muse is to enable you to create almost anything in the Unity Editor using natural input such as text prompts and sketches.
Now in closed beta: Muse Chat
Starting today, we’re beginning a closed beta for Muse Chat, a critical feature of the Muse platform. Using Muse Chat, you can leverage AI-based search across Unity documentation, training resources, and support content to get well-structured, accurate, and up-to-date information from Unity. Muse Chat helps you find relevant information, including working code samples, to speed up development and troubleshoot issues.
Over the next few months, you’ll see even more features in our Muse platform, including the ability to create textures and sprites or even fully animate a character, all using natural input.
This is just the beginning – Unity Muse will continuously improve to help you in the Editor and on the web.
This content is hosted by a third party provider that does not allow video views without acceptance of Targeting Cookies. Please set your cookie preferences for Targeting Cookies to yes if you wish to view videos from these providers.
Unity Sentis
Unity Sentis is a literal gamechanger. At a technical level, it bridges neural networks with the Unity Runtime, but the possibilities that Sentis unlocks are near endless.
Now in closed beta
Unity Sentis enables you to embed an AI model in the Unity Runtime for your game or application, enhancing gameplay and other functionality directly on end-user platforms.
Sentis allows AI models to run on any device where Unity runs. It’s the first and only cross-platform solution for embedding AI models into a real-time 3D engine, so you can build once and embed your model so it can run on the edge on multiple platforms, from mobile to PC and web to popular game consoles like Nintendo Switch™ and Sony PlayStation®. Since you’re running your program on the user’s device, there’s no complexity, latency, or cost associated with model hosting in the cloud.
This content is hosted by a third party provider that does not allow video views without acceptance of Targeting Cookies. Please set your cookie preferences for Targeting Cookies to yes if you wish to view videos from these providers.
Discover more AI solutions
Starting today, we’re also making available AI Verified Solutions – third-party packages that meet Unity’s highest quality and compatibility standards – on the Unity Asset Store. You can now find professional-quality AI solutions from providers such as Atlas, Convai, Inworld AI, Layer AI, Leonardo Ai, LMNT, Modl.ai, Polyhive, Replica Studios, and Zibra AI. These new solutions enable AI-powered smart NPCs, AI-produced VFX, textures, 2D sprites and 3D models, generative speech, in-gaming testing with AI, and more, all designed to support and accelerate your creative process.
ForumsShare your thoughts and questions with our team.
This is just the beginning
Stay in the loop about current and upcoming AI betas by signing up for the Unity AI Beta Program. Share your feedback and join the discussion on the new Muse and Sentis forums today.
We can’t wait to see how you leverage AI from Unity Muse, Sentis, and our growing ecosystem of AI Verified Solutions on the Unity Asset Store to accelerate your workflows and supercharge your experiences.
Nintendo Switch is a trademark of Nintendo.