Inworld AI announces that it has partnered with Nvidia and Streamlabs to create an intelligent streaming assistant using AI technology.

Streamlabs’ Intelligent Streaming Assistant is like an interactive co-host, expert producer and technical assistant to support independent creators with an entire production team. Inworld AI will provide its brains with multimodal AI, which can offload tasks from streamers without large production teams.

The companies made the announcement to Nvidia CEO Jensen Huangkeynote speech by sa CES 2025.

The collaboration brings together Streamlabs’ expertise in live streaming and Nvidia’s ACE technology for digital people. The latter includes audio-to-face animations, 3D rendering technology, as well as AI vision models that understand what is happening on the screen; and Inworld’s advanced generative AI capabilities for perception and cognition. Together, these technologies simplify streaming while empowering creators to produce high-quality, compelling content.

Creators can choose from assistant personalities that complement the tone of their stream, whether they’re looking for subtle behind-the-scenes support or a lively co-host.

How it works

Here’s how Inworld works under the hood to use this AI agent:

• Interactive co-host: Using Nvidia’s computer vision capabilities to detect real-time events with Inworld’s ability to drive real-time agent behavior based on the game state and understanding the context of games like in Fortnite, the Intelligent Streaming Assistant can provide commentary relevant to the context of the creator’s request. This awareness enables the assistant to do things like highlight a well-timed build, provide commentary during a dramatic Victory Royale, or shout out audience members for sending tips. .
• Stream Producer: Like a producer managing the flow of a live show, the Intelligent Streaming Assistant can trigger audio and visual effects to enhance high-impact gameplay or clip the best highlights for replay. Inworld processes multimodal inputs from the creator, chat, and game to implement these producer actions through the Streamlabs API, giving the creator full control over how their stream works.
• Technical Assistant: Intelligent Streaming Assistant also helps with Streamlabs desktop setup and troubleshooting. Inworld processes inputs from the creator to implement scene transitions or animations through the Streamlabs API, helping ensure the stream runs smoothly.

Intelligent Streaming Assistant will be available through the Streamlabs App Store when the product launches later in 2025.

“The pace of innovation in generative AI is unprecedented, pushing us beyond first-generation applications into a new era of sophisticated agent behavior,” said Kylan Gibbs, CEO of Inworld. , in a statement. “Our collaboration with Streamlabs and Nvidia demonstrates how Inworld’s AI agents can enable real-time, context-aware interactions. More importantly, it demonstrates the real-world potential of AI to increase games and entertainment—empowering creators to deepen engagement and delight their audiences.

Livestreaming has never been more popular—or more in demand. As millions of creators engage audiences around the world, the challenges of managing production, engaging audiences, and delivering entertaining commentary simultaneously can be overwhelming.

From juggling scene transitions to providing entertaining commentary, streamers must navigate a complex mix of technical and creative demands, often with limited resources, Inworld AI said.

For new and smaller creators, these barriers can be overwhelming, making it difficult to grow their audience and maintain consistency, the company said. Whether acting as a dynamic co-host by engaging the audience through real-time interaction or as a producer streamlining technical workflows, Intelligent Streaming Assistant empowers creators to focus on what matters most – engaging their audience.

“We hope that with this groundbreaking technology, creators can now embrace AI in a way that is true to their brand and enables them to push the boundaries of innovation,” said Ashray Urs, head of Streamlabs. , in a statement. “The first intelligent streaming assistant represents another leap forward for the medium, empowering creators to use this technology to make streaming faster and more engaging, all while maintaining the level of reliability they need to will nurture and develop their community.”

Inworld’s AI engine and tools are sparking the next generation of innovation in games and entertainment. Inworld is backed by Lightspeed Venture Partners, Section 32, Intel Capital, Founders Fund, Disney Accelerator, Microsoft’s M12 fund, BITKRAFT Ventures, First Spark Ventures founded by Eric Schmidt, The Venture Reality Fund, Kleiner Perkins, CRV, Stanford University, Meta , Micron Ventures, LG Technology Ventures, Samsung Next, NTT Docomo Ventures, and SK Telecom Venture Capital.