Watch this Nvidia demo with human-like game characters

Nvidia's Kairos Demo: A Glimpse into the Future of Gaming

At Computex 2023, Nvidia and Convai showcased a groundbreaking demo that hints at the future of gaming and AI integration. The demo, set in a cyberpunk ramen shop called Kairos, demonstrates how generative AI can respond to natural language, allowing players to interact with game characters through speech rather than traditional dialogue options.

Special Features

The demo leverages Nvidia's ACE (Avatar Cloud Engine) suite, which includes NeMo for large language models, Riva for speech-to-text and text-to-speech, and runs both locally and in the cloud. Built in Unreal Engine 5 with ray-tracing, the visual quality is stunning, although the AI dialogue response still has room for improvement.

Use Cases

This technology opens up new possibilities for immersive gameplay, where NPCs can respond dynamically to player interactions, potentially even conversing with each other. The demo suggests a future where gaming experiences are more interactive and less scripted, enhancing player immersion.

Operation Guide FAQ

While the demo is not yet available for public use, the technology behind it, including Nvidia's ACE suite, is intended to be accessible for game developers. It's unclear how soon this technology will be integrated into mainstream games, but the potential is evident.

Price Information

Nvidia's ACE suite is likely to be part of their developer tools offerings, which are typically subscription-based or tied to specific licensing agreements. Pricing details are not publicly available yet.

Common Problems

The current demo shows that while the visual aspects of the technology are impressive, the AI dialogue needs refinement to provide more natural and contextually appropriate responses. Scaling the technology to handle multiple characters conversing simultaneously is another challenge that needs to be addressed.

This demo represents a significant step towards more interactive and dynamic gaming experiences, although there's still progress to be made in perfecting the AI interactions.