RTVI-AI is a new open standard for Real-time Voice and Video Inference. Open source reference JavaScript and React SDKs are available today, with iOS, Android and other platform SDKS coming soon.
I'm a fan of anything that enables builders to build better, faster, and more expressively. This seems promising in that regard. I know @kwindla and the Daily.co team have many decades of combined experience with the WebRTC community and other open source projects. It's exciting to see them setting a new standard for real-time AI inference.
From @kwindla:
---
Today we’re announcing an open standard for Real-time Voice and Video Inference: RTVI-AI.
The RTVI abstractions and data structures define how client applications communicate with inference services. These are the “real-time APIs” for use cases like:
- Voice chat with LLMs
- Enterprise voice workflows such as healthcare patient intake
- Video avatars and immersive experiences
- Voice-driven user interfaces
- Voice conversational apps for education, customer support, and games
- High-framerate image generation and streaming generative video
We’re shipping open source reference JavaScript and React SDKs today, with iOS, Android and other platform SDKS coming soon.
This first release has been several months in the making, and incorporates work and insights from Groq, Deepgram, fal, Cartesia, Cerebrium, Vapi, and Daily
With RTVI, a “hello world” voice-to-voice AI chat app in JavaScript is 21 lines of code.
If you want to build real-time AI applications, implement infrastructure for real-time inference, or implement your own SDKs that leverage the RTVI standard, you are more than welcome to join this project. We welcome all contributions and ideas!
Congratulations on the launch! This tool looks very useful for real-time video interactions and AI integration.
I love the focus on making real-time voice and video AI accessible. This is a fantastic resource for developers!
Does thia support integration with popular video conferencing platforms like Zoom or Microsoft Teams? It would be fantastic to enhance those experiences with real-time AI features.
I’m really excited about the potential of this new standard for real-time voice and video inference. It’s a fantastic step forward for developers and creators
It's great to see open source solutions like this in the AI and audio space. Looking forward to the iOS and Android SDKs as well.
This sounds like a valuable tool for developers working with real-time voice and video. The open source approach and upcoming platform SDKs are impressive.
This new standard for real-time voice and video inference is very exciting! The availability of open source JavaScript and React SDKs makes it accessible for developers
Great work! I love the flexibility of your open standard. It’s fantastic to see how easily developers can build voice-to-voice AI chat apps with just a few lines of code
Congrats on your launch! I’m excited about the potential of integrating real-time voice and video inference. It’s a great step forward for developing interactive AI applications
Hello! The concept of making AI voice-to-voice and video applications more understandable is fantastic. I appreciate the flexibility of the client-side SDKs. Someone on my team has been looking for something like this, so I’ll definitely share it with them. Best of luck!
This tool looks really promising for AI applications! I'm particularly interested in how the line organization works. Congrats on the release!
Great job on the launch! This open standard for real-time voice and video inference looks like a helpful for developers. Good luck with this project!
What is RTVI-AI? Is it a new way to use AI for real-time voice and video? Can developers use it easily with JavaScript and React now? Will there be tools for other platforms like phones soon?
Wow, this is super exciting stuff! 🚀 Kudos to @kwindla and the Daily.co team for pushing the boundaries of real-time AI inference! I love how RTVI-AI opens up so many possibilities for builders to create innovative solutions.
The use cases listed are mind-blowing, especially voice chat with LLMs and immersive video experiences! Can't wait to see the iOS and Android SDKs roll out too. It’s great to know that it’s open-source, making it so accessible for developers!
Definitely looking forward to trying out that 21-line "hello world" app. This feels like just the beginning. Let’s build some awesome stuff together!
Congratulations on the launch! How does the video part works here? Does it use the same WebRTC standard? Thanks!
Hey Rajiv,
How does RTVI-AI handle scalability for large-scale applications?
Are there any performance benchmarks available?
Congrats on the launch!
Congratulations to the Daily.co team on the launch of RTVI-AI Open Standard on Product Hunt! This innovative open-source solution for building AI-powered voice chat apps in just 21 lines of JavaScript is a game-changer. I'm excited to see how the community embraces and builds upon this powerful tool. Well done, team!
About RTVI-AI Open Standard on Product Hunt
“Make an AI voice chat app in 21 lines of JavaScript”
RTVI-AI Open Standard launched on Product Hunt on July 23rd, 2024 and earned 128 upvotes and 14 comments, placing #17 on the daily leaderboard. RTVI-AI is a new open standard for Real-time Voice and Video Inference. Open source reference JavaScript and React SDKs are available today, with iOS, Android and other platform SDKS coming soon.
RTVI-AI Open Standard was featured in Open Source (68.3k followers), Artificial Intelligence (466.4k followers) and Audio (2k followers) on Product Hunt. Together, these topics include over 101.6k products, making this a competitive space to launch in.
Who hunted RTVI-AI Open Standard?
RTVI-AI Open Standard was hunted by Rajiv Ayyangar. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Reviews
RTVI-AI Open Standard has received 16 reviews on Product Hunt with an average rating of 5.00/5. Read all reviews on Product Hunt.
Want to see how RTVI-AI Open Standard stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Rajiv Ayyangar