I was the founder and tech lead on Voice SDK for over 5 years at Meta. As part of the Presence Platform for the Oculus SDK we provided natural voice interactions through machine learning based NLU.
Mets's Voice SDK was a major announcement at Meta Connect 2021 (formerly Oculus Connect), introducing a powerful tool for developers to add voice interaction, search, and voice-driven gameplay to VR apps on Quest devices, leveraging Meta's Wit.ai platform for natural language understanding (NLU) and enabling hands-free, immersive experiences for the emerging metaverse.
We built versions of Voice SDK for both Unity and Unreal Engine Voice SDK is still available on the Unity Asset Store
The Voice SDK enables you to bring voice interactions to your app experiences. Use the Voice SDK to enhance the AR/VR experience with more natural and flexible ways for people to interact with the app. For example, voice commands can shortcut controller actions with a single phrase, or interactive conversation can make the app more engaging.
Powered by the Wit.ai Natural Language Understanding (NLU) service, the Voice SDK is compatible with Oculus headsets, mobile devices, and other third-party platforms. Wit.ai is easy to sign up for, and it’s free. Using Wit, you can easily train apps to use voice commands with no prior AI/ML knowledge required. The combination of the Voice SDK and Wit.ai empowers you to focus on the creative and functional aspects of the app, while enabling powerful voice interactions.