The touchless control enabled ecosystem is on the verge of maturing to an inflection point of mass adoption as Clay AIR integrates into Qualcomm’s Snapdragon™ chipsets. This undisputed mobile XR leader is bringing 5G connectivity to the world of XR with Clay AIR as the dominant solution for seamless interactivity.
“Clay AIR’s partnership with Qualcomm enables our technology to be embedded into Qualcomm’s chips. The partnership will include a high performance SDK with optimized hand tracking and gesture recognition as a top tier solution to the AR and VR ecosystem,” said Thomas Amilien, CEO of Clay AIR.
Integrating Clay AIR’s software into the deepest level of the tech stack is setting the industry standard for high performance interactivity in AR/VR devices across the ecosystem, including Nreal (see Nreal partners with Clay AIR), Oculus, HTC, Lenovo, Pico and many more devices. Qualcomm’s Snapdragon processors and reference designs are central to providing the hardware that these AR/VR device makers need to create high-end experiences for end-users and enterprises.
Clay AIR’s technology can be implemented into any device with a camera without the need for any additional hardware. This means that players in the augmented and virtual reality space can integrate hand tracking and gesture recognition technology at a low cost by leveraging existing wide FOV (field of view) cameras that are used for other functionalities. Bulky and heavy devices are a barrier of entry to enterprise and consumer adoption, and the ability to use existing cameras enables Clay AIR to embed on lightweight devices such as Nreal’s augmented reality glasses.
This hand tracking and gesture recognition touchless revolution, where we can control and interact with virtual and digital objects with our hands, is a greatly anticipated development. We spend our lives interacting with our hands, and the inability thus far to translate the way we naturally communicate into digital and virtual environments has created friction for users. Clay AIR’s technology uses AI to process and capture subtle gestures to power human interactions, creating seamless interactivity with digital content.
When paired with eye tracking, facial tracking, facial recognition, biometrics, wearables and the growth of 3D development platforms such as Unreal and Unity, this conglomerate of technologies is paving the way for interactivity that is seeing exponential growth with the onset of 5G.
5G will power a new era of the web and an entire ecosystem of interactivity across augmented reality, virtual reality, smart displays and connected devices. As telecom giants lay the infrastructure for 5G and edge computing over the next five to ten years, the need for ubiquitous connectivity and its toolsets has already arrived. Manufacturers that are integrating hand tracking and gesture recognition into their devices today, will be the market leaders in the 5G revolution tomorrow.
Clay AIR’s high fidelity hand-tracking can be embedded in native monochrome cameras with low CPU consumption. The software tracks 22 key points of the hand, in addition to collisions, to interact with objects in a natural way. Globally, the mass adoption of high performance devices is normalizing the expectation of hand tracking and gesture recognition as the way to interact with digital content. Specific to augmented and virtual reality, Clay AIR offers ClayReality as a bespoke solution for hand tracking and gesture recognition.