Innovate UK - Feasibility studies for AI solutions: AI 3D Animation generation through VR Headsets & Inertial devices

In the dynamic world of 3D animation, the pursuit of realism and efficiency is an unending odyssey. Crafting lifelike 3D animations traditionally involves a meticulous and time-consuming process, with animators painstakingly keyframing every movement. Our groundbreaking research project, "AI 3D Animation generation through Virtual Reality Headsets and inertial devices" is poised to redefine this landscape by harnessing the transformative power of Artificial Intelligence (AI). At its core, this project seeks to leverage AI algorithms to predict entire body motions based on minimal inertial inputs. Inertial sensors, embedded in wearable devices like accelerometers and gyroscopes, capture motion data, offering a wealth of information about human movement. This technology is increasingly prevalent, found in applications ranging from virtual reality headsets to smartphones. Our solution aims to generate full-body motions that seamlessly align with a handful of inertial inputs, envisioning a scenario where wearing a VR headset with two hand controllers translates into a realistically animated full-body motion through AI. The implications of our project for the animation and 3D content industry are revolutionary. Primarily, it drastically reduces the time and effort required for animation creation. Instead of laboriously animating each frame, our AI system can generate animations in a fraction of the time, leading to substantial cost savings and allowing animators to channel their energies into more creative aspects of their projects. Distinguishing itself from overseas counterparts that focus solely on real-time motion prediction, our project integrates post-processing capabilities. While real-time prediction is invaluable, the addition of post-processing introduces a layer of refinement and polish to the animations, making our approach particularly appealing to industries where high-quality, lifelike animations are imperative. A notable feature of our system lies in its compatibility and flexibility. While other solutions may cater to specific hardware, such as the Quest VR headset, our approach is device-agnostic. Our AI-driven motion generation system is designed to embrace inputs from various sensor brands, unlocking possibilities across diverse platforms and applications. Furthermore, our AI-driven motion generation enhances the realism of animations by using real-world motion data as a foundation. This authenticity is particularly valuable in fields like gaming, virtual reality, and augmented reality, where immersive and believable animations are paramount. Beyond entertainment, the system finds applications in healthcare and sports, offering insights into human movement for enhanced physical therapy and sports performance analysis. The potential extends to robotics, where our motion prediction can integrate into robotic systems, making them more responsive and adaptable.