Johnny Lee, a project leader in the Advanced Technology and Projects group at Google, proposed a transformative effect, opening the border crossing for a generation of projects using 3D depth data.
Their current prototype is a 5” phone containing customized hardware and software designed to track the full 3D motion of the device, while simultaneously creating a map of the environment. These sensors allow the phone to make over a quarter million 3D measurements every second, updating its position and orientation in real-time, combining that data into a single 3D model of the space around you.
It runs Android and includes development APIs to provide position, orientation, and depth data to standard Android applications written in Java, C/C++, as well as the Unity Game Engine. These early prototypes, algorithms, and APIs are still in active development. So, these experimental devices are intended only for the adventurous and are not a final shipping product.
The goal of Project Tango is to give mobile devices a human-scale understanding of space and motion.
Over the past year, their team has been working with universities, research labs, and industrial partners spanning nine countries around the world to harvest research from the last decade of work in robotics and computer vision, concentrating that technology into a unique mobile phone.