Tango first started life as a project within ATAP, Google’s Advanced Technologies and Projects division. The idea was to integrate an array of sensors and cameras into a mobile device so that it could figure out its position relative to its surroundings. We’ve already seen how Tango’s 3D-mapping can be used to give directions in a museum, assist in home improvement projects and create cartoon worlds, but there are a few new ones that caught my eye.
One of them is Crayola Color Blaster, which is described as a “zombie color-blasting game.” Created by Legacy Games, the object here is to deal with incoming zombies by pelting them with paint. The zombies appear in an augmented reality view on the display, so it looks as if they’re there in your actual living room. It’s a very active game, and I found myself wandering around from one area of the room to the other just to get enough distance between me and the color-hungry undead. Unlike Pokemon Go, this felt like a real augmented reality game.
Arielle Lehrer, CEO of Legacy Games, said that the game was originally conceived as just a coloring book in real space until they figured out there was so much more you could do with the technology. “We started to think about the magic window idea of Tango,” said Andrew Duncan, the game’s lead designer. “Anywhere you look, you change the environment. It really plays in any space.”
Next, I played with Sockethead Games’ Slingshot Island, which is pretty much as the name describes. Again utilizing augmented reality, you place a virtual island in your physical space, be it your dining table or your kitchen floor. From there, you’ll use a slingshot to shoot projectiles at it in order to solve puzzles, like knocking an egg off a structure. The interesting thing here is that your entire phone is the motion controller. That means as soon as you aim your target, you actually move the phone around to establish the shot — as if your entire phone is the slingshot itself.
I also demoed a couple of titles that didn’t use augmented reality. One was Hot Wheels Track Builder, where I could race toy cars down tracks of my own creation. I picked pieces up and dropped them in place by moving the phone. It’s once again using the idea of the phone as the controller. Another was Ghostly Mansion, where I collected clues in a virtual room by walking around a physical space. I could lean down to open a drawer or lift the phone up to grab a picture on the wall.
Of course, Tango has other uses besides gaming. You can use an app called Measure to measure anything in your home, which is useful for home decorating. Apps like Wayfair View or iStaging are great for visualizing the placement of your furniture. There are educational applications too, like Solar Simulator for exploring the planets in the solar system.
A few years after its debut, Tango graduated to become its own project division in 2015. Now, it’s a part of Daydream, Google’s VR initiative. It doesn’t take much imagination to think of how useful depth-sensing and 3D-mapping would be in virtual reality. Indeed, the combination of the two could lead to perhaps a standalone headset in the future.
“A lot of the work we’re doing will enable inside out tracking in VR,” said Johnny Lee, Tango’s Director of Engineering. “There’s no product that we can talk about. But as Tango matures, as Daydream matures, there’s an obvious crossroads that we’re excited about.”
But before integrating that tech into VR, Google thought it was important to incorporate Tango into phones first.
“There are still a lot of phones being manufactured today,” said Lee. “We feel like this form factor is one that we’ll have with us for quite awhile.” One of the reasons Randall Eike, the CTO of Sockethead Games, was drawn to Tango is because he felt that smartphones are a lot more accessible than VR headsets. “A VR headset isn’t something you whip out of your pocket at a Starbucks,” he said, whereas everyone has a smartphone. “There’s a chance [Tango] will be more ubiquitous than VR.”
Lee shares the same sentiment. He thinks of Tango in the same way as GPS; we were able to get through our lives before it came along, but now we can’t imagine our phones without it. The spatial reasoning and depth sensing allowed by Tango, he said, will be just as important. “I believe there is a whole new suite of experiences that are possible. The way we interact with our computers will change.” Plus, he said, the rise of Pokemon Go shows that the public is a lot more accepting of augmented reality apps than it used to be, which is good news for Tango.
Google is so bullish on Tango that it’s already built up a pipeline of partners. In other words, look forward to more Tango-enabled phones next year. According to the company, they’ll come in varying price points, designs and form factors. So if you’re wary of the giant 6.4-inch screen on the Phab2 Pro, maybe wait a few months for a smaller Tango phone.
“This is not just a research product. It’s a product in the market today,” said Nikhil Chandhok, Tango’s product director. “Should every phone have GPS? Yes. Should every phone have a camera? Yes. Should every phone have inside-out tracking? Yes,” Chandhok continued. “Every phone should have it.”