Precise overlay registration within Augmented Reality – A glimpse into the technology

iarm_reentry_frame_18_d

If we caught your attention with our last post but you’re having a difficult time understanding what’s so exciting about a little research and some images narrating a potential future rest assured we have a lot to talk about.

The first thing we need to address is one of the “Hows” of the visualization technology. Even though we have several patents pending, we are still too sensitive to expose the ‘whole tomato’ to the masses, but suffice it to say we have cracked the Augmented Reality visual registration nut. The following is our first delving into the details that are under development.

What is this nut? Let me explain…

If you’ve ever used the current lineup of “AR Apps” available on Android or iPhone platform you’ve seen a neat portal into the world of Augmented Reality. You typically see a camera view of the world around you presented on a hardware screen with digital information presented (most often clumsily) on top of the view. As you move the phone around you see that information move accordingly as if it’s locked to some physical location. Sometimes you see that information move or ‘drift’ for unknown reasons and that is really the problem with current tech AR.

Registration is the accuracy by which the computing platform can “lock” the digital world onto the physical world and up to today, that technology has been susceptible to all sorts of errors and interference. One of the reasons registration is still immature is because developers are relying on hardware improvements to solve their problems. We believe that while hardware, especially heavily funded hardware (thank you Apple), may eventually get accurate enough to solve the registration problem we don’t have the time or patience to wait. We instead spent our time researching and testing an elegant and simple solution that would work with today’s hardware capabilities.

If you look at the narrative slides below you can see our User Experience Model relies heavily on pixel-accurate digital registration. We can “paint” anything including highlighting objects, manually marking the environment and even embedded three-dimensional models. I can assure you these aren’t the crazy vision of a designer with no insight as to how the technology works but are based on our registration system (U.S. Patent Pending).

Our system is primarily vision-based, but leverages gross measurements (with error detection) of GPS, Cell/WIFI triangulation, and digital compass hardware. That means that it uses cameras, models, and some other fancy wizardry to rapidly identify the observed view and paint objects within that domain accordingly.

That’s all for now but we’ll be presenting some more details on the system at ARE2010 and are excited to continue this discussion.


Posted by on May 24, 2010

19 Comments on Precise overlay registration within Augmented Reality – A glimpse into the technology

By Military Grade Augmented Reality Could Redefine Modern Warfare | Technology and Web 2.0 on June 11, 2010 at 11:40 am

[...] Illustrations from Juhnke’s presentation tell the company’s story of how their technology could give American troops the upper-hand in hostile situations. First of all, the company is developing a system of lightweight sensors and displays that collect and provide data from and to each individual soldier in the field. This includes a computer, a 360-degree camera, UV and infrared sensors, stereoscopic cameras and OLED translucent display goggles. [...]

By TekJoos - TekJoos on June 11, 2010 at 11:55 am

[...] Illustrations from Juhnke’s presentation tell the company’s story of how their technology could give American troops the upper-hand in hostile situations. First of all, the company is developing a system of lightweight sensors and displays that collect and provide data from and to each individual soldier in the field. This includes a computer, a 360-degree camera, UV and infrared sensors, stereoscopic cameras and OLED translucent display goggles. [...]

By Bob Barr on June 11, 2010 at 2:16 pm

I am a fire protection engineer with the Phoenix, AZ Fire Department. I’m sure that there is a place for AR in the fire service related to command of incidents. Would be interested in your thoughts. Contact me if you would like more information about fire departments.
Thanks
602-261-8271

By Military-Grade Augmented Reality Could Redefine Modern Warfare | War On You: Breaking Alternative News on June 13, 2010 at 4:13 pm

[...] Illustrations from Juhnke’s presentation tell the company’s story of how its technology could give American troops the upper-hand in hostile situations. First of all, the company is developing a system of lightweight sensors and displays that collect and provide data from and to each individual soldier in the field. This includes a computer, a 360-degree camera, UV and infrared sensors, stereoscopic cameras and OLED translucent display goggles. [...]

By The Truth Or The Fight » Blog Archive » Military-Grade Augmented Reality Could Redefine Modern Warfare on June 13, 2010 at 4:27 pm

[...] Illustrations from Juhnke’s presentation tell the company’s story of how its technology could give American troops the upper-hand in hostile situations. First of all, the company is developing a system of lightweight sensors and displays that collect and provide data from and to each individual soldier in the field. This includes a computer, a 360-degree camera, UV and infrared sensors, stereoscopic cameras and OLED translucent display goggles. [...]

By The Goggles That Will Transform Soldiers Into Terminators | Gizmodo Australia on June 14, 2010 at 8:02 pm

[...] their talent, rather than equip gangmembers with all the tools needed to rob the nearest 7-Eleven. [Tanagram via ReadWriteWeb] Tagged:augmented realitygadgetsgoggleshelmetsmilitarysoldierstanagram [...]

By Gafas estilo Terminator harán que los soldados digan: ¡Checkpoint! | Ultimos Avances on June 15, 2010 at 3:24 am

[...] Una pena que el mayor impulso tecnológico se de en asuntos relacionados con la guerra (o la “seguridad”), pero así es. Esperemos que sean pocos los que caigan sea donde sea, y que en sus gafas de realidad aumentada no les pongan “Game Over”. No podrían cargar partida. —Javier G. Pereda [Tanagram] [...]

By Helmet-mounted Augmented Reality info system makes soldiers more lethal | Gadgets Now on June 15, 2010 at 7:06 am

[...] been enroute so passionately yet. To make sure military has the best from the future of technology, Tanagram Partners is developing military-grade Augmented Reality gear based on lightweight sensors and [...]

By Military-Grade Augmented Reality Could Redefine Modern Warfare – NYTimes.com « Ambient Eyes on June 15, 2010 at 10:03 am

[...] enable entirely new forms of command and deployment tactics.  A further link the the NYT article, here, has some benign illustrations of what AR systems might be capable [...]

By Kim Badley on June 15, 2010 at 12:00 pm

I have been thinking of a similar system for computer monitors, gadget interfaces, and 3D viewing. My system uses cameras to pick up hand movements and a 3D vision system to provide objects to air touch to control the gadgets, instead of touch screens, mice, or keyboards.
The system could be placed in a pair of sunglasses. Eventually, the entire system could be all in the sunglasses.

By Joseph Juhnke on June 15, 2010 at 12:13 pm

That’s awesome Kim! Our hardware requires some special pieces, but you are among other brilliant minds including these fine folks. http://www.vuzix.com/iwear/products_wrap920ar.html

By Joseph Juhnke on June 15, 2010 at 12:14 pm

Bob, I know the team has reached out to you. We’d love to talk!

By Kristopher Yardley Leslie on June 15, 2010 at 2:39 pm

I give you a handclap for stepping on the wave of the future but are you aware that the tech you using is already registered trademarks in video games and movies?

Honestly anyone can hash up a system after viewing a movie or playing video games and reverse engineer it.

Honestly what are you going to bring to the table that is groundbreakig and actually original?

By Kristopher Yardley Leslie on June 15, 2010 at 2:44 pm

Last but not to sound like a flamer, what are your plans when you end up having other companies do the exact same thing? It seems to me better to keep your military side private and open source a framework to the public to build on.

And I’m one of those “designers” who actually thought up and conceptualized ideas and drawings similar to this. I hope your tech is good but again, when anyone can do what your doing what sill seperate what your product can do from a iClone.

By Helmet-mounted Augmented Reality info system makes soldiers more lethal - fujiang.info on June 15, 2010 at 4:01 pm

[...] yet. To attain trusty expeditionary has the prizewinning from the forthcoming of technology, Tanagram Partners is nonindustrial military-grade Augmented Reality equipment supported on lightweight [...]

By Military-Grade Augmented Reality Could Redefine Modern Warfare  | Vodule on June 16, 2010 at 12:52 am

[...] Illustrations from Juhnke’s presentation tell the company’s story of how its technology could give American troops the upper-hand in hostile situations. First of all, the company is developing a system of lightweight sensors and displays that collect and provide data from and to each individual soldier in the field. This includes a computer, a 360-degree camera, UV and infrared sensors, stereoscopic cameras and OLED translucent display goggles. [...]

By Gafas estilo Terminator harán que los soldados digan: ¡Checkpoint! | TengoFriki on June 16, 2010 at 2:14 pm

[...] Una pena que el mayor impulso tecnológico se de en asuntos relacionados con la guerra (o la “seguridad”), pero así es. Esperemos que sean pocos los que caigan sea donde sea, y que en sus gafas de realidad aumentada no les pongan “Game Over”. No podrían cargar partida. —Javier G. Pereda [Tanagram] [...]

By Goggles Transform Soldiers Into “Terminators” « Ex Submarine Spy on June 20, 2010 at 1:59 pm

[...] their talent, rather than equip gangmembers with all the tools needed to rob the nearest 7-Eleven. [Tanagram via ReadWriteWeb] via [...]

By Precise Overlay Registration Within Augmented Reality « Soldier Systems on July 4, 2010 at 6:42 am

[...] out Tanagram’s blog for more [...]

Write a Comment on Precise overlay registration within Augmented Reality – A glimpse into the technology

Comments on Precise overlay registration within Augmented Reality – A glimpse into the technology are now closed.

More

Read more posts by

About the Author

Joseph Juhnke - President and CEO of Tanagram, Inc.