Future

The future of firefighting – A HMD-AR user interface concept for first responders

Headmounted display (HMD) Augmented Reality (AR) technology is only a few short years away (trust us, we know…) and the Department of Homeland Security is actively exploring methods to help our firefighters benefit from information displays to help them stay alive and help others in the deadly environment that is a building fire.

Tanagram, under a grant provided by the Department of Homeland Security (DHS), developed a phase-zero self-contained breathing apparatus (SCBA) enhancement that leverages HMD / AR technology to display critical factors all-the-while not obscuring the firefighter’s field of view. Dubbed Helmet with Embedded Active Display for Emergency Responders or HEADER, our concept vision was researched with participation from the Champaign, IL Fire Department. (We even sent a few people to firefighter training!) In our literature review, we found little research has been done with regards to embedded, mixed media (augmented reality) display technology that focuses on unobtrusiveness and consumer acceptance (our fancy word for user friendly). Because of this we are sharing our work with you in hopes that it sparks a conversation that will be very relevant, very soon.

How do we design for an embedded environment?

What is the interaction vocabulary when there is no screen or mice?

What disciplines become relevant in this new medium? Interior design? Architecture? Industrial Design?

This is a first concept. Much work is being done to refine this interface so that it is even more user friendly, relevant, and safe. Please add your feedback below (click here for comments). This is a discussion we hope to promote and grow for the benefit of everyone.

Next week, we’re going to post details on the hardware prototype we developed using Ardiuno gear. Stay tuned!!

Special thanks to http://www.madtownmedia.com/ for their work producing this video.


Who is Tanagram and why you should care…

On July 2nd last year Tanagram turned 18 years old. It was a time to reflect and celebrate our “childhood” and look to a future of unlimited possibilities.

One of our many ruminations were on the topic of our brand and our legacy as an interactive design firm. While we’ve been recognized as the first at many great things, we couldn’t help but wonder how we remained relatively invisible in the marketplace today. As a result of our pondering we have realized that the presentation of our brand, as intentional as it is, is too complex. We are too complex. Don’t worry, we’re not going to become less complex, we’re not even sure we could do that if we tried. Instead we are spending some time to help all of you understand what makes Tanagram unique in the interactive development space and there is no better way to get started than to shout it out. So here goes:

———————

Tanagram is unique in that we design and build software for the digital frontier. Thirty percent of our project portfolio is made up of government funded “advanced” research. We do this specifically so that we can apply our learning to our commercial client projects and our ability to make ideas real to our government projects. We focus on three specific areas:

  1. Complex workflow applications (e.g. a hyper-local enterprise media management tool for Geomentum.com)
  2. Innovative web sites that change the way the Internet is used (e.g. http://www.skybeautiful.com and http://universityofchicagopress.com)
  3. Mobile applications that bring data to users in contextually relevant ways (like our Augmented Reality Platform).

———————

Here are links that might better illustrate Tanagram’s niche in the interactive design marketplace:

Complex Application:

Innovative Web:

Mobile / Augmented Reality:

In addition we’ve really turned on the PR machine. Above you’ve seen links from the New York Times, Gizmodo, and ABC featuring our work. Here are a couple of other great stories that you might not have seen:

If we haven’t lost you yet, here’s a Google Blog Search with the infinite number of posts about us.  YAY VANITY SEARCH! :-)


ARE2010 – The conference at the edge of a paradigm shift – An informal review #are2010

are-welcome

If you follow us on Twitter, you probably know many of our team spent last week at the ARE (Augmented Reality Event) 2010 conference. It was graciously put together by the exciting team at Ogmento and sponsored by some really great big and small names in the tech industry. Tanagram presented our work on our iARM platform and I hope to be able to share the video of that presentation as soon as the ARE2010 folks get it processed and released. 

ARE2010 did a lot of things for Tanagram. First and foremost it taught us that we aren’t the only crazy people out there. There were many hundred equally passionate (and equally insane) individuals working diligently to realize a vision that has been foretold for many many years. Attending were 400 enthusiasts, 90 speakers, and 40 sponsors. 

The conference also re-affirmed that Augmented Reality (AR) is a new frontier. The discussions were widely diverse from immediate implementations of marketing gimmicks to future visions of integrated experiences and super-powered humans. Keynote speakers, Bruce Sterling, Will Wright, and Blaise Agüera y Arcas, and Jesse Schell were all brilliant. They taught us to be humble, focused, human-centered, and reminded us that this isn’t the first new frontier and to remember (and reuse) the past. Jesse Schell presented a humorous and sobering view of privacy and what AR could mean for it (his point was it was already too late…). 

I personally had an opportunity to meet and discuss ideas with some of my all-time hero’s including Bruce Sterling and Blaise Agüera y Arcas. 

On the technology front I can share that there is a definite future for head mounted display technology. We saw proposals for 150deg. FOV systems. It’s going to be a very exciting decade!

As soon as the ARE folks post the videos I encourage you to browse the sessions. I didn’t attend one that was not fascinating. The ARE event will be held next year in Santa Clara and we will definitely be there. 

P.S. Through this experience I was introduced to Bruce Sterling’s Wired Blog – Beyond the Beyond. Bruce admits it is eclectic as hell and is really anything that interests him. He saw that as a weakness, but I see it as a strength. I really look forward to the “random” posts. They are always head-stretching. I also encourage you to review the twitter feed for the conference. Great stuff in there!


Precise overlay registration within Augmented Reality – A glimpse into the technology

iarm_reentry_frame_18_d

If we caught your attention with our last post but you’re having a difficult time understanding what’s so exciting about a little research and some images narrating a potential future rest assured we have a lot to talk about.

The first thing we need to address is one of the “Hows” of the visualization technology. Even though we have several patents pending, we are still too sensitive to expose the ‘whole tomato’ to the masses, but suffice it to say we have cracked the Augmented Reality visual registration nut. The following is our first delving into the details that are under development.

What is this nut? Let me explain…

If you’ve ever used the current lineup of “AR Apps” available on Android or iPhone platform you’ve seen a neat portal into the world of Augmented Reality. You typically see a camera view of the world around you presented on a hardware screen with digital information presented (most often clumsily) on top of the view. As you move the phone around you see that information move accordingly as if it’s locked to some physical location. Sometimes you see that information move or ‘drift’ for unknown reasons and that is really the problem with current tech AR.

Registration is the accuracy by which the computing platform can “lock” the digital world onto the physical world and up to today, that technology has been susceptible to all sorts of errors and interference. One of the reasons registration is still immature is because developers are relying on hardware improvements to solve their problems. We believe that while hardware, especially heavily funded hardware (thank you Apple), may eventually get accurate enough to solve the registration problem we don’t have the time or patience to wait. We instead spent our time researching and testing an elegant and simple solution that would work with today’s hardware capabilities.

If you look at the narrative slides below you can see our User Experience Model relies heavily on pixel-accurate digital registration. We can “paint” anything including highlighting objects, manually marking the environment and even embedded three-dimensional models. I can assure you these aren’t the crazy vision of a designer with no insight as to how the technology works but are based on our registration system (U.S. Patent Pending).

Our system is primarily vision-based, but leverages gross measurements (with error detection) of GPS, Cell/WIFI triangulation, and digital compass hardware. That means that it uses cameras, models, and some other fancy wizardry to rapidly identify the observed view and paint objects within that domain accordingly.

That’s all for now but we’ll be presenting some more details on the system at ARE2010 and are excited to continue this discussion.


Introducing iARM (Intelligent Augmented Reality Model). Military grade, consumer ready…

iarm_reentry_frame_02_d

About a year ago, Tanagram was granted its first direct (meaning we weren’t a sub-contractor) DARPA research funded program. Our goal was to improve situational awareness for soldiers deployed in contested (dangerous) cultures. During this program we proposed creating a complete server / client based architecture that responded to the program needs by providing digital augmentation of the surrounding environment. Tons of research, some prototype concepts, and a few patents later we are now cleared to share it with you.

We’ll talk more about the technology stack and client platform(s) in future posts, but for now you may read our final report.

Find it here. 

Take special note of the appendix with the storyboard illustrating the concepts defined. It is much easier to consume than the other thirty-ish pages.

Oh… did I mention we are building it now? Yup… It’ll be a few years before it’s available at Walmart, but we’re on it.


Happy Birthday Alteryx!

March 24, 2010 - Extend 2010 - Alteryx Introduced!

March 24, 2010 - Extend 2010 - Alteryx Introduced!

Tanagram is proud to introduce the world to Alteryx. Formerly SRC (extendthereach.com), Alteryx could be the future of Business Intelligence.

So what do you do with Alteryx? Anything! In English, one would say that their tools can consume any type of data (including geospatial of course) and merge it, filter it, process it, “spatial-ize” it, reprocess it, and finally output it to anything you can imagine including “the cloud.” Industry leaders are using Alteryx to determine where their best customers are and how to reach them in ways that are appreciated. These leaders represent just about any vertical you can imagine and they all understand that the insights derived using Alteryx Connect (for example) are critical for their competitive survival. Big companies like Geomentum use Alteryx to save big companies like Walgreens $30MM in one media placement project. Deloitte, Clarks, and Jones Lang LaSalle are among the many companies that use Alteryx to manage their data crunching desires.

If we’ve peaked your interest (we really did try to not use buzzwords) you can sample Alteryx for Free by downloading their application from their website (links at bottom of page) and you can see a live example of Alteryx Connect at DemographicsNow.com (you have to see this stuff!!!).

What does Tanagram have to do with Alteryx? Tanagram, in partnership with Meta Design, and Clarity Partners renamed, rebranded, and launched the new Alteryx.com website (using Microsoft SharePoint). In a very short period of time, we worked with the brilliant folks at Alteryx to develop an international brand (already represented in 50+ countries) and many new channels for Alteryx to connect with their customers. Rumor has it more is on the way, but that’s pure speculation. ;-) 

Congrats again to the entire project team. We really enjoy working with you!

Some screenshots (cue happy music!)

Alteryx.com Homepage

Alteryx.com Homepage

Video Case Studies

Video Case Studies


Hello Rockstar! – Tanagram seeking Experienced UX Designer

Once again, Tanagram is growing. We are looking for a curious individual with a passion for the future of interaction and deep experience working with HTML, AS3, and XAML. Our newest member must also rock. This isn’t a confidence thing for you or us, we aren’t prima donna designers and don’t work well with individuals who can’t collaborate intensively. Rock to us means to be REALLY REALLY good at what you do. It means you understand the implications of aesthetics and beauty on complex functional design. It means you understand and are relevant with the “fashion” of design. It means you wake up in the morning thinking about visual and systemic gorgeousness and strive to create it. You must have a great portfolio that is relevant and shows you are actively pursuing the issues we are passionate about.

Here at Tanagram we actively look for ways to escape the world of WIMP interaction and I’m proud to say we are very very close to realizing it. We design complex interactive experiences, systems that make most designers cringe. Systems that allow users to touch and manipulate data with hands not abstractions. We abhor refresh-encumbered interaction and enjoy individuals who understand that there is a better place.

While we can’t share project specifics, our current assignments include redefining geospatial hyperlocal media planning as a SaaS product*, inventing the the future of Augmented Reality interaction (no it’s not a silly iPhone app, think heads-up display technology and daily wear), and creating / refining online communities that are meaningful and truly help people. Our clients work with us to help them create the future and we are steadfast that our future is a better one.

In our process the UX designer’s role begins at project inception. She participates in client discussions gathering information and providing references to current and leading edge design approaches (visual, haptic, etc) that may benefit the client’s requirements. She references new trends, hot topics, and examples used by like and non-like competitors. Once requirements are gathered, she works with the project team as an artist, innovator, and strategist representing concepts and prototypes that are desired by her target audiences. Design aesthetics are always as important as simplicity and relevance. Our newest member must be a communicator, actively seeking and spreading inspiration. She is constantly challenging herself and the status quo.

Experience working with Industrial Design is a plus.

If you feel like she could be you and have 10+ years of experience please send your resume and portfolio to careers@tanagram.com and we can start the discussion.

We look forward to meeting you.

* apologies for the buzzword attack.


Living with Digital: This can go one of two ways…

It seems every other discussion I enter as of late has something to do with privacy and or the things “they” know about us. Maybe it’s the paranoid circles I travel, or maybe we are seeing the beginning of a significant change in our human paradigm. Digital technology is maturing and enabling us to connect/interact/react in ways we never before imagined. Human nature drives us to interact (you remember that “No man is an island” junk from High School?) and Digital technology is superpowering our ability.

Remember life before Facebook? How many old friends have you lost touch with? How many viable relationships could you maintain before Facebook? How many can you maintain now? (I have 181)

It’s a little overwhelming to think that we are actively crafting a Digital overlay that will enable Digitally enabled beings to interact with other Digitally enabled beings or objects across space (think telekinesis), time (think time-based stitched panoramas made from FLICKR images chronologically navigated), and wordless communication (telepathy?). Imagine being able to see and hear and interact with objects from amazing distances. Imagine wearing a digital outfit. Imagine.

As Augmented Reality, the superimposition of the Datasphere onto reality, becomes more viable we will gain access to vast amounts of real-time data and there are a few issues we need face very soon.

Privacy – The ‘Millenials‘ have already succombed to the collective and have given away the illusion of privacy. Social media products like Facebook, MySpace, and Twitter have become platforms for their near-narcisistic need to self-proclaim. They communicate outwardly, freely and without fear. The rest of us, especially those who remember the 60′s are going to face challenging times over the next 10 years. Data availability and detail will continue to improve and we will all be faced with a choice: Does data serve or punish me?

What does it mean that marketers know where I live and what products I’m inclined to buy? Is my cellphone constantly broadcasting my location accurate to the meter? Am I being monitored for selfish reasons? Ok, you can sit down and stop shaking…. It’s not as bad as you think. We at Tanagram firmly believe Digital will serve us in powerful and meaningful ways and we spend a great deal of time imagining what those might be.

The truth – You ARE being watched. There, I said it, and nothing exploded. The fact is the Marketing Industry is facing one of the most challenging times since its inception. Gone are the days when they could ‘tell people what to believe.’ Gone are the days where they could produce a single, one-size-fits-all message that compells consumers to purchase products. Digital has made us (consumers) much smarter and because of this, we require much more sophisticated communication and interaction to even begin to consider a product relationship (that’s what it is when you become loyal to a brand). We the consumer have become extremely powerful and marketers are afraid.

So what evil things can they do with their monitoring? Well, that’s where we take an unexpected turn. You see, the only way they can sell is with the truth. They can no longer pay talking heads tell us what to think, lies are posted on Twitter for thousands to view seconds after they are broadcast. The backlash from a malformed or misguiding ad-campaign can cost millions in revenue but even worse it can cast the originator as not reputable and have significant long term effects. Everybody remembers Blackwater, right? Their brand was so destroyed by blunder and lies they had to rename as Xe. So if they can’t lie to us, how can they push their products? They have to connect with us like real people, meaningfully. To do that they grab gobs of data and look for consumers who would actually benefit from and are interested in the products they sell. They then do their best to be helpful and useful so you, the consumer, will learn they are trustworthy and legitimate. They spend fortunes on non-profits and other ‘Cause Marketing’ to be viewed as contributing members of society.  Ultimately, they work very hard to maintain a real relationship with you. You see how mild mannered this once arrogant monster has become? Joking aside, they cannot take your free will. You will continue to be a fickle and informed consumer and they cannot afford for you to think that they have any intentions other than serving you the best they can. Also, there is no mind-control chip. They cannot hypnotise you into stupid purchase habits (for me this is a non-issue, I only buy stupidly) and if they could, they wouldn’t because the consumer backlash would destroy them.

So what do we do with these needy, shivering, whelp marketers? We give them our data. Why, because they will serve us better if they know our likes and dislikes. They can’t afford to annoy us anymore and they don’t want to waste money trying to sell to those who are disinclined. Broadcast advertising is going away.  Advertising of the future will take place at a personal level in meaningful ways. Here’s an example: Perhaps you are driving home, late from work and you haven’t prepared the family meal. Your local preferred local grocer sends you a text message offering a discount on cooked chicken dinners (or your favorite dish) and saves the day.

That is where we are going, we just have to make the choice.


Joseph Juhnke caught on the Red Couch

I may have had a drink or two or perhaps the interviewer was particularly charming. Either way I opened up for the folks at Level 3 and shared our dreams and visions for where Digital is going to take us in the coming years. I wish you could have seen the interviewer’s face. These were not answers he was prepared to address. Tell me the truth… Do I sound like a nut? Check out the other interviewees here. Great thinking and commentary from all.


2.75 Mile High Thoughts

 

Last week I attended a conference at the University of the Andes in Merida, Venezuela. The International Congress of Aesthetics (Simposio Internacional de Estetica – Arte, Ciencia es Technologia) brought together philosophers, writers, scientists and others together to discuss the role of written text, ideas and their ability to create aesthetic experiences through semiotic analysis.

Professor Edgar Yanez Zapata invited Aleksandra Giza, a professor of design from Northern Illinois University and myself to give several lectures to faculty and students of the School of Art and Design as well as present at the international congress.

Merida is a town nestled at the beginning of the Andean mountain range and runs along a ridge that is overseen by Pico Bolivar, over two miles above the city. For over 450 years the town evolved into a small city of about 20 square kilometers. The University of the Andes is the main function of the town and its impact is felt at all levels of life and activity.

 

There were four presentations given:

1) Introduction to Design Methods focusing on a contemporary perspective of design methods building on the original discussions in the early 1960’s and the publication of John Chris Jones seminal 1970 book “Design Methods.” Misunderstood and often maligned as a concept, design methods began as a way to question purely scientific post-war advancements and proposed a more integrated, multi-disciplinary perspective to integrate logic and intuition into a stronger approach to identify and solve problems. The presentation will focus on what design methods means in 2008, and how to structure and apply concepts to both problem solving and problem seeking.

2) Managing Ambiguities : The Role of Decision Modeling and Visualization focused on the development of diagrams and maps that described statistical and geographical relationships and the advancements of cognitive theories of how humans make decisions. The premise of the presentation focused on how the visualization of data through different content lenses can provide humans the needed cognitive and workload assist to provide options when faced with making decisions.

3) Urban Design Assistance Teams : A Different Approach
A Regional Urban Design Assistance Team (R-UDAT) is learning by doing, a type of accelerated practicum/charette to help towns and municipalities in distress. Teams interact with a variety of local stakeholders as well as to regional legislators in hopes of securing resources to implement UDAT recommendations. Randallstown, Maryland, a town of 30,000 residents in northeast Baltimore County was the backdrop where landscape architects, design architects and architects with experience in public policy, a traffic engineer, and a graphic designer mobilized to help Randallstown seek its potential.

4) Chicago : Innovation of the Past, Present and Future focused on the history of Chicago and innovations in architecture and engineering such as the modern development of the steel i-beam skyscraper and the load bearing cassion foundation which transformed a marshy prairie into one of the 25 largest cities in the world. The presentation highlighted the Village of Oak Park, 14 kilometers west of Chicago and home to Frank Lloyd Wright’s early architectural career as well as on key Chicago architectural icons that are not usually highlighted with a short discussion on the city’s bid for the 2016 Summer Olympics.

 

The presentation for the congress was attended by about 150 people as there were concurrent presentation sessions. Most of the attendees were focused on written language that describes the world and can generate aesthetic experiences using Sassurian frameworks and models. My presentations focused on Percian semiotics which extended linguistic semiotics into any form of thinking (metacognition, visual and written).

The second presentation to the congress was part of a panel that Edgar Yanez Zapata put together that addressed the role of digital technologies in aesthetic thought. From my observations, most conference participants would read short papers to the audience. A few had electronic presentations that endeavored to share richer stories. 

The last night of the conference there was a small dinner at a wonderful bar called Mogambo (Chama Hotel). We had the opportunity to sit next to three philosophers from the University of Venezuela at Caracas. As you may surmise we ended discussing issues of reality, meaning and how subjective or objective reality is (or is not). Over beer and wine (a necessary ingredient) we did not come to any firm conclusions, but it did raise some interesting ideas.

Over the weekend, Aleksandra and I were invited to an evening with faculty from the Art and Design department at the house of Argentinian architect Carlos Caminos and his wife Donna. Their home is nestled on the side of a hill designed by Simon, a Rhode Island School of Design graduate. The simple home is beautifully appointed with artwork, functional objects and the history of this interesting collaborative couple.

We talked late into the evening about design, culture and other topics as Aleksandra and I moved around the house. I would like to thank Leo Chacon, John Villarroel, Carmen Grisolia, Eduardo Araujo, and Julie Colasante for making time out of their hectic schedules to share cultural ideas.  We also had a wonderful dinner with Nory Pereira Colls, Dean of the Art and Design school at ULA. 

I would like to thank Edgar Yanez Zapata, Director of the School of Art and Design for suggesting the visit, coordinating all activities and making Alexandra and I feel at home in Venezuela.