Pixelsumo is a blog about interaction, with an emphasis on play, installation, video game culture, playgrounds and toys. Written by Chris O'Shea.
Follow...
RSS Feed
Vimeo Channel
Posted January 13th 2010 under Augmented Reality, Games
I’ve never really written very much about augmented reality on Pixelsumo, just an alternative reality. The other week I was talking at an Augmented Planet event, where various demos were shown & discussed.
I am slightly cynical towards AR because many things I have seen don’t work, so I decided to post some projects that I actually do like.
For me, bad uses of augmented reality are where it is used just as a gimmick. Showing a 3D model on a marker? I mean common, the ARToolKit was developed nearly 10 years ago! The experience has to be meaningful, with the technology being part of the context in which it is used, and enhance an experience, not making it harder. If you are aware of the technology as the main focus, then it hasn’t worked.
Watch this parody video…
![]()
Or how bad is this? :)
![]()
A lot of marker based stuff doesn’t work, due to lighting conditions, obscuring the marker or just being too slow. The problem is that we get used to these flaws as part of the experience of using AR, so we just accept them.
To be honest, I’m not keen on the concepts of augmented magazines, corporate brochures, band videos & business cards. What happens when the novelty of AR wears off?
So what do I like?
Le monde des montagnes
Written about previously already. Lovely.
levelHead
![]()
levelHead by Julian Oliver is a great spatial memory game. Players use a plastic cube, each side covered in an AR marker, acting as a window into a virtual room, whilst tilting the cube to make the character walk. I like this because the display cube is used as a tangible link into the virtual world, and the markers themselves help act as visual helpers to remembering which rooms belong to the cube sides.
Augmented Reality Magic
![]()
Augmented illusions from the ‘virtual magician’ Marco Tempest, watch video. Whilst in contemporary magic you have no idea how a trick is done, here its easy to say ‘oh its done in the computer’. However there are traditional card tricks linked into some AR graphics here. The system recognises the cards (rather than needing AR markers), with the software for this magic being created by Zach Lieberman & Theo Watson. Pictures of the software in action here.
Also check out the Magic Projection (created by Zach for Marco).
EyePet
![]()
In EyePet, Sony have brought AR to the masses in a game, much more accessible than any other attempt at AR for homes before it. More of an advanced toy than fully fledged game, you control your virtual pet via the PSEye camera as the interface. As well as motion vectors from your hands movement, they have used ‘magic card’ as AR markers to let you interact with your pet (shown here). Most impressive is the technology to turn your drawings into 3d objects that the pet can ride & play with (shown above). Watch this video, and this one. I suspect when the new PS3 motion controller is released this spring will bring a host of improvements to EyePet.
Lego Digital Box
![]()
When you take a child to buy a box of Lego, the box doesn’t just show the pieces that are inside in a random pile, it shows that these pieces can (or should) be made into. Watch video. So its a very logical idea to let children see what their creations could look like when finished & also animate them. Why is it good? In store you get to instantly see how the Lego pieces animate, and the technology doesn’t rely on large ugly AR markers. Created by Metaio for Lego (via Notcot)
ARPool
![]()
“The RCVLab at Queen’s University demonstrates Deep Green, a pool playing robot, and ARPool, an augmented reality system for teaching the science of pool”. Watch video. Sure it works as a training aid, but also opens up ideas for creating new rules & games on a pool table. Although, this Obscura Digital product might be too distracting?
Total Immersion
![]()
French company Total Immersion are one of the leaders in this field for years. They have done too much to mention (3d face mapping, markerless space tracking, pattern recognition), but check out their videos here. Also check out the videos of team member Emmanuel here for tonnes of great behind the scenes & experiments.
AR on iphone
![]()
Yes there have been a few apps that overlay arrows pointing at tube stations, and demos of using the AR toolkit, but the marker-less space tracking is really going to be the key to success. Apple, please allow developers to use the camera in your sdk!
The Active Vision Group of the Oxford University Engineering Department created PTAM (Parallel Tracking and Mapping) by Georg Klein & David Murray, watch this awesome video (from 2007). Now supports multiple cameras & multiple maps (with source code), see PTAMM. As you can see from this video, they have PTAM running on iPhone.
I suspect that other companies, such as Total Immersion & Metaio have iPhone technology ready to go when Apple buck up their ideas. Why is this important? Well the popularity of the device could see interesting AR apps and games appearing that really push the boundaries of outdoor AR and pervasive gaming.
Augmented Reality Toys
![]()
For his final project of Interaction Design Master degree, Frantz Lasorne created a toy prototype, asking the question how we might play if wearing a head mounted AR viewer device (view videos). Read about the project here.
Comments
(January 13th 2010)
Nice roundup. I actually hadn’t seen a few of these before. Thanks for posting - Cheers!
(January 13th 2010)
This anime from 2007 also has a very interesting approach of how a future AR powered world could be like.
http://en.wikipedia.org/wiki/Dennou_Coil
http://halcyonrealms.com/animeartbooks/images/denno_roman.jpg
(January 14th 2010)
Nice wrap up :)
I think the reason marker-based things don’t generally “work” is that it’s not very engaging to interact with the world via the proxy of a screen. I think “levelHead” works because it substitutes the language of AR with that of a novel interface. That is, the markers are an input device rather than something to be augmented. “nextwall” takes the same approach. http://nextwall.net/content/projekt/taggedinmotion.php
I think for AR to feel right (and not just look cool in a demo video, which I’m worried could be the case with “Le monde des montagnes”) it has to work on the basis of re-projection or overlays on the physical world. Augmenting our vision rather than offering an alternative viewport. ARPool, the AR toys you show, and iPhone based AR like the PTAM work and Sekai Camera are all steps in that direction.
The “Dennou Coil” series looks really neat. I bet that technology will be released in five years, marketed by Apple as an iPhone replacement. iRayBan anyone? ;)
Also, there aren’t enough sonic AR projects! Noah Vawter’s “Ambient Addition” http://web.media.mit.edu/~nvawter/thesis/index.html and RjDj http://rjdj.me/ are the only two that come to mind.
(January 15th 2010)
Nice roundup. Maybe you can add a new kind of augmented realit: augmented reality in business cards (see my website, [ed - url removed]) for example or browse the web.
This is a less commun usage of augmented reality but this is a possible one :)
(January 15th 2010)
Thank you Chris.
I deeply agree with you.
“Augmenting” is not just putting digital stickers on physical objects/spaces, but “enhancing” an overall experience.
Last months have been so stuffed with technology advances that the tech-vs-design issue is no more a philosophical topic.
Bye!
S
(January 15th 2010)
@metabaron, did you read the article? I don’t think AR business cards are very good. You are already on someones website by the time you are looking at the AR, so thats the point?