MARIO: Mid-air Augmented Reality Interaction with Objects
Demo of mixed-reality tech where you can play with a cute virtual character - video embedded below:
This mixed reality interface places virtual characters in the real world. It was developed by the Naemura Lab at the University of Tokyo.
Users can have an animated character jump onto their hand, as well as guide the character onto blocks, creating a novel interactive experience.
"Recently, devices have been developed that can form images in mid-air. We’ve utilized one of those, and combined it with sensors and a projector, to provide an intuitive display experience where a picture in the air is skillfully merged with the real world."
Data such as the height of the user’s hand and the shape of the block is obtained using Kinect, and the system is programmed to automatically move the character to the highest place. This data is used to display the character and its shadow correctly in mid-air, both geometrically and optically, creating a very realistic looking experience.
More at DigInfo here