It is presumed that the tech will be used in conjunction with Microsoft’s next wave of Kinect hardware, which is rumoured to come in the form of 3D glasses called Fortaleza. The glasses will be able to tell exactly what direction in which you're looking, as well as giving the impression of 3D objects within the room.
So basically, your entire room could be turned into an alien environment filled with characters, architecture, fauna and who knows what else, much of which is interactive. Microsoft are building a Holodeck.
The news comes via a patent filed by MS themselves, which is accompanied by an image showing just how the tech would work. It shows someone playing an FPS, with the image on a TV screen spilling out onto the walls of the room. It also shows a second TV-mounted device alongside a Kinect unit.
The patent reads, “Interactive media experiences, such as video games, are commonly delivered by a high quality, high resolution display. Such displays are typically the only source of visual content, so that the media experience is bounded by the bezel of the display.”
“Even when focused on the display, the user may perceive architectural and decorative features of the room the display is in via the user’s peripheral vision. Such features are typically out of context with respect to the displayed image, muting the entertainment potential of the media experience.”
“Further, because some entertainment experiences engage the user’s situational awareness (e.g., in experiences like the video game scenario described above), the ability to perceive motion and identify objects in the peripheral environment (i.e., in a region outside of the high resolution display) may intensify the entertainment experience.”
information courtesy of CVG