Looks like it would be pretty neat to have, although I would hope that it wouldn't require so much memory and processing power that it wouldn't be practical, and that it would work with normal Windows based programs. It does seem to open a few doors, though, like fully 3D programs, etc.
http://wwws.sun.com/software/looking_glass/demo.html
http://wwws.sun.com/software/looking_glass/demo.html