Augmented Reality for Pervasive Computing

The ultimate limit of today`s user interfaces lies in the used two-dimensional abstractions that are only effective for their original domain of document-centric work. In contrast, in our everyday world we are not limited to our desktop surface. Information in the real world is perceived and processed in three dimensions, continuously and in real time. A human-computer interface that can capture these properties will be able to render a new level of services to the user, enabling the use of computers for new application domains and for new user populations. This "anywhere" and "anytime" requirement for pervasive computing cannot be fulfilled with miniature versions of desktop environments. A new style of user interface, a paradigm shift is needed. Therefore, the core of the proposed research is the following thesis: Augmented reality (AR), i. e., enhancing a user`s perception of the real world with computer generated graphics and annotations, can make working with computers in 3D as productive as the desktop metaphor in 2D. This thesis is motivated by the fact that AR allows to integrate the whole world into the interface - the world essentially becomes the interface. Therefore users are able to leave their physical desktops and computer desktops to interact with their environment and with other users. The AR platform Studierstube lead by the proposer is world-wide unique in its combination of augmented reality, 3D display and groupware elements. Studierstube, the study room where Faust was searching for enlightenment, describes the philosphy of using the place as a mediator to information and insight. We are currently developing a wearable augmented reality system, which allows the user interface to be in any place, with and for anybody. Within the proposed augmented reality/pervasive computing infrastructure, an environment can be turned into a virtual "ether" encompassing users that are enabled to interact with the computer through real-world objects. The proposed project work will expand the augmented reality platform Studierstube into a pervasive computing environment built on a variety emerging technologies. A number of promising application areas is selected, for which applications will be developed that try out the new style of interfacing with the computer in practice.

The ultimate limit of today`s user interfaces lies in the used two-dimensional abstractions that are only effective for their original domain of document-centric work. In contrast, in our everyday world we are not limited to our desktop surface. Information in the real world is perceived and processed in three dimensions, continuously and in real time. A human-computer interface that can capture these properties will be able to render a new level of services to the user, enabling the use of computers for new application domains and for new user populations. This "anywhere" and "anytime" requirement for pervasive computing cannot be fulfilled with miniature versions of desktop environments. A new style of user interface, a paradigm shift is needed. Therefore, the core of the proposed research is the following thesis: Augmented reality (AR), i. e., enhancing a user`s perception of the real world with computer generated graphics and annotations, can make working with computers in 3D as productive as the desktop metaphor in 2D. This thesis is motivated by the fact that AR allows to integrate the whole world into the interface - the world essentially becomes the interface. Therefore users are able to leave their physical desktops and computer desktops to interact with their environment and with other users. The AR platform Studierstube lead by the proposer is world-wide unique in its combination of augmented reality, 3D display and groupware elements. Studierstube, the study room where Faust was searching for enlightenment, describes the philosphy of using the place as a mediator to information and insight. We are currently developing a wearable augmented reality system, which allows the user interface to be in any place, with and for anybody. Within the proposed augmented reality/pervasive computing infrastructure, an environment can be turned into a virtual "ether" encompassing users that are enabled to interact with the computer through real-world objects. The proposed project work will expand the augmented reality platform Studierstube into a pervasive computing environment built on a variety emerging technologies. A number of promising application areas is selected, for which applications will be developed that try out the new style of interfacing with the computer in practice.