e-Glasses: The interactive eyeglasses for mobile, perceptual computing

The eGlasses project is focused on the development of an open platform in the form of multisensory electronic glasses and on the integration and designing of new intelligent interaction methods using the eGlasses platform. This is an initial development focused on long-term research and technological innovation in perceptual and super- perceptual (e.g. heart rate, temperature) computing. It is an emerging technology that is also focused on the creation of mobile, perceptual media. Perceptual media refers to multimedia devices with added perceptual user interface capabilities. These devices integrate human-like perceptual awareness of the environment, with the ability to respond appropriately. This can be achieved by using automatic perception of an object`s properties and delivering information about the object`s status as a result of reasoning operations. For example, using the eGlasses, it will be possible to control a device, which is recognized within the field of view using the interactive menu, associated with the identified device. Other examples include presentation of a recognized person name, recognition of people with abnormal physiological parameters, protection against possible head injuries, etc. The platform will use currently available user-interaction methods, new methods developed in the framework of this project (e.g. a haptic interface) and will enable further extensions to introduce next generation user-interaction algorithms. Furthermore, the goal of this project is to propose and evaluate new and intelligent user interactions, which are particularly useful for healthcare professionals, people with disabilities or at risk of exclusion, and to create and evaluate behavioural models of these mobile users. The main scientific and technological objectives of the project are to design and evaluate the following: - eye-tracking hardware and algorithms for a user, who is mobile in a noisy real world environment, - algorithms for perceptual media and for super perceptual computing, - methods for locating objects and guiding vision towards the identified objects, - methods of interactions with users and objects (menu of activities for the identified person or object), - a haptic interface in a form of a peripheral proximity radar, - methods for the recognition of the user`s own gestures and recognition of gestures of the observed person, - methods for context-aware behavioural studies, - methods for reference applications. The result of the project will be an open platform in the form of multisensory electronic multimedia glasses and a set of new methods for intelligent user interactions, especially in the context of perceptual media.

The eGlasses project focuses on the development of an open platform in the form of multisensory electronic glasses and on the integration and design of new intelligent interaction methods using the eGlasses platform. The objective of this project was to design an open evaluation platform that includes already developed user-interaction methods. Furthermore, the goal of this project was to propose and evaluate new and intelligent user interactions, which could be particularly useful for healthcare professionals, people with disabilities, or those at risk of exclusion. The main scientific objectives of the project were to design, evaluate and develop (1) new eye-tracking hardware and algorithms for users in mobile contexts, (2) new and fast algorithms for perceptual media, (3) new and fast algorithms for super-perceptual computing, (4) methods for locating objects and guiding vision towards the identified objects, (5) new methods of interaction between users and objects, (6) to design and verify a peripheral proximity radar, (7) to develop and evaluate new methods for user input, (8) to perform empirical studies of a users behaviour, (9) to develop new algorithms and investigate applications for health professionals and people with limited perception abilities. We focused mainly on (5) and therefore proposed novel gesture-based interaction methods. We looked at the everyday use of head-worn computers and evaluated the current interaction methods. We found that these devices are usually used for getting access to small bits of information (e.g. checking weather, checking time, messaging, etc.) and were typically used in mobile contexts. Therefore, we found that mid-air gestures, which are physically demanding, were not appropriate for interaction using smart glasses. We focused on smart textiles since clothing or accessories can be worn directly on the body and are always available, like wearables. Next, we investigated smart materials such as yarns and fabrics based on their structural types, raw materials, and their sensing properties. Then, we started to create a range of sensors by using yarns, fabrics and diverse textile processing methods like knitting and sewing. StretchEBand is a stretch-sensitive and adjustable elastic band, which can be integrated into any kind of elastic fabric (e.g. wrist bands; pocket openings, etc.). FlexTiles is a pressure-sensitive fabric, which can be used to create a smart couch cover that senses people who are seated, a smart steering wheel that supports fatigue detection and touch interaction, and a wearable arm sleeve that supports touch interaction, body movement detection or non-rigid deformations of the textile. Thus, the expected final results are fabric sensors that can take on different shapes, can be integrated into deformable objects, can be used for ubiquitous sensing and/or leveraged in mobile contexts, and can ultimately be used as an input medium for smart glasses.