About the Project
About the Project
Embedded Files
The AWARE project aims to augment human capabilities through assistive AI that is aware of the human user’s cognition and tasks. We decode the various signals obtained from wearable sensors, headsets, and cameras, yielding estimates of the user’s biological state, cognitive state, and the surrounding context.
Augmenting humans with extended reality (XR) systems gives them improved situational awareness, new information and abilities and also enables co-operation through remote presence.
Machine learning (ML) based context understanding and human state estimation enable an artificial intelligence (AI) to intervene in stressful situations and ensure optimal performance by adapting the multimodal XR capabilities.
Environmental sensing will be implemented by a combination of sensors. The cognitive state of the human will be estimated by wearable biosensors and eye-trackers in conjunction with XR devices.
Environmental sensing will be implemented by a combination of sensors. The cognitive state of the human will be estimated by wearable biosensors and eye-trackers in conjunction with XR devices.
The results of the project will enable optimal use of XR systems for co-operation of humans and AI technologies.
The results of the project will enable optimal use of XR systems for co-operation of humans and AI technologies.
We will measure the cognitive responses, task performance, and user experience of humans interacting with this AI-powered XR technology that combines cognitive state modelling, detection, personalization and prediction with task modelling, context awareness and HCI adaptation.
We will measure the cognitive responses, task performance, and user experience of humans interacting with this AI-powered XR technology that combines cognitive state modelling, detection, personalization and prediction with task modelling, context awareness and HCI adaptation.
The Partners
The Partners
TAUCHI laboratories in Tampere University consist of six research facilities for experimental research: Virtual Reality CAVE room, Interaction Technology Laboratory, Haptics Laboratory, Gaze Laboratory, Scent Laboratory and Psychophysiological Computing Laboratory. Tampere University also has high-performance GPU clusters available to the project.
VTT Sensing Solutions has various kinds of biosensors (light mobile EEG, eye-tracking, HR/V, EDA), solid knowledge on human physiology and psychophysiological phenomenon as well as software for multi-biosensor fusion and for analysing personal biomarkers on population scale.
University of Lapland Faculty of Art and Design workshops and design facilities to support design, user studies, and rapid prototyping. The workshops provide facilities to conduct design-based research, e.g., wearables integrating in textile and clothing design, interaction design, product design, and rapid prototyping of interactive research models.
The People
The People
Roope
Raisamo
PI, Prof.
Roope is the coordinator of the consortium. He has coordinated more than 40 externally funded national and international projects in haptic interaction, computer vision, and multimodal systems. He has the main responsibility of the design of the interaction model for wearable human augmentation.
Jari
Kangas
Senior researcher, D.Sc.(Tech)
Jari has background in both artificial intelligence and human-computer interaction. He is mainly working on studying interaction and visualisation methods as well as defining methodologies for testing the solutions with users.
Pertti
Huuskonen
Senior researcher, D.Sc.(Tech)
Pertti is a scientific midwife – planning, negotiating and executing new projects at Tampere University together with research partners and the industry. He has over 40 years of experience in the IT and telecom sectors, having worked at VTT, CERN and Nokia on (then) very bleeding edge projects on explainable AI, WWW, mobile sensing, context awareness, ubiquitous computing, IoT, HCI, XR and many other topics. At the moment he is experimenting with 3D printing and laser engraving coupled with generative AI.
Ismo
Rakkolainen
Senior researcher, D.Sc.(Tech), docent
Ismo's research interests include interaction techniques, novel user interfaces, displays, human augmentation, and virtual reality. He is also interested in a host of other topics such as geopolitics, economics, religions, psychology, astronomy, and history. He is studying interaction methods and societal and philosophical implications of human augmentation.
Albina
Rurenko
Doctoral researcher, M.Sc.
Abby is a doctoral researcher specializing in human augmentation, with an interdisciplinary background in computer science, cognitive science, and human-computer interaction. Her current work focuses on using haptic technologies to convey contextual information.
Devbrat Anuragi
Doctoral researcher
Devbrat is a doctoral student.
Muhammad Zeeja
Research assistant
Muhammad is a research assistant at Tampere University, working with TAUCHI’s Multimodal Interaction Group. His work focuses on human augmentation and multimodal interaction, particularly how emerging technologies like XR and AI can support enhanced perception and interaction.
Kati
Petterson
PI, Senior Scientist, PhD.
Kati is a specialist in eye metrics and analysis, cognitive state estimation, and physiological measurements. During her postdoctoral research, she focused on oculomotor behavior at NASA Ames Research Center’s Fatigue Countermeasures Laboratory. She currently leads VTT’s PsychoLab, which focuses on psychophysiological measurements in augmented reality.
Jani Mäntyjärvi
Principal Scientist, PhD, docent
Jani has over 20 years of experience in research and development on data processing, pattern recognition, and machine learning methods for activity recognition, context, and situation awareness and behavior analysis based on mobile and wearable device data.
Jaakko Tervonen
Research Scientist
Coming soon!
Mari
Rytky
Research Scientist, M.Sc.(Tech)
Mari has a background in biosignal processing, data analytics, and algorithm development. In the project, she focuses on data interpretation and developing algorithms to extract relevant information from physiological data.
Juuso Heininen
Research Scientist, M.Sc
Juuso is a data scientist with experience on working with data and algorithms in various applications ranging from population studies and RF antennas to wearable health devices. His main role in AWARE is to develop algorithms for eye and head movement detection in VR.
Jonna
Häkkilä
PI, Professor of Industrial Design
Jonna leads the Lapland User Experience research group. Her group’s work at the cross-section between design and technology has been exhibited at Milan Design Week, New York Wanted Design, and awarded at the ISWC wearables design exhibition in Singapore and Germany.
Ashley
Colley
Dr., docent
Ashley is a docent in creative technologies at the University of Lapland. He has more than 25 years professional industry experience, including 10 years as a Principal Designer in Nokia, and as co-founder of the successful health technology start-up Oura Health (Oura ring).
Zhengya
Gong
PhD.
Zhengya is a postdoctoral researcher at the University of Lapland, Finland. Her work is focused on Human-computer interaction, virtual reality, and design creativity.
Henri
Mella
Research assistant, BA
Henri will focus on 3D graphics and modelling, XR UIs, industrial design, service design and aesthetics.
Previous members and other collaborators
Matilda Kalving
Coordinator, MA, Doctoral Researcher
Matilda worked as a coordinator and designer at University of Lapland in the AWARE project in 2023-2024, blending technology and innovation. She is a doctoral candidate in the Finnish Doctoral Program Network in Artificial Intelligence (FCAI) doctoral program at Tampere University.
Page updated
Google Sites
Report abuse