“Touch and Control” is a mixed reality interaction paradigm that enables communication with physical objects in a natural and efficient manner. The concept is embedded in the scenario of autonomous car which offers insight into future in-car interaction with MR glasses.
A majority of next generation touchless systems is an reactive adaption to available sensing techniques instead bases on the fundamental interaction principles and human behaviours. In the master thesis the focus lies not on how to completely design a tracking system for gesture recognition and the corresponding feedback, but on exploring the opportunities for the new touchless interaction modality, as well as seeking for the theoretical basis for potential interaction in future. The Master thesis aims to discuss the two points below:
1, Defining a set of touchless micro-gestures for MR glasses;
2, Embedding micro gestures in use cases (e.g. in-car scenarios given the advantages Mixed- Reality glasses bring ) to describe above theoretical research in detail and verify its viability.
What are the natural, relaxed, productive gestures for MR glasses for daily use?
In which use cases will these gestures be applied? This project is to design a visionary concept regardless of proven technology on the market, instead focusing on human demand.
The manipulation is activated through touching the surface of the object and proceeds with micro-gesture (Finger movements on hand. In this project it means thumb tapping or moving on the other fingers), while MR visual effect emerging around the object and the hints on hand. The gestures(bio-acoustic signals) will be sensed through the accelerometer on a smartwatch which can offer vibrating feedback.