Designing interactive experiences with computer systems that understand users’ body movement and gestures

Abstract

In this talk, I will present results obtained in the Machine Intelligence and Information Visualization Research Laboratory (http://www.eed.usv.ro/mintviz) regarding designs of gesture-based interaction for wearable devices, large displays, touchscreens and interactive surfaces, augmented and mixed reality systems, smart television, and other application areas. Examples include gestures enabled by a wearable system designed for the finger and hand that makes users believe they are actually holding and manipulating digital content, gesture commands for controlling a smart TV that replace remote controls, and body-referenced gestures used to interact with digital content found in physical pockets on the user’s clothes.