Computational Psychology of Human Movement to Understand Gestures and Body Kinesics

   
Project summary
Project no.: 101BM/2017
Principal Investigators: Radu-Daniel Vatavu (University of Suceava, Romania) and Jean Vanderdonckt (Université catholique de Louvain, Belgium)
Funded by UEFISCDI, Romania and Wallonie-Bruxelles International, Belgium
Running period: January 2017 - December 2018 (24 months)

Abstract
In this project, we want to formalize a new methodology to understand human movements and whole-body gestures for interactive applications with new computational and psychological measures as well as new software tools to compute those measures automatically. Our goal is to empower the scientific community with relevant software tools for gesture analysis, which we expect to foster new developments in whole-body gesture interfaces for interactive applications.



Concrete objectives
  1. Define a global ontology for whole-body gestures by considering several levels of abstraction and characterization with three dimensions: conative, cognitive, and computational.
  2. Design new measures to characterize human movement and interactive whole-body gestures.
  3. Develop software tools to automatically compute our set of measures from raw sensor data.
  4. Validate our measures and associated software tools for specific interactive scenarios

Team
The team includes experienced researchers and PhD students in Human-Computer Interaction, Software Engineering, and Psychology.
University of Suceava, Romania Université catholique de Louvain, Belgium
  • Prof. Radu-Daniel Vatavu (Principal Investigator)
  • Prof. Stefan-Gheorghe Pentiuc
  • Dr. Doina-Maria Schipor
  • Dr. Ovidiu-Andrei Schipor
  • Dr. Ionela Rusu
  • Bogdan-Florin Gheran (PhD student)
  • Irina Popovici (PhD student)
Research activities are conducted in the Machine Intelligence and Information Visualization Research Laboratory of the MANSiD Research Center (Romania) and the Louvain Interaction Laboratory (Belgium).

Publications
  1. Jean Vanderdonckt, Paolo Roselli, Jorge Luis Pérez-Medina. (2018). !FTL, an Articulation-Invariant Stroke Gesture Recognizer with Controllable Position, Scale, and Rotation Invariances. In Proceedings of ICMI'18, the 20th ACM International Conference on Multimodal Interaction. ACM, New York, NY, USA, 125-134
    ACCEPTANCE RATE: 46.9% (46/98) | ARC B (CORE 2018)
    PDF | DOI
  1. Irina Popovici, Radu-Daniel Vatavu. (2018). Perceived Usability, Desirability, and Workload of Mid-Air Gesture Control for Smart TVs. In Proceedings of the 15th Romanian Human-Computer Interaction Conference (RoCHI '18). Matrix Rom, Bucharest, Romania, 91-98
    ACCEPTANCE RATE: 66.7% (28/42)
    PDF | DOI | YOUTUBE
  1. Jean-Yves Lionel Lawson, Jean Vanderdonckt, Radu-Daniel Vatavu. (2018). Mass-Computer Interaction for Thousands of Users and Beyond. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Paper LBW032, 6 pages
    ACCEPTANCE RATE (LBW): 39.8% (255/641) | ARC A* (CORE 2018)
    PDF | DOI | YOUTUBE
  1. Jean Vanderdonckt, Bruno Dumas, Mauro Cherubini. (2018). Comparing Some Distances in Template-based 2D Gesture Recognition. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Paper LBW121, 6 pages
    ACCEPTANCE RATE (LBW): 39.8% (255/641) | ARC A* (CORE 2018)
    PDF | DOI
  1. Jean Vanderdonckt, Radu-Daniel Vatavu. (2018). Designing, Engineering, and Evaluating Gesture User Interfaces. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Paper C22, 4 pages
    ACCEPTANCE RATE (courses): 65.7% (25/38) | ARC A* (CORE 2018)
    PDF | DOI
  1. Radu-Daniel Vatavu. (2017). Beyond Features for Recognition: Human-Readable Measures to Understand Users' Whole-Body Gesture Performance. International Journal of Human-Computer Interaction 33 (9). Taylor & Francis, 713-730
    PDF | DOI | WOS:000407618800002
    IF: 1.118 | 5-Year IF: 1.396 (JCR 2016)
  1. Radu-Daniel Vatavu. (2017). Fundamentals of Gesture Production, Recognition, and Analysis. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 1174-1177
    PDF | DOI | ARC A* (CORE 2018)

Media


Resources
Project resources (software and datasets) will be available in this section soon.

Note: flag icons used on this page (flag-icons-css) are available under the MIT license here.