New Interaction Techniques for Smart Environments at the Periphery of User Attention

   
Project summary
Project no.: PN-III-P3-3.1-PM-RO-CN-2018-0032; Contract no.: 3BM/2018
Principal Investigators: Radu-Daniel Vatavu (University of Suceava, Romania) and Wenjun Wu (Beihang University, China)
Funded by UEFISCDI, Romania and Ministry of Science and Technology, P.R. China
Funding scheme: PNIII P3 - European and International Cooperation
Running period: July 2018 - December 2019 (18 months)

Abstract

In this project, we plan to design and develop efficient, low-effort, and fluent interactions for users in smart environments that enable task shifting from the center to the periphery of user attention. To this end, we address new software architecture designs, such as SAPIENS (Software Architecture for Peripheral Interaction in Smart Environments; see figure below, left), and we investigate new input techniques to support peripheral interactions for practical applications, such as smart pockets to control smart TVs (see figure below, middle).


Concrete objectives

  1. Define a generic, comprehensive taxonomy for interactions in smart environments performed at the periphery of user attention
  2. Design and implement software architecture to enable interactions at the periphery of user attention
  3. Design, implement, and evaluate peripheral interaction techniques for smart environments

Team

The team includes experienced researchers and PhD students in Human-Computer Interaction and Software Engineering.
University of Suceava, Romania Beihang University, China
  • Prof. Radu-Daniel Vatavu (Principal Investigator)
  • Dr. Ovidiu-Andrei Schipor
  • Dr. Ovidiu-Ionut Gherman
  • Irina Popovici (PhD student)
  • Bogdan-Florin Gheran (PhD student)
  • Petru-Vasile Cioata (PhD student)
  • Marian-Nicolae Pinzariu (PhD student)
  • Prof. Wenjun Wu (Principal Investigator)
  • Prof. Wei-Tek Tsai
  • Han Yong (PhD student)
  • Pu Yanjun (PhD student)
  • Wang Qunbo (PhD student)
  • Yu Liang (PhD student)
  • Xiaoming Yu (PhD student)
Research activities are conducted in the Machine Intelligence and Information Visualization Research Laboratory of the MANSiD Research Center (Suceava, Romania) and the State Key Lab of Software Development Environment, Beihang University (Beijing, China).

Publications

  1. Irina Popovici, Ovidiu-Andrei Schipor, Radu-Daniel Vatavu. (2019). Hover: Exploring Cognitive Maps and Mid-Air Pointing for Television Control . International Journal of Human-Computer Studies 129 (September). Elsevier, 95-107
    PDF | DOI | ISI WOS:000472687700008 | IF: 2.006, 5-Year IF: 2.517 (Web of Science JCR 2018)
  1. Ovidiu-Andrei Schipor, Radu-Daniel Vatavu, Wenjun Wu. (2019). SAPIENS: Towards Software Architecture to Support Peripheral Interaction in Smart Environments. Proceedings of the ACM on Human-Computer Interaction 3, EICS. ACM, New York, NY, USA, Article No. 11, 24 pages
    PDF | DOI
  1. Irina Popovici, Radu-Daniel Vatavu, Wenjun Wu. (2019). TV Channels in Your Pocket! Linking Smart Pockets to Smart TVs. In Proceedings of TVX'19, the ACM International Conference on Interactive Experiences for TV and Online Video. ACM, New York, NY, USA, 6 pages
    PDF | DOI | ISI WOS:000482136600019
  1. Ovidiu-Andrei Schipor, Radu-Daniel Vatavu, Wenjun Wu. (2019). Integrating Peripheral Interaction into Augmented Reality Applications. In Proceedings of ISMAR '19 Adjunct, the 18th International Symposium on Mixed and Augmented Reality. IEEE Press, 358-359
    PDF | DOI | A* conference (ARC CORE 2018) | ISI WOS: TBA

Media

Software

The SAPIENS software architecture, designed and implemented in this project and described in Schipor, Vatavu, and Wu (2019), has a dedicated web page. We also deliver our online simulation application for peripheral interaction, which enables practitioners to access JavaScript code and observe how live JSON messages are being exchanged by the various components of the SAPIENS architecture.



Note: flag icons used on this page (flag-icons-css) are available under the MIT license here.