Multimodal Interaction: a Survey from Model Driven Engineering and Mobile perspectives

Elouali, Nadia; Rouillard, Jose; Le Pallec, Xavier; Tarby, Jean-Claude

Document type :

Article dans une revue scientifique: Article original

Title :

Multimodal Interaction: a Survey from Model Driven Engineering and Mobile perspectives

Author(s) :

Elouali, Nadia [Auteur]
Composition de modèles pour l'ingénierie logicielle [COCOA]
Nouveaux Outils pour La Coopération et l'Education [NOCE]
Rouillard, Jose [Auteur]

Nouveaux Outils pour La Coopération et l'Education [NOCE]
Le Pallec, Xavier [Auteur]

Composition de modèles pour l'ingénierie logicielle [COCOA]
Laboratoire d'Informatique Fondamentale de Lille [LIFL]
Tarby, Jean-Claude [Auteur]

Laboratoire d'Informatique Fondamentale de Lille [LIFL]
Nouveaux Outils pour La Coopération et l'Education [NOCE]

Journal title :

Journal on Multimodal User Interfaces

Publisher :

Springer

Publication date :

2013-06-03

ISSN :

1783-7677

English keyword(s) :

Multimodal mobile interaction
Model-Driven Engineering (MDE)
Model-based approaches

HAL domain(s) :

Informatique [cs]/Informatique et langage [cs.CL]

English abstract : [en]

The multimodal interaction is becoming richer in last years thanks to the increasing evolution of mobile devices (smartphones/tablets) and their embedded sensors including accelerometer, gyroscope, GPS, NFC and prox- imity ...
Show more >The multimodal interaction is becoming richer in last years thanks to the increasing evolution of mobile devices (smartphones/tablets) and their embedded sensors including accelerometer, gyroscope, GPS, NFC and prox- imity sensors. Using such sensors, either sequentially or simultaneously, to interact with applications ensures an intuitive interaction and the user accep- tance. Today, the development of multimodal mobile systems incorporating input and output modalities through sensors is a long and difficult task. De- spite the facts that numerous model-based approaches have emerged and are supposed to simplify the multimodal mobile applications engineering, the de- sign and implementation of these applications are still generally in an ad-hoc way. In order to explain this situation, the present paper reviews, discusses, and analyses different model-based approaches proposed to develop multimodal mobile applications. The analysis considers not only the modelling and gener- ation of mobile multimodality features, but also the inclusion of Model-Driven Engineering (MDE) features such as guidance and model reuse that allows the appropriate use of models and benefits from them. Our aim is to identify the current gaps that hinder the facility and acceleration of the multimodal mobile applications development using model-based approaches.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

ANR Project :

Modèles et Outils pour Applications NOmades de découverte de territoire

Comment :

A paraître

Collections :

Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189

Source :

Harvested from HAL

Multimodal Interaction: a Survey from Model ... BibTeX CSV Excel RIS

Multimodal Interaction: a Survey from Model ...

BibTeX

CSV

Excel

RIS