Touchless interaction with medical images ...
Document type :
Article dans une revue scientifique: Article original
Title :
Touchless interaction with medical images based on 3D hand cursors supported by single-foot input: A case study in dentistry
Author(s) :
Paulo, Soraia Figueiredo [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Relvas, Filipe [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Nicolau, Hugo [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Rekik, Yosra [Auteur]
Laboratoire d'Automatique, de Mécanique et d'Informatique industrielles et Humaines - UMR 8201 [LAMIH]
Machado, Vanessa [Auteur]
Hospital de Santa Maria [Lisboa]
Botelho, João [Auteur]
Hospital de Santa Maria [Lisboa]
Mendes, José João [Auteur]
Hospital de Santa Maria [Lisboa]
Grisoni, Laurent [Auteur]
Institut de Recherche sur les Composants logiciels et matériels pour l'Information et la Communication Avancée - UAR 3380 [IRCICA]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Jorge, Joaquim [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Lopes, Daniel Simões [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Relvas, Filipe [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Nicolau, Hugo [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Rekik, Yosra [Auteur]
Laboratoire d'Automatique, de Mécanique et d'Informatique industrielles et Humaines - UMR 8201 [LAMIH]
Machado, Vanessa [Auteur]
Hospital de Santa Maria [Lisboa]
Botelho, João [Auteur]
Hospital de Santa Maria [Lisboa]
Mendes, José João [Auteur]
Hospital de Santa Maria [Lisboa]
Grisoni, Laurent [Auteur]
Institut de Recherche sur les Composants logiciels et matériels pour l'Information et la Communication Avancée - UAR 3380 [IRCICA]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Jorge, Joaquim [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Lopes, Daniel Simões [Auteur]
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa [INESC-ID]
Journal title :
Journal of Biomedical Informatics
Pages :
103316
Publisher :
Elsevier
Publication date :
2019-12
ISSN :
1532-0464
English keyword(s) :
Foot
Hand
Gestures
Asepsis
Dentistry
User-computer interface
Tomography
Hand
Gestures
Asepsis
Dentistry
User-computer interface
Tomography
HAL domain(s) :
Informatique [cs]/Synthèse d'image et réalité virtuelle [cs.GR]
Informatique [cs]/Interface homme-machine [cs.HC]
Informatique [cs]/Interface homme-machine [cs.HC]
English abstract : [en]
Feet input can support mid-air hand gestures for touchless medical image manipulation to prevent unintended activations, especially in sterile contexts. However, foot interaction has yet to be investigated in dental settings. ...
Show more >Feet input can support mid-air hand gestures for touchless medical image manipulation to prevent unintended activations, especially in sterile contexts. However, foot interaction has yet to be investigated in dental settings. In this paper, we conducted a mixed methods research study with medical dentistry professionals. To this end, we developed a touchless medical image system in either sitting or standing configurations. Clinicians could use both hands as 3D cursors and a minimalist single-foot gesture vocabulary to activate manipulations. First, we performed a qualitative evaluation with 18 medical dentists to assess the utility and usability of our system. Second, we used quantitative methods to compare pedal foot-supported hand interaction and hands-only conditions next to 22 medical dentists. We expand on previous work by characterizing a range of potential limitations of foot-supported touchless 3D interaction in the dental domain. Our findings suggest that clinicians are open to use their foot for simple, fast and easy access to image data during surgical procedures, such as dental implant placement. Furthermore, 3D hand cursors, supported by foot gestures for activation events, were considered useful and easy to employ for medical image manipulation. Even though most clinicians preferred hands-only manipulation for pragmatic purposes, feet-supported interaction was found to provide more precise control and, most importantly, to decrease the number of unintended activations during manipulation. Finally, we provide design considerations for future work exploring foot-supported touchless interfaces for sterile settings in Dental Medicine, regarding: interaction design, foot input devices, the learning process and camera occlusions.Show less >
Show more >Feet input can support mid-air hand gestures for touchless medical image manipulation to prevent unintended activations, especially in sterile contexts. However, foot interaction has yet to be investigated in dental settings. In this paper, we conducted a mixed methods research study with medical dentistry professionals. To this end, we developed a touchless medical image system in either sitting or standing configurations. Clinicians could use both hands as 3D cursors and a minimalist single-foot gesture vocabulary to activate manipulations. First, we performed a qualitative evaluation with 18 medical dentists to assess the utility and usability of our system. Second, we used quantitative methods to compare pedal foot-supported hand interaction and hands-only conditions next to 22 medical dentists. We expand on previous work by characterizing a range of potential limitations of foot-supported touchless 3D interaction in the dental domain. Our findings suggest that clinicians are open to use their foot for simple, fast and easy access to image data during surgical procedures, such as dental implant placement. Furthermore, 3D hand cursors, supported by foot gestures for activation events, were considered useful and easy to employ for medical image manipulation. Even though most clinicians preferred hands-only manipulation for pragmatic purposes, feet-supported interaction was found to provide more precise control and, most importantly, to decrease the number of unintended activations during manipulation. Finally, we provide design considerations for future work exploring foot-supported touchless interfaces for sterile settings in Dental Medicine, regarding: interaction design, foot input devices, the learning process and camera occlusions.Show less >
Language :
Anglais
Peer reviewed article :
Oui
Audience :
Internationale
Popular science :
Non
Collections :
Source :
Files
- https://doi.org/10.1016/j.jbi.2019.103316
- Open access
- Access the document
- https://doi.org/10.1016/j.jbi.2019.103316
- Open access
- Access the document
- https://doi.org/10.1016/j.jbi.2019.103316
- Open access
- Access the document
- https://doi.org/10.1016/j.jbi.2019.103316
- Open access
- Access the document
- j.jbi.2019.103316
- Open access
- Access the document
- document
- Open access
- Access the document
- Soraia_Figueiredo_Paulo_Journal_Biomedical_Informatics_2019.pdf
- Open access
- Access the document