• English
    • français
  • Help
  •  | 
  • Contact
  •  | 
  • About
  •  | 
  • Login
  • HAL portal
  •  | 
  • Pages Pro
  • EN
  •  / 
  • FR
View Item 
  •   LillOA Home
  • Liste des unités
  • Institut d'Électronique, de Microélectronique et de Nanotechnologie (IEMN) - UMR 8520
  • View Item
  •   LillOA Home
  • Liste des unités
  • Institut d'Électronique, de Microélectronique et de Nanotechnologie (IEMN) - UMR 8520
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Combining audio and visual displays to ...
  • BibTeX
  • CSV
  • Excel
  • RIS

Document type :
Article dans une revue scientifique
DOI :
10.1007/s12193-021-00378-8
Title :
Combining audio and visual displays to highlight temporal and spatial seismic patterns
Author(s) :
Paté, Arthur [Auteur]
Acoustique - IEMN [ACOUSTIQUE - IEMN]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Farge, Gaspard [Auteur]
Institut de Physique du Globe de Paris [IPGP (UMR_7154)]
Holtzman, Benjamin [Auteur]
Lamont-Doherty Earth Observatory [LDEO]
Barth, Anna [Auteur]
Lamont-Doherty Earth Observatory [LDEO]
Poli, Piero [Auteur]
Institut des Sciences de la Terre [ISTerre]

Boschi, Lapo [Auteur]
Institut des Sciences de la Terre de Paris [iSTeP]
Karlstrom, Leif [Auteur]
University of Oregon [Eugene]
Journal title :
Journal on Multimodal User Interfaces
Pages :
125-142
Publisher :
Springer
Publication date :
2022-03
ISSN :
1783-7677
HAL domain(s) :
Sciences cognitives
English abstract : [en]
Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system ...
Show more >
Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system is good at recognizing spatial patterns, whereas our auditory system is better tuned for temporal patterns. In this article, data representation methods are proposed that combine visualization, sonification, and spatial audio techniques, in order to optimize the user’s perception of spatial and temporal patterns in a single display, to increase the feeling of immersion, and to take advantage of multimodal integration mechanisms. Three seismic data sets are used to illustrate the methods, covering different physical phenomena, time scales, spatial distributions, and spatio-temporal dynamics. The methods are adapted to the specificities of each data set, and to the amount of information that the designer wants to display. This leads to further developments, namely the use of audification with two time scales, the switch from pure audification to time-modulated noise, and the switch from pure audification to sonic icons. First user feedback from live demonstrations indicates that the methods presented in this article seem to enhance the perception of spatio-temporal patterns, which is a key parameter to the understanding of seismically active systems, and a step towards apprehending the processes that drive this activity.Show less >
Language :
Anglais
Peer reviewed article :
Oui
Audience :
Internationale
Popular science :
Non
Comment :
Data availability all datasets used in this study are available on the web at the following addresses (see also the manuscript):- https://www.usgs.gov/volcanoes/kilauea/monitoring- https://www.usgs.gov/observatories/hawaiian-volcano-observatory- https://pnsn.org/seismograms- https://www.pnsn.org/tremor- http://www.fdsn.org/networks/detail/Y4_2014.
Collections :
  • Institut d'Électronique, de Microélectronique et de Nanotechnologie (IEMN) - UMR 8520
Source :
Harvested from HAL
Université de Lille

Mentions légales
Université de Lille © 2017