Title :

Combining audio and visual displays to highlight temporal and spatial seismic patterns

Author(s) :

Paté, Arthur [Auteur]
Acoustique - IEMN [ACOUSTIQUE - IEMN]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Farge, Gaspard [Auteur]
Institut de Physique du Globe de Paris [IPGP (UMR_7154)]
Holtzman, Benjamin [Auteur]
Lamont-Doherty Earth Observatory [LDEO]
Barth, Anna [Auteur]
Lamont-Doherty Earth Observatory [LDEO]
Poli, Piero [Auteur]
Institut des Sciences de la Terre [ISTerre]

Boschi, Lapo [Auteur]
Institut des Sciences de la Terre de Paris [iSTeP]
Karlstrom, Leif [Auteur]
University of Oregon [Eugene]

Journal title :

Journal on Multimodal User Interfaces

Pages :

125-142

Publisher :

Springer

Publication date :

2022-03

ISSN :

1783-7677

HAL domain(s) :

Sciences cognitives

English abstract : [en]

Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system ...
Show more >Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system is good at recognizing spatial patterns, whereas our auditory system is better tuned for temporal patterns. In this article, data representation methods are proposed that combine visualization, sonification, and spatial audio techniques, in order to optimize the user’s perception of spatial and temporal patterns in a single display, to increase the feeling of immersion, and to take advantage of multimodal integration mechanisms. Three seismic data sets are used to illustrate the methods, covering different physical phenomena, time scales, spatial distributions, and spatio-temporal dynamics. The methods are adapted to the specificities of each data set, and to the amount of information that the designer wants to display. This leads to further developments, namely the use of audification with two time scales, the switch from pure audification to time-modulated noise, and the switch from pure audification to sonic icons. First user feedback from live demonstrations indicates that the methods presented in this article seem to enhance the perception of spatio-temporal patterns, which is a key parameter to the understanding of seismically active systems, and a step towards apprehending the processes that drive this activity.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

Comment :

Data availability all datasets used in this study are available on the web at the following addresses (see also the manuscript):- https://www.usgs.gov/volcanoes/kilauea/monitoring- https://www.usgs.gov/observatories/hawaiian-volcano-observatory- https://pnsn.org/seismograms- https://www.pnsn.org/tremor- http://www.fdsn.org/networks/detail/Y4_2014.

Collections :

• Institut d'Électronique, de Microélectronique et de Nanotechnologie (IEMN) - UMR 8520

Source :

Harvested from HAL