Back to Search Start Over

S4: Self-Supervised Learning of Spatiotemporal Similarity.

Authors :
Tkachev G
Frey S
Ertl T
Source :
IEEE transactions on visualization and computer graphics [IEEE Trans Vis Comput Graph] 2022 Dec; Vol. 28 (12), pp. 4713-4727. Date of Electronic Publication: 2022 Oct 26.
Publication Year :
2022

Abstract

We introduce an ML-driven approach that enables interactive example-based queries for similar behavior in ensembles of spatiotemporal scientific data. This addresses an important use case in the visual exploration of simulation and experimental data, where data is often large, unlabeled and has no meaningful similarity measures available. We exploit the fact that nearby locations often exhibit similar behavior and train a Siamese Neural Network in a self-supervised fashion, learning an expressive latent space for spatiotemporal behavior. This space can be used to find similar behavior with just a few user-provided examples. We evaluate this approach on several ensemble datasets and compare with multiple existing methods, showing both qualitative and quantitative results.

Details

Language :
English
ISSN :
1941-0506
Volume :
28
Issue :
12
Database :
MEDLINE
Journal :
IEEE transactions on visualization and computer graphics
Publication Type :
Academic Journal
Accession number :
34339374
Full Text :
https://doi.org/10.1109/TVCG.2021.3101418