Multi-Modal Data Exploration in a Mixed Reality Environment Using Coordinated Multiple Views
Immersive analytics is an emerging field of data exploration and analysis in immersive environments. The main idea is to use visual analytics in a fully immersive 3D space. The availability of immersive extended reality systems has increased tremendously recently, but it is still not as widely used as conventional 2D displays. We describe an immersive analysis system for spatio-temporal data and compare its performance in an immersive environment and on a conventional 2D display.
The work is accepted to the HCI International 2021 conference. To learn more about the dataset that is shown, visit IEEE VAST Challenge 2019. To explore this prototype in a desktop environment, visit the WebGL environment.
Related links: Conference Paper | ICAT Creativity and Innovation Day 2021 | Demo | CHCI Student Symposium 2021
Initial sketch.
Various Coordinated Multiple Views (CMV): 2D bar chart.
Various Coordinated Multiple Views (CMV): 3D bar charts.
Various Coordinated Multiple Views (CMV): Scatter plot.
Various Coordinated Multiple Views (CMV): Floor view.
The interactive selection of data is called brushing. The color of a data sphere toggles when brushed. Three data spheres are brushed in the floor CMV.
Timestamps.
Top view.
Scaled down version.
Virtual keyboard in an MR environment.
Snapshots of the proof-of-concept in action: Electron density plot at 08:00:00 UTC shown in the holographic streaming mode from a computer to the HoloLens device in real-time.
Snapshots of the proof-of-concept in action: Iris dataset scatter plot shown in the holographic streaming mode from a computer to the HoloLens device in real-time.