Conversational Visualization

VOICE: Visual Oracle for Interaction, Conversation, and Explanation

Donggang Jia, Alexandra Irger, Lonni Besançon, Ondrej Strnad, Deng Luo, Johanna Björklund, Anders Ynnerman, Ivan Viola

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2025.
DOI: 10.1109/TVCG.2025.3579956

We present VOICE, a novel approach to science communication that connects the conversational capabilities of large language models with interactive exploratory visualization. VOICE bridges natural language queries with multiscale biological data, enabling real-time interaction and explanation in 3D visual environments.

VOICE System

Conversational Modeling

Chat Modeling: Natural Language-based Procedural Modeling of Biological Structures without Training

Donggang Jia, Yunhai Wang, Ivan Viola

arXiv preprint, arXiv:2404.01063, 2024

Chat Modeling is a natural language-based procedural modeling method that takes arbitrary textual input and completes corresponding 3D modeling tasks without any additional training.

Chat Modeling