Vislink: Revealing Relationships Amongst Visualizations

VisLink: Revealing Relationships Amongst Visualizations

C HRISTOPHER C OLLINS & S HEELAGH C ARPENDALE [email protected], [email protected]

IEEE Information Visualization 2007

(Collins, 2007) (Heer, 2006 [prefuse]) & (Fry, 2004) Understanding Multiple Relations

 What is the relationship…  across different views of the same data?  across different relations in the same dataset?  across multiple relations and datasets? VisLink VisLink Overview

 Any number of 2D visualizations, each on its own plane in 3D space  Adjacent planes connected by bundled edges  Shortcuts and constrained widgets aid usability  Enables powerful inter-visualization queries Formalizing Multiple Relations Visualizations

Dataset Relation Visualization

Conference Attendee Data Professor / Student Node-link social network graph

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Dataset Relation Visualization

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Dataset Relation Visualization

DA RA (DA )

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Dataset Relation Visualization

DA RA (DA ) Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Relation

RA (DA )

Dataset Visualization

DA Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Relation

RA (DA )

Dataset Visualization

Relation

R (D ) Vis  R (D ) DA B A A A A

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Visualization

Relation Vis A  RA (DA )

RA (DA )

Dataset Visualization

VisB  RA (DA ) Relation

R (D ) DA B A

Formalism for Multiple Relationship Visualization Comparison Formalizing Multiple Relations Visualizations

Visualization

Relation Vis A  RA (DA )

RA (DA )

Dataset Visualization

VisB  RA (DA ) Relation

R (D ) DA B A

Visualization

VisC  RB (DA) Formalism for Multiple Relationship Visualization Comparison Multiple Relation Visualizations

Individual Visualizations Coordinated Views Compound Graphs Semantic Substrates VisLink

Formalism for Multiple Relationship Visualization Comparison Individual Visualizations

 Any datasets, relations, and visualizations  Manually compare  e.g. different charts in Excel

Formalism for Multiple Relationship Visualization Comparison Coordinated Views

Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison Coordinated Views

Vis A  RA (DA ) Vis A  RB (DA )

Formalism for Multiple Relationship Visualization Comparison Coordinated Views

Vis A  RA (DA ) Vis A  RB (DA )

 Any datasets, relations, and visualizations  Interactive highlighting  e.g., Snap-Together Visualization (North & Shneiderman, 2000)

Formalism for Multiple Relationship Visualization Comparison Compound Graphs

Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison Compound Graphs

Vis A  RA (DA )  RB (DA )

Formalism for Multiple Relationship Visualization Comparison Compound Graphs

Vis A  RA, RB (DA )  Secondary relation has no spatial rights  e.g., Overlays on TreemapsUse of the(Fekete powerfulet al., 2003)spatial, ArcTrees dimension (Neumann et al., 2005), Hierarchicalto encode data Edge relationships. Bundles (Holten, 2006)

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

D A1

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

D A1

D A2 DA

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

D A1

D D A2 A …

D An

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

D D A1 A2

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

Vis  R (D ) Vis  R (D ) A A A1 A A A2

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

Vis  R (D ) Vis  R (D ) A A A1 A A A2

Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison Semantic Substrates

 Single visualization, single relation  Semantically meaningful data subsets  Spatial rights for all relations

(Shneiderman and Aris, 2006)

Formalism for Multiple Relationship Visualization Comparison VisLink

Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison VisLink

Vis A  RA (DA ) VisB  RB (DA )

Formalism for Multiple Relationship Visualization Comparison VisLink

Vis A  RA (DA ) VisB  RB (DA )

VisB  RA (DB )

Formalism for Multiple Relationship Visualization Comparison VisLink

Vis A  RA (DA ) VisB  RB (DA )

Vis AB T(RA (DA ), RB (DA ))

Formalism for Multiple Relationship Visualization Comparison VisLink

Vis AB T(RA (DA ), RB (DA ))  Visualize second order relations between visualizations  Across any datasets, relations, visualizations for which a relation can be defined  All component visualizations retain spatial rights

Formalism for Multiple Relationship Visualization Comparison VisLink & Semantic Substrates

Vis A  RA (DA ) Vis  R (D ) Vis A  RA (DA ) Vis  R (D ) 1 A A A2 B B A

Vis AB T(RA (DA ), RB (DA )) Vis A  RA (DA )

Formalism for Multiple Relationship Visualization Comparison VisLink & Semantic Substrates

Vis A  RA (DA ) Vis  R (D ) Vis A  RA (DA ) Vis  R (D ) 1 A A A2 B B A

Vis AB T(RA (DA ), RB (DA )) Vis A  RA (DA )

 Single visualization technique  Semantic subsets of data provide added meaning

Formalism for Multiple Relationship Visualization Comparison VisLink & Semantic Substrates

Vis A  RA (DA ) Vis  R (D ) Vis A  RA (DA ) Vis  R (D ) 1 A A A2 B B A

Vis AB T(RA (DA ), RB (DA )) Vis A  RA (DA )

 Any number of different relations and visualizations  Second order relations revealed in inter-plane edges

Formalism for Multiple Relationship Visualization Comparison Equivalency & Extension

Formalism for Multiple Relationship Visualization Comparison VisLink

VisLink Visualization VisLink Case Study: Lexical Data

WordNet IS-A hierarchy (R ) ? A Similarity clustering (RB) using using radial tree (Vis ) A force-directed layout (VisB)

VisLink Visualization Edge Detail

 Bundled: one-to-many edges  Smooth: Chaiken corner cutting  Transparent: bundles more opaque  Directed: orange-to-green

VisLink Visualization Interaction With Component Visualizations

 Always equivalent to 2D:  Planes are virtual displays  Mouse events transformed and passed to underlying visualization  Equivalent to 2D viewing mode

VisLink Visualization Interplane Edges

VisLink Visualization Zoom

VisLink Visualization Filter

VisLink Visualization Constrained Widget Interaction

VisLink Interaction 3D Navigation

VisLink Interaction Spreading Activation

 Nodes have a level of activation, indicated by transparency of orange node background  Full activation through:  Selecting a node on a plane  Node matches search query  Activation propagates through interplane edges, reflecting between planes with exponential drop-off  Enables inter-visualization queries  Edge transparency relative to source node activation

Spreading Activation Inter-Plane Query Example

2: synonym sets 1: alphabetic clusters

No synonym information No alphabetic organization

Q: Synonyms in the alphabetic view?

Spreading Activation Inter-Plane Query Example

1. Select a word on plane 1 2. Edges propagate to synonym sets on plane 2 3. Reflected edges propagate back, revealing synonyms in alphabetic clusters

1: similarity clusters 2: synonym sets

Spreading Activation Inter-Plane Query Example

1. Select a word on plane 1 2. Edges propagate to synonym sets on plane 2 3. Reflected edges propagate back, revealing synonyms in alphabetic clusters

1: similarity clusters 2: synonym sets

Spreading Activation Inter-Plane Query Example

1. Select a word on plane 1 2. Edges propagate to synonym sets on plane 2 3. Reflected edges propagate back, revealing synonyms in alphabetic clusters

1: similarity clusters 2: synonym sets

Spreading Activation Inter-Plane Query Example

1. Select a word on plane 1 2. Edges propagate to synonym sets on plane 2 3. Reflected edges propagate back, revealing synonyms in alphabetic clusters

1: similarity clusters 2: synonym sets

Spreading Activation Edge Reflection and Inter-Plane Queries

Spreading Activation Linking Existing Visualizations

Case Study Linking Existing Visualizations

Case Study Implementation

 Prefuse visualization toolkit (Heer et al., 2005)  Existing visualizations can be incorporated without changes  Interplane edges defined by (plane, node) index pairs  Java OpenGL

Case Study Perceptual Considerations

 Not all layouts equal  Colour interactions with edges and visualizations  3D perspective bias

Conclusion Future Work

 Application to additional analytic scenarios  Investigation of 3D edge bundling, edge lenses  Animation of spreading activation  Evaluation against existing multiple view techniques  Rich query language to filter visualization planes

Conclusion Summary

 Formalism to describe multi-relation visualizations  New way to reveal relationships amongst visualizations  Reuse of the powerful spatial visual dimension  Full 2D interactivity for constituent visualizations  Techniques to simplify 3D navigation  Visualization bridging through inter-representational queries and spreading activation

Conclusion VisLink: Revealing Relationships Amongst Visualizations

A CKNOWLEDGEMENTS : Gerald Penn, Petra Isenberg, Mark Hancock, Tobias Isenberg, Uta Hinrichs, and Matthew Tobiasz, and helpful reviewers for their advice.

Christopher Collins ([email protected]) & Sheelagh Carpendale ([email protected])