TIME AND ANIMATION

Petra Isenberg (&Pierre Dragicevic) TIME ANIMATION

2 TIME VISUALIZATION ANIMATION Time

3 VISUALIZATION OF TIME

4 TIME  Is just another data dimension  Why bother?

5 TIME  Is just another data dimension  Why bother?  What data type is it? • Nominal? • Ordinal? • Quantitative?

6 TIME  Ordinal

 Quantitative

• Discrete

• Continuous

Aigner et al, 2011 7 TIME

Joe Parry, 2007. Adapted from Mackinlay, 1986 8 TIME  Periodicity • Natural: days, seasons • Social: working hours, holidays • Biological: circadian, etc.  Has many subdivisions (units) • Years, months, days, weeks, H, M, S  Has a specific meaning • Not captured by data type • Associations, conventions • Pervasive in the real-world • Time visualizations often considered as a separate type

9 TIME Shneiderman: • 1-dimensional data • 2-dimensional data • 3-dimensional data • temporal data • multi-dimensional data • tree data • network data

10 VISUALIZING TIME

as a time point

11 VISUALIZING TIME

as a time period

12 VISUALIZING TIME

as a duration

13 VISUALIZING TIME

PLUS DATA

14 MAPPING TIME TO SPACE

15 MAPPING TIME TO AN AXIS

Time

Data

16 TIME-SERIES DATA  From a Statistics Book:

• A set of observations xt, each one being recorded at a specific time t

 From Wikipedia: • A sequence of data points, measured typically at successive time instants spaced at uniform time intervals

17 LINE

Aigner et al, 2011 18 LINE CHARTS Marey’s Physiological Recordings

Plethysmograph Étienne-Jules Marey, 1876

(image source)

Pneumogram Étienne-Jules Marey, 1876

(image source) 19 LINE CHARTS Pendulum Seismometer

(image source) Andrea Bina, 1751 Possibly also 17th century (source) 20 LINE CHARTS Inclinations of planetary orbits

Macrobius, 10th or 11th century cited in Kendall, 1990 21 Marey’s Train Schedule LINE CHARTS

6

LYON 7 22 Étienne-Jules Marey, 1885, cited in Tufte, 1983 OTHER CHARTS

Line Plots Point Plots

Silhouette Graphs Bar Charts

Aigner et al, 2011 23 OTHER CHARTS Combination - New York Times Weather

New York Times, 1980. Cited in Tufte, 1983 24

OTHER CHARTS Sparklines

Tufte, 2006. Cited in Aigner et al, 2011 26 OTHER CHARTS Color Encoding

Lam and Munzner ,2007 27

OTHER CHARTS Color Encoding - FFT Spectrum frequency

(image source) time 28 OTHER CHARTS Horizon Graphs

Reijner, 2008. Cited in Aigner et al, 2011 29 OTHER CHARTS Arc

Wattenberg, 2002 30 OTHER DATA TYPES

Time

Ordinal Data

31 OTHER

Rank Chart

32 Brinton, 1914. Cited in Aigner et al, 2001. [] OTHER Rank Chart

Hughes, 2009 33 OTHER DATA TYPES

Time

Proportions

34 Stacked Graph Area Chart OTHER CHARTS ThemeRiver StreamGraph

Stacked Area Chart unemployed

35 New York Times, 2009 Stacked Graph Area Chart OTHER CHARTS ThemeRiver StreamGraph

Stacked Area Chart employed

New York Times, 2009 36 OTHER CHARTS Stacked Area Chart

lastgraph.areacode.org 37 OTHER DATA TYPES

Time

Events

38 EVENTS  Like observations in time-series: • Data points with a time stamp  But: • Most often sparse and irregular • Data is mostly nominal • Can have a duration (start + end)

• Often, subjective / social data rather than physical measures

39 TIMELINES

Project Timeline

Aigner et al, 2011 40 TIMELINES

Gantt Chart

Gantt, 1913. Cited in Aigner et al, 2011 41 TIMELINES Planning Lines

Aigner et al, 2005 42 TIMELINES

Patient Data

Aigner et al, 2011 43 TIMELINES

Reigns of English Monarchs

Étienne-Jules Marey, 1885 (source) 44 TIMELINES Joseph Priestley, 1769 (source)

45

TIMELINES

historyshots.com, 2005 47 TIMELINES xkcd.com, 2009

Movie Narratives

[] 48 TIMELINES TimeNets

• \

Kim et al, 2010 49 MAPPING TIME TO AN AXIS

Time

Data

50 NON-LINEAR TIME AXES

Time

Data NON-LINEAR SCALE

Time NON-LINEAR SHAPE

51 NON-LINEAR TIME AXES Dual-Scale Charts

William Playfair, 1805. Cited in Aigner et al, 2011. 52 NON-LINEAR TIME AXES

Dual-Scale Charts

Regular Chart

Bifocal Chart Isenberg et al, 2011 53 NON-LINEAR TIME AXES

Other Types of Dual-Scale Charts

Lens Chart Broken Chart

Cut-Out Chart Superimposed Chart

Isenberg et al, 2011 54 NON-LINEAR TIME AXES

Logarithmic scale

Heinz von Foerster, 1994 (source) 55 NON-LINEAR

Curved

Megan Jaegerman, 1997 56 NON-LINEAR TIME AXES

Spiral

Webel et al, 2001 57 NON-LINEAR TIME AXES

Spiral

Aigner et al, 2011 58 NON-LINEAR TIME AXES

Grid

Beddow, 1990 59 NON-LINEAR TIME AXES

Grid - Calendar

Tom Haynes, 2010 60 NON-LINEAR TIME AXES Grid - Tile

Mintz et al, 1997. Cited in Aigner et al, 2011. 61 NON-LINEAR TIME AXES

Cycle Plots

Cleveland et al, 1978 63 NON-LINEAR TIME AXES

Cycle Plots

Cleveland et al, 1978 64 Trees

geschichtsbaum.de 65 Phylogenetic Tree

?

anonymous 66 NON-LINEAR TIME AXES

Phylogenetic Tree

evogeneao.com – based on Dawkins, The Ancestor’s Tale 67 NON-LINEAR TIME AXES

Trees – Branching time

Aigner et al, 2011. 68 MAPPING TIME TO AN AXIS

Time

INTERACTION?

Data

69 INTERACTION

Focus+Context - Simile Timeline

simile-widgets.org 70 INTERACTION

Focus+Context - Wall

Mackinlay, 1991 71 INTERACTION

Focus+Context - DateLens

Bederson et al, 2004 72 INTERACTION

Semantic Zooming - Midgaard

Schlechtweg and Miksch, 2004. Cited in Aigner et al, 2011 73 INTERACTION

Magic Lenses - ChronoLenses

Zhao et al, 2011 74 INTERACTION

Dynamic queries - Time Searcher

Hochheiser and Shneiderman, 2003 75

INTERACTION Temporal alignment – Lifelines 2

Wang et al, 2008

77 INTERACTION Temporal alignment – Lifelines 2

Wang et al, 2008

78 INTERACTION Temporal alignment + Aggregation – LifeFlow

Wongsuphasawat et al, 2011

79 MAPPING TIME TO SPACE

80 MAPPING TIME TO AN AXIS

Time

Data

81 MAPPING TIME TO AN AXIS

Time

Data

82 2D + TIME Space-Time Cube Model

Time

83 2D + TIME

Cassinelli, 2005 84 2D + TIME

Cassinelli, 2005 85 2D + TIME Time Flattening 1 Time

Time 2

86 2D + TIME

Long exposure photography

87 2D + TIME

Phillips Curve

Tufte, 1997. Cited in Aigner et al, 2001 88 2D + TIME

Trails

gapminder.org 89 2D + TIME

Napoleon’s Russian Campaign of 1812

Charles Joseph Minard, 1861. Cited in Tufte, 1983 90 2D + TIME

Flow

Tobler, 1987 Adrienko, 2011 91 2D + TIME

Discrete Time Flattening Time 1 Time 2

3 Time

92 2D + TIME

Marey’s Chronophotography Technique

(image source)

Étienne-Jules Marey, 1880s (source)

93 2D + TIME Sequences

94 Cited in Tufte, 1983 2D + TIME

Sequences

Megan Jaegerman. Cited in Tufte, 2007

95 2D + TIME

What about this?

(image source)

96 2D + TIME Time Juxtaposing Time 1 Time 2

3

97 2D + TIME Muybridge’s Chronophotography Technique

Eadweard J. Muybridge, 1878 (source) 98 2D + TIME

Comics

Understanding Comics: The invisible Art 99 Scott McCloud, 1993 2D + TIME

Comics

Understanding Comics: The invisible Art 100 Scott McCloud, 1993 2D + TIME Small Multiples

Tufte, 1983

101 (image source) 2D + TIME

Small Multiples

Aigner et al, 2011 102 2D + TIME

What about this?

(image source) [] 103 2D + TIME

What about this? Time 2 1 Time Canada

US

France

Time 3

104 2D + TIME Side-By-Side Views

105 2D + TIME

Side-By-Side Views

106 2D + TIME Space Cutting

1 Time 2 Time

3

107 2D + TIME

Slit-Scan Photography Time

Time (images source) 108 2D + TIME

Slit-Tear Exploration of Videos

Tang et al, 2009 (video) 109

2D + TIME Space Flattening 1 Time 2 Time

3

111 2D + TIME History Flow

Viegas et al, 2003 112 2D + TIME Sampling 1 Time 2 Time

3

113 2D + TIME

Multiple Silhouette Graphs

Andrienko and Adrienko, 2004 114 2D + TIME Planning Polygons

Shanbhag, 2005 115 2D + TIME

3D Rendering

1 Time 2

116 2D + TIME 3D visualizations - Kiviat Tube

Time

Aigner et al, 2011 117 2D + TIME

3D visualizations – 3D bar chart

Aigner et al, 2011 118 2D + TIME 3D visualizations – DIVA

Mackay and Beaudouin-Lafon, 1998 119 2D + TIME

3D visualizations – Climate data

Aigner et al, 2011 120 2D + TIME 3D visualizations – Time-evolving graphs

Brandes and Corman, 2002 121 2D + TIME

3D visualizations - Points Time

Aigner et al, 2011 122 2D + TIME

3D visualizations - Points

(video source) 123 2D + TIME

3D visualizations - Paths

Kraak, 2003. Cited in Aigner et al, 2011 124 2D + TIME 3D visualizations - GeoTime .com

125 2D + TIME 3D visualizations – Time-evolving graphs

Time

Brandes et al, 2004 126 MAPPING TIME TO SPACE

128 2D + TIME Colored Time Flattening Time 1 Time 2

Time 3

129 2D + TIME

Using Color – GEOVOL

Time

Collberg et al, 2003 130 2D + TIME

Using Color – Stroke Order

Time

User:Yug 131 MAPPING TIME TO AN AXIS

Time

2D Data

134 MAPPING TIME TO AN AXIS

Time

3D Data

135 3D + TIME Slicing + Juxtaposing – 3D Small Multiples

Tufte and Bushell, 2005 136 3D + TIME Flattening - FromDaDy

Hurter et al, 2009

137 3D + TIME Slicing & Flattening - Peter Jansen’s Sculptures

Peter Jansen. humanmotions.com 138 TIME VISUALIZATION

What’s Missing?

139 Animations

140 ANIMATION

141 ANIMATION  Static Visual Content • Visual content that is fixed over time

142 ANIMATION  Static Visual Content • Visual content that is fixed over time  Dynamic Visual Content • Visual content that changes over time

143 ANIMATION  Static Visual Content • Visual content that is fixed over time  Dynamic Visual Content • Visual content that changes over time  Interactive Visual Content • Visual content that changes over time • Under the user’s influence

145 ANIMATION  Static Visual Content • Visual content that is fixed over time  Dynamic Visual Content • Visual content that changes over time  Interactive Visual Content • Visual content that changes over time • Under the user’s influence  Animation • Visual content that changes over time • Outside the user’s influence

146 2D + TIME Animated Time Cutting Time 1 Time 2

3

147 2D + TIME

Movies and Cartoons

Eadweard J. Muybridge, 1879

148 2D + TIME

Zoopraxiscope

(image source) (image source)

Eadweard J. Muybridge, 1879

149 2D + TIME

Zoetrope

William G. Horner, 1833 also Ting Huan, 180 AD (source) 150 2D + TIME Animation – Gap Minder

(image source) gapminder.org 151 2D + TIME Animation – Gap Minder

(video source)

gapminder.org 152 2D + TIME

Animation vs. Other Approaches

(image source)

153 2D + TIME Animation vs. Other Approaches

(image source)

154 2D + TIME Animation vs. Other Approaches Small Multiples

Trails (Coloring + Flattening) Animation

155 2D + TIME Animation vs. Other Approaches

156 2D + TIME Time Slider – GapMinder

gapminder.org 157 TIME VISUALIZATION

Animations for conveying time-evolving data

ANIMATION

160 ANIMATIONS  For conveying time-evolving data

161 ANIMATIONS  For conveying time-evolving data

 For capturing users’ attention

 As an information channel

 For explaining transitions

162 ANIMATIONS  For conveying time-evolving data

 For capturing users’ attention

 As an information channel

 For explaining transitions

163 ANIMATIONS

Motion primitives as visual variables

Ware and Bobrow, 2006. Also see Bartram. 164 ANIMATIONS Motion primitives as visual variables

Ware and Bobrow, 2006. Also see Bartram. 165 ANIMATIONS

Rhythm as a

LINK

Samuel Huron, 2008 166 ANIMATIONS  For conveying time-evolving data

 For capturing users’ attention

 As an information channel

 For explaining transitions

167 ANIMATED TRANSITIONS

Change Blindness Demo

Rensink, 2002 168 ANIMATED TRANSITIONS

Change Blindness Demo

Rensink, 2002 169 ANIMATED TRANSITIONS

Change Blindness Demo – Try again

Rensink, 2002 170 ANIMATED TRANSITIONS

Understanding Visual Transitions visual disturbance

2

Visual Content 1

Time

171 ANIMATED TRANSITIONS

Understanding Visual Transitions

2

Visual Content 1

Time

172 ANIMATED TRANSITIONS

How many words were inserted?

175 ANIMATED TRANSITIONS

How many words were inserted? Try Again

176 ANIMATED TRANSITIONS

What has changed?

177 ANIMATED TRANSITIONS

What has changed? Try Again

178 ANIMATED TRANSITIONS

Understanding Visual Transitions

2

Visual Content 1

Time

179 ANIMATED TRANSITIONS

Understanding Visual Transitions

2

Visual Content 1

Time

180 ANIMATED TRANSITIONS

Understanding Visual Transitions

2

Visual Content 1

Time

181 ANIMATED TRANSITIONS Help when scrolling documents

Klein & Bederson, 2005 182 ANIMATED TRANSITIONS

Help when panning and zooming

Shanmugasundaram & Irani, 2008 183 ANIMATED TRANSITIONS Help when navigating document revisions

Chevalier et al, 2010 184 ANIMATED TRANSITIONS In faceted browsing - Pivot

Microsoft Pivot

185 ANIMATED TRANSITIONS In multidimensional exploration - ScatterDice

Elmqvist et al, 2009 186 ANIMATED TRANSITIONS

In charts – Baby Name Voyager

Wattenberg, 2005 187 ANIMATED TRANSITIONS

How to design them?

1. Interpolation problem: what to show in-between 2. Pacing problem: when to show it

189 ANIMATED TRANSITIONS

Designing Animated Transitions

Direct Interpolation

Staged Animation

Heer and Robertson, 2007 190 ANIMATED TRANSITIONS

Designing Animated Transitions

Dragicevic et al, 2011 191 ANIMATED TRANSITIONS Use them!

192 TIME VISUALIZATION

The End. ANIMATION

193 ACKNOWLEDG

Slides in were inspired and adapted from slides by • EMENTSPierre Dragicevic (Inria)