University of Art and Industrial Design Linz, Austria Department of Media Interface Cultures ART AND TECHNOLOGY AT PLAY A Practice-Based Exploration of Embodied Interaction by Eng. Lic. Tiago Miguel Santos Martins Advisors: Prof. Dr. C rista !ommerer", Prof. Dr. #uno M. Correia$ " Interface Cultures - University of Art and Industrial Design Linz $ Faculty of Sciences and Tec nology - New University of Lis)on ' is dissertation is su)mitted for t e degree of Doctor of P ilosop y Approved: .....................................… Linz, January 2017 For Mom, Pedro and Inci. Acknowledgements The author would like to thank all tho e who contri!uted to thi di ertation and the e"#erience, #ractice and works that u##orted it. First and $oremo t, a !i% heart$elt thanks to u#ervi ors Pro$. 'r. (hri ta )ommerer and Pro$ 'r. *uno (orreia, $or their role in tartin% it all, their #atience, continued en+ coura%ement and u##ort. Thanks al o to the e"cellent, creati&e and hard+workin% #eo#le who colla!orated on the works, (hri tina -eidecker, Thoma .a%ner, Andrea 0in%erle, 1icardo *a ci+ mento, Ma2a Jazbec, Ju tyna 0u!rycka, 3e ela Mihaylova, (laudio Pina, Tom 4ielin%, /ndrea (lemen , Inci+/na 0ohra#, (hiara 5 #o ito and Fa!ian .erfel. Thanks to the #eo#le o$ the Interface (ulture de#artment o$ the 6ni&ersity o$ Art and Indu trial de i%n in Linz, includin%, Pro$ 'r. Laurent Mi%nonneau, $or the %uidance with a en e o$ humour; Michaela 8rtner and 9ertrude -:rle !er%er $or their #rom#t u##ort7 all the %ood $riend I have made there ; o many o$ you<=7 and overall $or an amazin% environment to e"#eriment, create, di cover and %row. Thanks to the 'ela& ki 'om Trbovl>e and the #eo#le $rom Trbovl>e who #ut u# an awe+ ome how every year, o$$er a venue $or crazy idea and alway make me $eel at home when I am there. ?ou are my )lovenian $amily. Thanks to the #eo#le at the 'e i%n 1e earch La! o$ the 4erlin 6niver ity o$ the Art , $or #rovidin% an en%a%in% and #lea ant environment to work; to Tom 4ielin% and 9e + che Joo t $or the o##ortunity to work on )#eechle 7 to (orinna )chmidt $or her #rom#tne and o#timi m7 to @atharina 4redie , -annah Perner-Wil on and Ju i Mikkonen $or the e"#ert ti# 7 to Pauline 3ierne and Fa!rizio Lamoncha $or makin% everythin% even more $un. Thanks al o to 5liza!eth )charler and John 3on 4er%en $or their %reat hel#. Thanks al o to the #eo#le at the 5m#owerment In$ormatic %rou# o$ the 6niver ity o$ T uku!a, $or havin% me there and receivin% me o kindly, e #ecially Aki ?amada, Ma2a Jaz!ec and Monica Peru AuBa -ernCndez. Finally, thanks to my $riend and $amily $or the continued u##ort throu%hout the years7 and e #ecially D9rand#a" 3Btor, who i my hero. v Abstract Thi the i e"#lore the u e o$ 5m!odied Interaction and #lay$ulne a e$$ective cre+ ative trate%ie in the de i%n o$ human+machine interaction , em#loyed toward a + #ect o$ u a!ility and e"#re ivene o$ #artici#atory e"#erience and interactive art+ works. It $ocu e on a !ody o$ ori%inal works which include multimodal interface , in+ teracti&e narrati&e , video%ame , art in tallation , and critical de i%n conce#t . / a whole, the works con titute a critical re$lection u#on the normative de i%n o$ in+ $ormation and communication technolo%ie , a they addre #henomenolo%ical limit+ ation , hi%hli%ht ideolo%ie and #rovide e"#re i&e alternati&e E in a #lay$ul and em+ !odied way. / #ractice+!a ed a##roach to inAuiry wa cho en, u##ortin% the ituated e"#loration o$ o##ortunitie and #otential under the !ene$it o$ a holi tic and critical #ers#ective. Thi involved tance allowed the creative develo#ment o$ ori%inal and in$ormative e"+ #erience o$ human+com#uter interaction, a o##o ed to de i%n which iterate on e + ta!li hed #roduct %enre and #reconce#tion . /$ter introducin% the to#ic o$ technolo%y, 5m!odied Interaction and #lay$ulne , with em#ha i on a #ect that have erved to conte"tualize and/or in$orm the #racti+ tionerG a##roach, an account o$ each work’ ideation, develo#ment and outcome i o$$ered. 5ach account hi%hli%ht #eci$ic way in which em!odiment and #lay contri!+ uted toward the work’ ucce $ul a #ect , while chartin% the re earcherG #ro%re + ion throu%h di$$erent environment o$ creative #ractice, re$inement o$ techniAue and the develo#ment o$ a holi tic and critical a##roach. vii Table of Contents List of Figures..............................................................................................................................xii 1.INTRODUCTION..........................................................................................................................1 1.1 ·8!>ective................................................................................................................................................... 2 1.2 ·Methodolo%y............................................................................................................................................. I 1.2.1 ·Creative Practice a Re earch.........................................................................................................J 1.2.2 ·Paradi%m........................................................................................................................................... K 1.2.L ·Critical De i%n................................................................................................................................ 11 1.2.I ·/rt For The Ma e ........................................................................................................................ 1L 1.L ·)tructure................................................................................................................................................. 1J 2.TECHNOLOGY............................................................................................................................17 2.1 ·5volutionary Syner%ie .......................................................................................................................... 1M 2.2 ·Culture and Ma Production...............................................................................................................21 2.2.1 ·4lack Bo"e ..................................................................................................................................... 2L 2.2.2 ·Dome tication and A##ro#riation...............................................................................................2I 2.L ·*ew Media.............................................................................................................................................. 2N 2.L.1 ·.hat i New.................................................................................................................................... 2N 2.L.2 ·Partici#ation and Creation............................................................................................................2M 2.I ·/u%mentation......................................................................................................................................... 2K 2.I.1 ·Tool a E"ten ion ........................................................................................................................ L0 2.I.2 ·Cy!or% ........................................................................................................................................... L1 2.J ·Ma%ic and Enchantment........................................................................................................................ L2 2.J.1 ·Technolo%ical Su#er+#ower .........................................................................................................L2 2.J.2 ·Ma%ic, My tici m and Mi direction..............................................................................................LI 2.J.L ·The Technolo%y o$ Enchantment..................................................................................................LJ 2.N ·8verloaded............................................................................................................................................. LN 2.N.1 ·4eyond Evolution........................................................................................................................... LN 2.N.2 ·Co%nitive Load................................................................................................................................ LK 2.N.L ·Mo!ile Interaction.......................................................................................................................... I0 2.N.I ·1eachin% a Limit............................................................................................................................. I2 3.EM ODIED INTER!CTION........................................................................................................"# L.1 ·Tan%i!le Inter$ace ................................................................................................................................. IM L.2 ·.eara!le Inter$ace ............................................................................................................................... JL L.L ·8!>ect a Media.................................................................................................................................... JM L.L.1 ·Meanin%.......................................................................................................................................... JM L.L.2 ·Co%nition........................................................................................................................................ JK L.L.L ·Materiality and A%ency..................................................................................................................N1