TecnoLógicas Artículo de Investigación/Research Article ISSN-p 0123-7799 ISSN-e 2256-5337 Vol. 21, No. 41, pp. 81-102 Enero-abril de 2018 MindFluctuations: Poetic, Aesthetic and Technical Considerations of a Dance Spectacle Exploring Neural Connections MindFluctuations: consideraciones Poéticas, Estéticas y Técnicas de un Espectáculo de Baile Explorando Conexiones Neuronales Tania Fraga1 Recibido: 30 de septiembre de 2017 Aceptado: 23 de noviembre de 2017 Cómo citar / How to cite T. Fraga, MindFluctuations: Poetic, Aesthetic and Technical Considerations of a Dance Spectacle Exploring Neural Connections. TecnoLógicas, vol. 21, no. 41, pp. 81-102, 2018. © Copyright 2015 por autores y Tecno Lógicas Este trabajo está licenciado bajo una Licencia Internacional Creative Commons Atribución (CC BY) 1 Architect and artist, Ph.D. in Communication and Semiotics, Institute of Mathematics and Art of Sao Paulo, University of Brasilia, Sao Paulo-Brazil, [email protected] MindFluctuations: Poetic, Aesthetic and Technical Considerations of a Dance Spectacle Exploring Neural Connections Abstract In this era of co-evolution of humans and computers, we are witnessing a lot of fear that humanity will lose control and autonomy. This is a possibility. Another is the development of symbiotic systems among men and machines. To accomplish this goal, it is necessary to research ways to apply some key concepts that have a catalytic effect over such ideas. In the discussion of this hypothesis through the case study of the spectacle MindFluctuations— an experimental artwork exploring neural connections—we are looking for ways to develop them from conception to realization. The discussion also establishes a process of reflection on the design, development and production of this dance spectacle. This artwork uses a customized Java application, NumericVariations, to explore the quoted neural connections for spectacles, performances and site-specific installations. Its approach was made possible by recent neuroscience research and the development of a Brain Computer Interface (BCI) integrated with a virtual reality framework, which enable an experimental interactive virtual reality artwork to emerge. A neural helmet connected to the computer and entwined with mathematical procedures enabled a symbiosis of humans with computers. Keywords Computer Art, Algorithmic Art, Virtual Reality, Brain Computer Interface BCI, Java3DTM. Resumen En esta era de co-evolución de los seres humanos y las computadoras estamos presenciando mucho miedo de que la humanidad pierda el control y la autonomía. Esta es una posibilidad. Otro es el desarrollo de sistemas simbióticos entre el hombre y las máquinas. Para lograr este objetivo es necesario investigar formas de aplicar algunos conceptos clave capaces de tener un efecto catalizador sobre tales ideas. Al discutir esta posibilidad a través del estudio de caso del espectáculo MindFluctuations, una obra experimental que explora las conexiones neuronales, estamos buscando formas de desarrollarlas discutiendo este caso particular desde su concepción hasta su realización. También establece un proceso de reflexión sobre el diseño, desarrollo y producción de este espectáculo de danza. Esta obra de arte utiliza una aplicación personalizada, NumericVariations, para explorar las conexiones neuronales citadas para espectáculos, actuaciones e instalaciones específicas del sitio. Su enfoque fue posible gracias a la reciente investigación en neurociencia y al desarrollo de una Interfaz de Computadora Cerebral (BCI) integrada con un marco de realidad virtual, que permitió que surgiera una obra experimental de realidad virtual interactiva. Un casco neuronal, conectado a la computadora y entrelazado con procedimientos matemáticos, propició una simbiosis de seres humanos con computadoras. Palabras clave Arte informático, Arte algorítmico, Realidad virtual, Interfaz informática de cerebro BCI, Java3DTM. [82] TecnoLógicas, ISSN-p 0123-7799 / ISSN-e 2256-5337, Vol. 21, No. 41, enero-abril de 2018, pp. 81-102 MindFluctuations: Poetic, Aesthetic and Technical Considerations of a Dance Spectacle Exploring Neural Connections 1. INTRODUCTION ing number of artists who are using cus- tomized software and hardware developed In this era of co-evolution of humans for artistic goals, opening a large field of and computers, we are witnessing a lot of possibilities for artworks produced through fear that humanity will lose control and computer coding. “Usually such artworks autonomy. This is a possibility. Another is are evaluated with past criteria that deny the development of symbiotic systems their main characteristics, which are to be among men and machines. “Symbiosis is a what they never were before. Therefore, state found in Nature in which two or more such artworks have to be approached with organisms act in complementary ways to different evaluation methods. There are achieve survival (…). From my point of many differences between computer art- view, the possibility of deeply interacting works and other means of creating art. with machines, to be turned inside out by There are convergences and divergences seeing my own mind fluctuations translat- which are not at the focus here. The pre- ed into something through the action of a sent approach does not intend to enhance computer is fascinating. By externalizing a one kind of art by depreciating the other” few emotional states and thought process- as quoted in [4] (p 186), but rather under- es, facing the fluctuations of one’s own stand the singular aspects that character- mind it may be possible to glimpse at this ize a spectacle, an installation or a perfor- mysterious, unfathomable process we call mance using real-time virtual reality, as 'thought' [1]. I do not believe machines will described in [5]. substitute humans but, since they are built It is important to note that “similar to mirroring 'humans' own decision and rea- traditional artworks, computer artworks soning processes [2], they have had an are poetic and aesthetic creations of hu- increasingly complementary role in human man minds evoking emotions, sensations lives. Such role I have called symbiosis” as and a labyrinth of representations and, cited in [3], (p 3). However, it is not the sometimes, ambiguities and paradoxes. goal of this article to focus on symbiosis. These subjective sets intensify mental Here it is only necessary to point out its connections allowing the human sensory importance as a key concept for the specta- apparatus to be entwined with mathemat- cle set up, since it is able to have a catalyst ics. They establish different relationships effect over the spectacle’s development. causing different readings. Therefore, nu- In the discussion of this possibility merical relations and functions are woven through the case study of the spectacle with sensory experiences and the results MindFluctuations, we are looking for are not always predictable”, as cited in [4] ways to understand what Roy Ascott de- (p 186). fines as the confluence of dry computation- The spectacle MindFluctuations has al systems with wet biological ones. This been designed in conjunction with the particular case study is discussed from American choreographer Maida Withers conception to realization. This spectacle and premiered on March 19th, 2015, in was quite complex and involved several Washington DC. It will happen in the fu- professionals such as musicians, choreog- ture in site-specific installations and per- raphers, dancers, light designer, stage formances. To achieve neural connections manager, sculptor, programmers and sci- with poetic and aesthetic expressions, this entists from various fields, among others. artwork searched for ways to use neural Computer Art has existed for more than data and other related procedures able to 60 years but there still is a lot of resistance be translated by numbers, a procedure in the art world to appraise it as an art described in [3]. form. In the meantime, there is an increas- TecnoLógicas, ISSN-p 0123-7799 / ISSN-e 2256-5337, Vol. 21, No. 41, enero-abril de 2018, pp. 81-102 [83] MindFluctuations: Poetic, Aesthetic and Technical Considerations of a Dance Spectacle Exploring Neural Connections In this spectacle, the dancers wore two other similar software, EpicurusGarden, neural helmets to capture data related to described in [15]. They have stated several their emotional states. After these states times that such awareness constantly were scanned and used as input, they were arose in their minds during the interaction interpreted by the computer and influ- with similar virtual worlds. Several as- enced virtual scenarios projected over a pects of this software and its brain com- screen on the backstage. The resulting puter interface (BCI) are presented in the scenarios are artificially alive systems section titled “The application Numer- allowing the dancers to “symbiotically icVariations”. interfere in the algorithmic nature of arti- In these realms, affective fields emerge ficial 'seeds'”, as cited in [6] (p. 169). Com- and their sensory stimuli establish a com- posers and musicians John Driscoll and plex network of data and relationships. Steve Hilmy performed the music live in a They create many possible configurations sound environment created with robotic that may or may not have been foreseen by instruments and electronic music. the artist-programmer as made explicit in Many conceptual, aesthetic and poetic [4]. Since computer languages were not aspects of other similar works have been