Teaching a Machine Beauty

Total Page:16

File Type:pdf, Size:1020Kb

Teaching a Machine Beauty Teaching a machine beauty Intelligent interactive evolution of abstract animations Wouter Deenik M.Sc. Thesis August 2017 Supervisors: dr. M. Poel dr. ir. D. Reidsma Abstract Generative art in the form of animations is used more and more in the current screen-filled world. If these animations would be generated with as much freedom as possible, some problems arise. More freedom means more ‘ugly’ animations are generated, and an ugly animation can get unpleasant to look at, in contrast to an ugly image. Also, to steer the algorithm towards better animations, human feedback is needed, but giving feedback on animations takes time. A system is proposed and developed which can generate diverse abstract animations, while minimizing the number of unpleasant animations in its output to (partly) solve the stated problems. This system uses a modified version of an algorithm developed by Karl Sims [1] to render the animations, a genetic algorithm to improve those animations and a neural network acting as a filter to reject unpleasant animations from the system’s output. Feedback is gathered using a custom developed feedback interface. The system is evaluated and the performance of the filtering component determined in terms of precision, recall and F score in several different tests. When a system without a neural network to reject unpleasant animations, and one with such a network are compared, the system with neural network shows significantly less unpleasant animations. The precision of the neural network in the different tests tends to be around 0.75, which means around one out of four animations that pass the filter is given the lowest rating by users. Without a filter, the precision of the system is on average around 0.66: one in three of the shown animations would get the lowest rating. This shows an increase in precision when a neural network is used to filter the animations. Some good animations are rejected too, but since the system has a near infinite ‘pool’ of animations to draw from, this is not considered as a big problem. Several different neural networks are tested, but only the learning rate seems to matter in terms of performance. However, the learning speed seems to depend much on the dataset used for training the neural network. 50-100 animations seem to be the minimum number to train an untrained network to a performance close to the 0.75 precision observed in other tests. Several suggestions are made on how to improve the system. Table of contents 1 Introduction ............................................................................................................. 4 2 Context ...................................................................................................................... 9 2.1 Preference in art ................................................................................................ 9 2.1.1 Static art ...................................................................................................... 9 2.1.2 Animations ................................................................................................ 11 2.2 User feedback methods ................................................................................... 11 2.2.1 Feedback scales ......................................................................................... 11 2.2.2 Reliability ................................................................................................. 12 2.2.3 Usability .................................................................................................... 12 2.2.4 Animations ............................................................................................... 13 2.3 State of the art .................................................................................................. 13 2.3.1 Electric Sheep ........................................................................................... 13 2.3.2 Milkdrop ................................................................................................... 14 2.3.3 Self-developed ......................................................................................... 15 2.3.4 Karl Sims ................................................................................................... 16 2.3.5 Differences ............................................................................................... 16 3 Design & Implementation .................................................................................... 18 3.1 Main goal & requirements ............................................................................ 18 3.2 System architecture........................................................................................ 19 3.2.1 Animation renderer ............................................................................... 20 3.2.2 Animation improvement ...................................................................... 20 3.2.3 Feedback gathering ................................................................................. 21 3.2.4 Filtering..................................................................................................... 21 3.3 Animation renderer ...................................................................................... 23 3.3.1 Choosing an algorithm .......................................................................... 23 3.3.2 The algorithm explained ....................................................................... 24 3.3.3 Implementation ...................................................................................... 26 1 3.3.4 Reflection ................................................................................................. 30 3.4 Animation Improvement ............................................................................. 32 3.4.1 Structure and methods .......................................................................... 32 3.4.2 Construction of generations .................................................................33 3.4.3 Settings ...................................................................................................... 35 3.4.4 Reflection .................................................................................................. 38 3.5 Feedback gathering ....................................................................................... 40 3.5.1 Scale .......................................................................................................... 40 3.5.2 Interface .................................................................................................... 41 3.5.3 Reflection .................................................................................................. 41 3.6 Filtering component ...................................................................................... 43 3.6.1 Method ..................................................................................................... 43 3.6.2 Feature extraction .................................................................................. 44 3.6.3 Machine learning algorithm ................................................................ 48 3.6.4 Reflection .................................................................................................. 51 4 Testing ..................................................................................................................... 52 4.1 Overview .......................................................................................................... 52 4.2 Test 1 .................................................................................................................. 55 4.2.1 Method ...................................................................................................... 56 4.2.2 Results ....................................................................................................... 59 4.3 Test 2 ................................................................................................................. 63 4.3.1 Method ...................................................................................................... 63 4.3.2 Results ...................................................................................................... 64 4.4 Test 3 ................................................................................................................. 68 4.4.1 Method ...................................................................................................... 68 4.4.2 Results ....................................................................................................... 68 5 Discussion .............................................................................................................. 70 5.1 REQ1 ................................................................................................................. 70 2 5.2 REQ2 ................................................................................................................ 70 5.3 REQ3 ................................................................................................................. 71 5.4 REQ4 ................................................................................................................. 71 5.5 REQ5 .................................................................................................................. 72 5.6 REQ6 ................................................................................................................. 72 6 Conclusion .............................................................................................................
Recommended publications
  • Fractal 3D Magic Free
    FREE FRACTAL 3D MAGIC PDF Clifford A. Pickover | 160 pages | 07 Sep 2014 | Sterling Publishing Co Inc | 9781454912637 | English | New York, United States Fractal 3D Magic | Banyen Books & Sound Option 1 Usually ships in business days. Option 2 - Most Popular! This groundbreaking 3D showcase offers a rare glimpse into the dazzling world of computer-generated fractal art. Prolific polymath Clifford Pickover introduces the collection, which provides background on everything from Fractal 3D Magic classic Mandelbrot set, to the infinitely porous Menger Sponge, to ethereal fractal flames. The following eye-popping gallery displays mathematical formulas transformed into stunning computer-generated 3D anaglyphs. More than intricate designs, visible in three dimensions thanks to Fractal 3D Magic enclosed 3D glasses, will engross math and optical illusions enthusiasts alike. If an item you have purchased from us is not working as expected, please visit one of our in-store Knowledge Experts for free help, where they can solve your problem or even exchange the item for a product that better suits your needs. If you need to return an item, simply bring it back to any Micro Center store for Fractal 3D Magic full refund or exchange. All other products may be returned within 30 days of purchase. Using the software may require the use of a computer or other device that must meet minimum system requirements. It is recommended that you familiarize Fractal 3D Magic with the system requirements before making your purchase. Software system requirements are typically found on the Product information specification page. Aerial Drones Micro Center is happy to honor its customary day return policy for Aerial Drone returns due to product defect or customer dissatisfaction.
    [Show full text]
  • Transformations in Sirigu Wall Painting and Fractal Art
    TRANSFORMATIONS IN SIRIGU WALL PAINTING AND FRACTAL ART SIMULATIONS By Michael Nyarkoh, BFA, MFA (Painting) A Thesis Submitted to the School of Graduate Studies, Kwame Nkrumah University of Science and Technology in partial fulfilment of the requirements for the degree of DOCTOR OF PHILOSOPHY Faculty of Fine Art, College of Art and Social Sciences © September 2009, Department of Painting and Sculpture DECLARATION I hereby declare that this submission is my own work towards the PhD and that, to the best of my knowledge, it contains no material previously published by another person nor material which has been accepted for the award of any other degree of the University, except where due acknowledgement has been made in the text. Michael Nyarkoh (PG9130006) .................................... .......................... (Student’s Name and ID Number) Signature Date Certified by: Dr. Prof. Richmond Teye Ackam ................................. .......................... (Supervisor’s Name) Signature Date Certified by: K. B. Kissiedu .............................. ........................ (Head of Department) Signature Date CHAPTER ONE INTRODUCTION Background to the study Traditional wall painting is an old art practiced in many different parts of the world. This art form has existed since pre-historic times according to (Skira, 1950) and (Kissick, 1993). In Africa, cave paintings exist in many countries such as “Egypt, Algeria, Libya, Zimbabwe and South Africa”, (Wilcox, 1984). Traditional wall painting mostly by women can be found in many parts of Africa including Ghana, Southern Africa and Nigeria. These paintings are done mostly to enhance the appearance of the buildings and also serve other purposes as well. “Wall painting has been practiced in Northern Ghana for centuries after the collapse of the Songhai Empire,” (Ross and Cole, 1977).
    [Show full text]
  • Guide to Digital Art Specifications
    Guide to Digital Art Specifications Version 12.05.11 Image File Types Digital image formats for both Mac and PC platforms are accepted. Preferred file types: These file types work best and typically encounter few problems. tif (TIFF) jpg (JPEG) psd (Adobe Photoshop document) eps (Encapsulated PostScript) ai (Adobe Illustrator) pdf (Portable Document Format) Accepted file types: These file types are acceptable, although application versions and operating systems can introduce problems. A hardcopy, for cross-referencing, will ensure a more accurate outcome. doc, docx (Word) xls, xlsx (Excel) ppt, pptx (PowerPoint) fh (Freehand) cdr (Corel Draw) cvs (Canvas) Image sizing specifications should be discussed with the Editorial Office prior to digital file submission. Digital images should be submitted in the final size desired. White space around the image should be removed. Image Resolution The minimum acceptable resolution is 200 dpi at the desired final size in the paged article. To ensure the highest-quality published image, follow these optimum resolutions: • Line = 1200 dpi. Contains only black and white; no shades of gray. These images are typically ink drawings or charts. Other common terms used are monochrome or 1-bit. • Grayscale or Color = 300 dpi. Contains no text. A photograph or a painting is an example of this type of image. • Combination = 600 dpi. Grayscale or color image combined with a line image. An example is a photograph with letter labels, arrows, or text added outside the image area. Anytime a picture is combined with type outside the image area, the resolution must be high enough to maintain smooth, readable text.
    [Show full text]
  • David Rosenberg's July 2013 / 2018 Interview with Miguel Chevalier
    David Rosenberg’s July 2013 / 2018 Interview with Miguel Chevalier Flows and Networks David Rosenberg: Can you tell me what led you, starting in the early 1980s, to use computer applications as a means of artistic expression? Miguel Chevalier: I was very much interested in the video work of the South Korean artist Nam June Paik and in Man Ray’s rayographs. And the work of Yves Klein and Lucio Fontana constituted at that time for me two forms of pictorial absolutism, but I did not yet clearly see how one could go beyond all those avant-garde movements. In the early 1980s, at the Fine Arts School in Paris, several of us young students asked ourselves what was to do done after all these “deconstructions” and negations of the field of art and painting. This was, need it be recalled, a time when, for example, Daniel Buren said he represented the “degree zero” of painting. For my part, I felt far removed from Graffiti Art, from Free Figuration, from the German Neo-Expressionists, and from the Italian painters who had gathered around the art critic Achille Bonito Oliva. I wanted to explore still-virgin territories and create a new form of composition with the help of computer applications. D.R.: You took a special set of courses in this area? M.C.: No, not at all. I really approached computers and programming as an artist and an autodidact. During this period, there was no instruction in these areas in art schools in France. D.R.: And how were your research efforts perceived? M.C.: With a lot of scepticism.
    [Show full text]
  • Glossaire Infographique
    Glossaire Infographique André PASCUAL [email protected] Glossaire Infographique Table des Matières GLOSSAIRE ILLUSTRÉ...............................................................................................................................................................1 des Termes techniques & autres,.....................................................................................................................................1 Prologue.......................................................................................................................................................................................2 Notice Légale...............................................................................................................................................................................3 Définitions des termes & Illustrations.......................................................................................................................................4 −AaA−...........................................................................................................................................................................................5 Aberration chromatique :..................................................................................................................................................5 Accrochage − Snap :........................................................................................................................................................5 Aérosol,
    [Show full text]
  • NANCE PATERNOSTER Digital Artist - Compositor - Instructor 503 • 621 • 1073
    NANCE PATERNOSTER Digital Artist - Compositor - Instructor 503 • 621 • 1073 OBJECTIVE: Working in a Creative Capacity for Apple Computer or Adobe Products Digital Compositing, Motion Graphics & Special Effects Animation Creating Digital Art & Animated Sequences Teaching in an Animation Department at an Art School EDUCATION: MA 1993 – San Francisco State University Masters in Computer & Film Animation/Video Disk Technology BFA 1984 - Syracuse University: Syracuse, New York Art Media Program: Computer Graphics Major/College of Visual & Performing Arts (Film, Video, Photo. & Computer Graphics/Programming - Fine Art Emphasis) Additional Computer Graphics Training: Art Institute of Portland - Maya Courses Academy of Art College 1994; Pratt Institute, N.Y., NY 1985; The School of Visual Art, NY 1984 N.Y. Institute of Technology 1984-1985; Pratt Brooklyn, 1985 Center for Electronics Arts, S.F., CA 1988-1989 COMPUTER GRAPHIC EQUIPMENT Platforms - Mac/SGI/PC Software - Flame, After Effects Photoshop, Illustrator, Painter, Quark Some - Maya, Max, Lightwave, Soft Image Xaos Tools - Pandemonium, NTITLE Some - Avid, Final Cut, Premiere Amazon Paint 2D/3D, PIRANHA Unix, Dos, + Some C++, Pascal, Fortran, Javascript , HTML Additional Photography, Stereo Photography. Analog and Digital Video editing, Film editing. RELATED WORK: Art Institute of Portland - Adjunct Faculty VEMG/DFV Depts. - Present Pacific Northwest College of Art - Adjunct Faculty - Present Art Institutes Online - Adjunct Faculty - Present Art Institutes Online- Full Time Faculty - Animation Department - 2006-2007 Art Institute of Portland - Full Time Faculty - Animation Department Teaching Compositing, Motion Graphics, Special FX Animation, Advanced Image Manipulation, Digital Paint, Independent Study for Senior Animation Students, & Digital Portfolio. 2000 - 2005 Art Institutes Online - Adjunct Faculty - Game Art & Design Department Teaching Digital Ink & Paint Online, 2D Animation, Image Manipulation.
    [Show full text]
  • THIAGO JOSÉ CÓSER Possibilidades Da Produção Artística Via
    THIAGO JOSÉ CÓSER Possibilidades da produção artística via prototipagem rápida: processos CAD/CAM na elaboração e confecção de obras de arte e o vislumbre de um percurso poético individualizado neste ensaio. Dissertação apresentada ao Instituto de Artes da Universidade Estadual de Campinas, para a obtenção do título de mestre em Artes. Área de concentração: Artes Visuais Orientador: Prof. Dr. Marco Antonio Alves do Valle Campinas 2010 3 FICHA CATALOGRÁFICA ELABORADA PELA BIBLIOTECA DO INSTITUTO DE ARTES DA UNICAMP Cóser, Thiago José. C89p Possibilidades da produção artística via Prototipagem Rápida: Processos CAD/CAM na elaboração e confecção de obras de arte e o vislumbre de um percurso poético individualizado neste ensaio. : Thiago José Cóser. – Campinas, SP: [s.n.], 2010. Orientador: Prof. Dr. Marco Antonio Alves do Valle. Dissertação(mestrado) - Universidade Estadual de Campinas, Instituto de Artes. 1. Prototipagem rápida. 2. Arte. 3. Sistema CAD/CAM. 4. Modelagem 3D. 5. escultura. I. Valle, Marco Antonio Alves do. II. Universidade Estadual de Campinas. Instituto de Artes. III. Título. (em/ia) Título em inglês: “Possibilities of Art via Rapid Prototyping: using CAD / CAM systems to create art works and a glimpse of a poetic route individualized essay.” Palavras-chave em inglês (Keywords): Rapid prototyping ; Art ; CAD/CAM systems. ; 3D modelling ; Sculpture. Titulação: Mestre em Artes. Banca examinadora: Prof. Dr. Marco Antonio Alves do Valle. Profª. Drª. Sylvia Helena Furegatti. Prof. Dr. Francisco Borges Filho. Prof. Dr. Carlos Roberto Fernandes. (suplente) Prof. Dr. José Mario De Martino. (suplente) Data da Defesa: 26-02-2010 Programa de Pós-Graduação: Artes. 4 5 Agradecimentos Ao meu orientador, profº Dr.
    [Show full text]
  • The Missing Link Between Information Visualization and Art
    Visualization Criticism – The Missing Link Between Information Visualization and Art Robert Kosara The University of North Carolina at Charlotte [email protected] Abstract of what constitutes visualization and a foundational theory are still missing. Even for the practical work that is be- Classifications of visualization are often based on tech- ing done, there is very little discussion of approaches, with nical criteria, and leave out artistic ways of visualizing in- many techniques being developed ad hoc or as incremental formation. Understanding the differences between informa- improvements of previous work. tion visualization and other forms of visual communication Since this is not a technical problem, a purely techni- provides important insights into the way the field works, cal approach cannot solve it. We therefore propose a third though, and also shows the path to new approaches. way of doing information visualization that not only takes We propose a classification of several types of informa- ideas from both artistic and pragmatic visualization, but uni- tion visualization based on aesthetic criteria. The notions fies them through the common concepts of critical thinking of artistic and pragmatic visualization are introduced, and and criticism. Visualization criticism can be applied to both their properties discussed. Finally, the idea of visualiza- artistic and pragmatic visualization, and will help to develop tion criticism is proposed, and its rules are laid out. Visu- the tools to build a bridge between them. alization criticism bridges the gap between design, art, and technical/pragmatic information visualization. It guides the view away from implementation details and single mouse 2 Related Work clicks to the meaning of a visualization.
    [Show full text]
  • Biological Agency in Art
    1 Vol 16 Issue 2 – 3 Biological Agency in Art Allison N. Kudla Artist, PhD Student Center for Digital Arts and Experimental Media: DXARTS, University of Washington 207 Raitt Hall Seattle, WA 98195 USA allisonx[at]u[dot]washington[dot]edu Keywords Agency, Semiotics, Biology, Technology, Emulation, Behavioral, Emergent, Earth Art, Systems Art, Bio-Tech Art Abstract This paper will discuss how the pictorial dilemma guided traditional art towards formalism and again guides new media art away from the screen and towards the generation of physical, phenomenologically based and often bio-technological artistic systems. This takes art into experiential territories, as it is no longer an illusory representation of an idea but an actual instantiation of its beauty and significance. Thus the process of making art is reinstated as a marker to physically manifest and accentuate an experience that takes the perceivers to their own edges so as to see themselves as open systems within a vast and interweaving non-linear network. Introduction “The artist is a positive force in perceiving how technology can be translated to new environments to serve needs and provide variety and enrichment of life.” Billy Klüver, Pavilion ([13] p x). “Art is not a mirror held up to reality, but a hammer with which to shape it.” Bertolt Brecht [2] When looking at the history of art through the lens of a new media artist engaged in several disciplines that interlace fields as varying as biology, algorithmic programming and signal processing, a fairly recent paradigm for art emerges that takes artistic practice away from depiction and towards a more systems based and biologically driven approach.
    [Show full text]
  • Colorization Algorithm Using Probabilistic Relaxation
    Colorization Algorithm Using Probabilistic Relaxation Takahiko HORIUCHI Department of Information and Image Sciences, Faculty of Engineering Chiba University 1-33, Yayoi-cho, Inage-ku, Chiba 263-8522, Japan Email: [email protected] TEL/FAX +81-43-290-3485 ABSTRACT: This paper presents a method of colorizing a black and white imagery based on the probabilistic relaxation algorithm. Since the colorization is an ill-posed problem, a user specifies a suitable color on each isolated pixel of an image as a prior information in this paper. Then other pixels in the image are colorized automatically. The colorizing process is done by assuming local Markov property on the images. By minimizing a total of RGB pixel-wise differences, the problem can be considered as a combinatorial optimization problem and it is solved by using the probabilistic relaxation. The proposed algorithm works very well when a few percent color pixels are known with confidence. Keywords – Colorization, probabilistic relaxation, Markov property, grayscale image Colorization Algorithm Using Probabilistic Relaxation 1. INTRODUCTION Colorization is a computerized process that adds color to a black and white print, movie and TV program, supposedly invented by Wilson Markle. It was initially used in 1970 to add color to footage of the moon from the Apollo mission. The demand of adding color to grayscale images such as BW movies and BW photos has been increasing. For example, in the amusement field, many movies and video clips have been colorized by human’s labor, and many grayscale images have been distributed as vivid images. In other fields such as archaeology dealing with historical grayscale data and security dealing with grayscale images by a crime prevention camera, we can imagine easily that colorization techniques are useful.
    [Show full text]
  • Digital Art & Design (DART)
    Digital Art & Design (DART) 1 DART-170 Digital Video Editing 3 Units DIGITAL ART & DESIGN (DART) 108 hours activity; 108 hours total Introduction to non-linear editing on the computer. Includes historical DART-101 Graphic Design Foundations 3 Units development, digital video and audio formats, techniques and theory 108 hours activity; 108 hours total of editing, aspect ratios, organization of the edit, desktop environment, Graphic Design Foundations is an introductory course with emphasis on importing digital elements, project organization, video and audio files, the foundations of the Graphic Arts. Course content includes concept non-linear editing skills, applying transitions, designing titles, applying development, design processes, production, presentation, technical skills filters, digital and time line effects, importing graphics, mixing audio and in both traditional and digital media, and solving visual communication video elements, synchronize sound with video, and exporting digital video problems. Projects include lettering/typography and layout/composition. projects. Transfers to both UC/CSU Transfers to both UC/CSU DART-120 Intro to Digital Art & Graphic Design 3 Units 36 hours lecture; 54 hours lab; 90 hours total Recommended Preparation: Completion of ARTS-101 with a minimum grade of C. This course provides an introduction to visual design concepts and contemporary professional practices in graphic art using industry- standard software including Adobe Photoshop, Illustrator and InDesign. Transfers to both UC/CSU DART-125 Animation 3 Units 36 hours lecture; 54 hours lab; 90 hours total An introductory course in the basic principles and technology of animation. Both traditional and alternative animation styles will be covered with an emphasis on creating effective sequences appropriate for the subject or narrative.
    [Show full text]
  • Extending Mandelbox Fractals with Shape Inversions
    Extending Mandelbox Fractals with Shape Inversions Gregg Helt Genomancer, Healdsburg, CA, USA; [email protected] Abstract The Mandelbox is a recently discovered class of escape-time fractals which use a conditional combination of reflection, spherical inversion, scaling, and translation to transform points under iteration. In this paper we introduce a new extension to Mandelbox fractals which replaces spherical inversion with a more generalized shape inversion. We then explore how this technique can be used to generate new fractals in 2D, 3D, and 4D. Mandelbox Fractals The Mandelbox is a class of escape-time fractals that was first discovered by Tom Lowe in 2010 [5]. It was named the Mandelbox both as an homage to the classic Mandelbrot set fractal and due to its overall boxlike shape when visualized, as shown in Figure 1a. The interior can be rich in self-similar fractal detail as well, as shown in Figure 1b. Many modifications to the original algorithm have been developed, almost exclusively by contributors to the FractalForums online community. Although most explorations of Mandelboxes have focused on 3D versions, the algorithm can be applied to any number of dimensions. (a) (b) (c) Figure 1: Mandelbox 3D fractal examples: (a) Mandelbox exterior , (b) same Mandelbox, but zoomed in view of small section of interior , (c) Juliabox indexed by same Mandelbox. Like the Mandelbrot set and other escape-time fractals, a Mandelbox set contains all the points whose orbits under iterative transformation by a function do not escape. For a basic Mandelbox the function to apply iteratively to each point �" is defined as a composition of transformations: �#$% = ��ℎ�������1,3 �������6 �# ∗ � + �" Boxfold and Spherefold are modified reflection and spherical inversion transforms, respectively, with parameters F, H, and L which are described below.
    [Show full text]