Dynamic Generation of Musical Notation from Musicxml Input on an Android Tablet

Total Page:16

File Type:pdf, Size:1020Kb

Dynamic Generation of Musical Notation from Musicxml Input on an Android Tablet Dynamic Generation of Musical Notation from MusicXML Input on an Android Tablet THESIS Presented in Partial Fulfillment of the Requirements for the Degree Master of Science in the Graduate School of The Ohio State University By Laura Lynn Housley Graduate Program in Computer Science and Engineering The Ohio State University 2012 Master's Examination Committee: Rajiv Ramnath, Advisor Jayashree Ramanathan Copyright by Laura Lynn Housley 2012 Abstract For the purpose of increasing accessibility and customizability of sheet music, an application on an Android tablet was designed that generates and displays sheet music from a MusicXML input file. Generating sheet music on a tablet device from a MusicXML file poses many interesting challenges. When a user is allowed to set the size and colors of an image, the image must be redrawn with every change. Instead of zooming in and out on an already existing image, the positions of the various musical symbols must be recalculated to fit the new dimensions. These changes must preserve the relationships between the various musical symbols. Other topics include the laying out and measuring of notes, accidentals, beams, slurs, and staffs. In addition to drawing a large bitmap, an application that effectively presents sheet music must provide a way to scroll this music across a small tablet screen at a specified tempo. A method for using animation on Android is discussed that accomplishes this scrolling requirement. Also a generalized method for writing text-based documents to describe notations similar to musical notation is discussed. This method is based off of the knowledge gained from using MusicXML. 3 Dedication This document is dedicated to my family. 4 Acknowledgments I thank my advisor, Rajiv Ramnath, for all his help and guidance in the completion of this project and thesis. I also thank Peter Rogers and Tony Wells for their vision and support. I additionally thank Michael Jewitt for his role as my teammate for the initial part of my project. 5 Vita May 2007 .......................................................Avon Lake High School June 2011 ......................................................B.S. Computer and Information Science, The Ohio State University September 2011 - present ..............................Graduate Student, Department of Computer Science and Engineering, The Ohio State University Fields of Study Major Field: Computer Science and Engineering 6 Table of Contents Abstract ............................................................................................................................... 3 Dedication ........................................................................................................................... 4 Acknowledgments............................................................................................................... 5 Vita ...................................................................................................................................... 6 Fields of Study .................................................................................................................... 6 Table of Contents ................................................................................................................ 7 List of Tables and Figures................................................................................................... 9 Chapter 1: Introduction ..................................................................................................... 10 1.1: Organization of this Document .............................................................................. 12 Chapter 2: Background Information ................................................................................. 13 2.1: Basic Sheet Music Description .............................................................................. 13 2.2: Android ViewGroups and Layouts ........................................................................ 16 2.3: Visual Impairments and Music .............................................................................. 17 Chapter 3: Related Research ............................................................................................. 19 Chapter 4: Implementation ............................................................................................... 23 4.1: Music Data Structure.............................................................................................. 24 7 4.2: Layout/ViewGroup Hierarchy ............................................................................... 25 4.3: Measure Width ....................................................................................................... 26 4.4: Note Placement ...................................................................................................... 26 4.5: Laying Out and Measuring Accidentals ................................................................. 28 4.6: Laying Out Beams.................................................................................................. 29 4.7: Laying Out Slurs and Ties...................................................................................... 30 4.8: Multiple-Staff Layout and Overlap ........................................................................ 32 4.9: Maximizing Tablet Screen Space........................................................................... 33 4.10: Method for Nesting Inside Android Relative Layouts ......................................... 35 4.11: Drawing Musical Symbols ................................................................................... 37 4.12: Color Changes ...................................................................................................... 38 4.13: Smooth Scrolling .................................................................................................. 38 Chapter 5: Insights in Text to Image Generation .............................................................. 40 Chapter 6: Conclusions ..................................................................................................... 44 6.1: Contributions .......................................................................................................... 44 6.2: Future Work ........................................................................................................... 44 Works Cited ...................................................................................................................... 46 8 List of Tables and Figures Figure 1: Simple Note and Rest Durations ....................................................................... 14 Figure 2: Beamed Eighth Notes ........................................................................................ 15 Figure 3: Labeled Music ................................................................................................... 16 Figure 4: Music Data Structure ......................................................................................... 24 Figure 5: Layout Hierarchy ............................................................................................... 25 Figure 6: Distance Between Lines is 1/14th of the Height ............................................... 27 Figure 7: Accidentalview .................................................................................................. 28 Figure 8: Beamviews ........................................................................................................ 29 Figure 9: Overlapping whitespace .................................................................................... 32 Figure 10: Two Parts Versus One Part ............................................................................. 34 Figure 11: Dotted Half Note, Rest, Petal, Fermata, Treble clef........................................ 37 Figure 12: MusicXML Excerpt ......................................................................................... 41 9 Chapter 1: Introduction It is currently standard for sheet music to be created in a one-size-fits-all paper format. This music is printed and distributed in music stores and available online for musicians to print out. It contains black print on white paper, and is generally printed on 9x12 inch paper with staff lines 1/16th of an inch apart. While this may be an acceptable format for the average music reader, it is not adequate for readers with low vision. Also some people prefer music in a different color scheme than black on white. Some people with visual impairments prefer white on black or yellow on black. People with cataracts read faster with white text on a black background (Elliott). These issues motivate a solution of dynamically generating sheet music in a desired size and color set by the user. To make this process easier for the user, an application that runs on a tablet device can be used to allow the user to set these parameters and immediately see the regenerated music. This thesis focuses on the process of generating musical notation on an Android tablet from a text-based input and displaying it to the user. This thesis describes the algorithms and data structures used to create an application that inputs a MusicXML file and displays the corresponding musical notation on an Android 3.0 tablet in a size and color scheme specified at run time. This thesis has several goals. The first is to create an application that is capable of reading in the MusicXML format on an Android tablet and displaying the notes and symbols in musical notation.
Recommended publications
  • Recommended Formats Statement 2019-2020
    Library of Congress Recommended Formats Statement 2019-2020 For online version, see https://www.loc.gov/preservation/resources/rfs/index.html Introduction to the 2019-2020 revision ....................................................................... 2 I. Textual Works and Musical Compositions ............................................................ 4 i. Textual Works – Print .................................................................................................... 4 ii. Textual Works – Digital ................................................................................................ 6 iii. Textual Works – Electronic serials .............................................................................. 8 iv. Digital Musical Compositions (score-based representations) .................................. 11 II. Still Image Works ............................................................................................... 13 i. Photographs – Print .................................................................................................... 13 ii. Photographs – Digital ................................................................................................. 14 iii. Other Graphic Images – Print .................................................................................... 15 iv. Other Graphic Images – Digital ................................................................................. 16 v. Microforms ................................................................................................................
    [Show full text]
  • Basics Music Principles E-Book
    Basic Music Principles (e-book edition) Copyright © 2011-2013 by Virtual Sheet Music Inc. All rights reserved. No part of this e-book shall be reproduced or included in a derivative work without written permission from the publisher. It can be shared instead anywhere on the web or on printed media in its entirety. No patent liability is assumed with respect to the use of the information contained herein. Although every precaution has been taken in the preparation of this e-book, the publisher and authors assume no responsibility for errors or omissions. Neither is any liability assumed for damages resulting from the use of the information contained herein. REMEMBER! YOU ARE WELCOME TO SHARE AND DISTRIBUTE THIS BOOK ANYWHERE! Trademarks All terms mentioned in this e-book that are known to be trademarks or service marks have been appropriately capitalized. Publisher cannot attest to the accuracy of this information. Use of a term in this e-book should not be regarded as affecting the validity of any trademark or service mark. Virtual Sheet Music® and Classical Sheet Music Downloads® are registered trademarks in USA and other countries. Warning and Disclaimer Every effort has been made to make this e-book as complete and as accurate as possible, but no warranty is implied. The information provided is on an “as is” basis. The authors and the publisher shall have neither liability nor responsibility to any person or entity with respect to any loss or damages arising from the information contained in this e-book. The E-Book’s Website Find out more, contact the author and discuss this e-book at: http://www.virtualsheetmusic.com/books/basicmusicprinciples/ Published by Virtual Sheet Music Inc.
    [Show full text]
  • Musical Genres - Styles and Eras
    Musical Genres - Styles and Eras. Classifying music into various genres does not have a right or wrong system. There are many genres & subgenres, and different ways of classifying music. At the broadest level, we can talk about music as being part of the Classical, Folk, Jazz, or World Music traditions. This resource touches [very briefly] on the Classical Music tradition. Typically when people talk about “classical music” they are referring to music written in the European tradition, though of course, this music could now be written anywhere in the world. Classical music can be written in a number of different styles, and the date when it was written can give a strong hint about which style it is in. In broad terms the Medieval era runs up until 1400BC, the Renaissance from 1400-1600, the Baroque era from 1600-1750, the Classical from 1750-1820 (ish), and the Romantic era from 1810-1910. The current Modern classical period run from around the start of the twentieth century and is further complicated by being subcategorized into a shed-load of different styles. Sorry. Does it matter? Yes! (and No). The thing is, some folk (ok, Teachers [and examiners!]) can get very sniffy if music from one period is played in the wrong manner. Think of an opera singer trying to do rap music. IT JUST DOESN’T SOUND RIGHT. It’s not Authentic. The reason why the answer might be “No”, is that music is about having fun, and being playful & creative, and sometimes it just works even when it shouldn’t.
    [Show full text]
  • The Music Encoding Initiative As a Document-Encoding Framework
    12th International Society for Music Information Retrieval Conference (ISMIR 2011) THE MUSIC ENCODING INITIATIVE AS A DOCUMENT-ENCODING FRAMEWORK Andrew Hankinson1 Perry Roland2 Ichiro Fujinaga1 1CIRMMT / Schulich School of Music, McGill University 2University of Virginia [email protected], [email protected], [email protected] ABSTRACT duplication of effort that comes with building entire encoding schemes from the ground up. Recent changes in the Music Encoding Initiative (MEI) In this paper we introduce the new tools and techniques have transformed it into an extensible platform from which available in MEI 2011. We start with a look at the current new notation encoding schemes can be produced. This state of music document encoding techniques. Then, we paper introduces MEI as a document-encoding framework, discuss the theory and practice behind the customization and illustrates how it can be extended to encode new types techniques developed by the TEI community and how their of notation, eliminating the need for creating specialized application to MEI allows the development of new and potentially incompatible notation encoding standards. extensions that leverage the existing music document- 1. INTRODUCTION encoding platform developed by the MEI community. We also introduce a new initiative for sharing these The Music Encoding Initiative (MEI)1 is a community- customizations, the MEI Incubator. Following this, we driven effort to define guidelines for encoding musical present a sample customization to illustrate how MEI can documents in a machine-readable structure. The MEI be extended to more accurately capture new and unique closely mirrors work done by text scholars in the Text music notation sources.
    [Show full text]
  • TIME SIGNATURES, TEMPO, BEAT and GORDONIAN SYLLABLES EXPLAINED
    TIME SIGNATURES, TEMPO, BEAT and GORDONIAN SYLLABLES EXPLAINED TIME SIGNATURES Time Signatures are represented by a fraction. The top number tells the performer how many beats in each measure. This number can be any number from 1 to infinity. However, time signatures, for us, will rarely have a top number larger than 7. The bottom number can only be the numbers 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, et c. These numbers represent the note values of a whole note, half note, quarter note, eighth note, sixteenth note, thirty- second note, sixty-fourth note, one hundred twenty-eighth note, two hundred fifty-sixth note, five hundred twelfth note, et c. However, time signatures, for us, will only have a bottom numbers 2, 4, 8, 16, and possibly 32. Examples of Time Signatures: TEMPO Tempo is the speed at which the beats happen. The tempo can remain steady from the first beat to the last beat of a piece of music or it can speed up or slow down within a section, a phrase, or a measure of music. Performers need to watch the conductor for any changes in the tempo. Tempo is the Italian word for “time.” Below are terms that refer to the tempo and metronome settings for each term. BPM is short for Beats Per Minute. This number is what one would set the metronome. Please note that these numbers are generalities and should never be considered as strict ranges. Time Signatures, music genres, instrumentations, and a host of other considerations may make a tempo of Grave a little faster or slower than as listed below.
    [Show full text]
  • Chapter 1 "The Elements of Rhythm: Sound, Symbol, and Time"
    This is “The Elements of Rhythm: Sound, Symbol, and Time”, chapter 1 from the book Music Theory (index.html) (v. 1.0). This book is licensed under a Creative Commons by-nc-sa 3.0 (http://creativecommons.org/licenses/by-nc-sa/ 3.0/) license. See the license for more details, but that basically means you can share this book as long as you credit the author (but see below), don't make money from it, and do make it available to everyone else under the same terms. This content was accessible as of December 29, 2012, and it was downloaded then by Andy Schmitz (http://lardbucket.org) in an effort to preserve the availability of this book. Normally, the author and publisher would be credited here. However, the publisher has asked for the customary Creative Commons attribution to the original publisher, authors, title, and book URI to be removed. Additionally, per the publisher's request, their name has been removed in some passages. More information is available on this project's attribution page (http://2012books.lardbucket.org/attribution.html?utm_source=header). For more information on the source of this book, or why it is available for free, please see the project's home page (http://2012books.lardbucket.org/). You can browse or download additional books there. i Chapter 1 The Elements of Rhythm: Sound, Symbol, and Time Introduction The first musical stimulus anyone reacts to is rhythm. Initially, we perceive how music is organized in time, and how musical elements are organized rhythmically in relation to each other. Early Western music, centering upon the chant traditions for liturgical use, was arhythmic to a great extent: the flow of the Latin text was the principal determinant as to how the melody progressed through time.
    [Show full text]
  • Scanscore 2 Manual
    ScanScore 2 Manual Copyright © 2020 by Lugert Verlag. All Rights Reserved. ScanScore 2 Manual Inhaltsverzeichnis Welcome to ScanScore 2 ..................................................................................... 3 Overview ...................................................................................................... 4 Quickstart ..................................................................................................... 4 What ScanScore is not .................................................................................... 6 Scanning and importing scores ............................................................................ 6 Importing files ............................................................................................... 7 Using a scanner ............................................................................................. 7 Using a smartphone ....................................................................................... 7 Open ScanScore project .................................................................................. 8 Multipage import ............................................................................................ 8 Working with ScanScore ..................................................................................... 8 The menu bar ................................................................................................ 8 The File Menu ............................................................................................ 9 The
    [Show full text]
  • SCOPE and SEQUENCE for Instrumental Music Program
    Poway Unified School District Instrumental Music Scope and Sequence – Grades 5 through 12 The mission of the Poway Unified School District Instrumental Music Program is to provide a quality music education for students. Through the development of rhythmic, melodic, and expressive senses, utilizing a variety of musical repertoire and technology, students will work together to achieve common goals to: • Improve the individual musical performance and ensemble skills of its members • Strengthen an awareness of the value and tradition of music in our individual and collective lives • Develop strong leaders, who will become productive, resilient and innovative members of society • Reinforce long term ensemble participation as a tool for college readiness • Reinforce learning through explicit teaching for transfer across the curriculum GRADE RHYTHMIC SENSE MELODIC SENSE EXPRESSIVE SENSE Understanding rhythms, beats groupings, Understanding notes, pitch, and sound in Understanding expressive qualities that and time signatures for artistic purpose relation to artistic expression transform music into artistic experiences 5 Notes – quarter, half, dotted half, whole, • Introduction to note reading (knowing • Dynamics – piano, mezzo piano, mezzo paired eighth note names and fingering/position) forte, forte, crescendo, decrescendo Rests – quarter, half, whole, multiple • Major key signatures and scales (one • Tempo – Andante, Adagio, Moderato, measure rest octave, two octave within reason) Allegro, fermata Time Signature – 4/4 (Common Time), 3/4, -
    [Show full text]
  • Introduction to Music Theory
    Introduction to Music Theory This pdf is a good starting point for those who are unfamiliar with some of the key ​ concepts of music theory. Reading musical notation Musical notation (also called a score) is a visual representation of the pitched notes ​ ​ heard in a piece of music represented by dots over a set of horizontal staves. In the top ​ ​ example the symbol to the left of the notes is called a treble clef and in the bottom ​ ​ example is called a bass clef. ​ ​ People often like to use a mnemonic to help remember the order of notes on each clef, ​ ​ here is an example. ​ Intervals An interval is the difference in pitch between two notes as defined by the distance ​ ​ ​ between the two notes. The easiest way to visualise this distance is by thinking of the notes on a piano keyboard. For example, on a C major scale, the interval from C to E is ​ ​ a 3rd and the interval from C to G is a 5th. Click here for some more interval examples. ​ ​ It is also common for an increase by one interval to be called a half­step, or ​ ​ ​ ​ semi­tone, and an increase by two intervals to be called a whole step, or tone. ​ ​ ​ ​ ​ ​ ​ Joe Rees­Jones, University of York, Department of Electronics 19/08/2016 Major and minor scales A scale is a set of notes from which melodies and harmonies are constructed. There are two main subgroups of scales: Major and minor. The type of scale is dependant on the ​ ​ ​ ​ intervals between the notes: Major scale ­ Tone, Tone, Semi­tone, Tone, Tone, Tone, Semi­tone ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Minor scale ­ Tone, Semi­tone, Tone, Tone, Semi­tone, Tone, Tone ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ For example (by visualising a keyboard) the notes in C Major are: CDEFGAB, and C Minor are: CDE♭FGA♭B♭.
    [Show full text]
  • Methodology and Technical Methods
    Recordare MusicXML: Methodology and Technical Methods Michael Good Recordare LLC Los Altos, California, USA [email protected] 17 November 2006 Copyright © 2006 Recordare LLC 1 Outline Personal introduction What is MusicXML? Design methodology Technical methods MusicXML use today Suitability for digital music editions Recommendations Future directions 17 November 2006 Copyright © 2006 Recordare LLC 2 My Background B.S. and M.S. in computer science from Massachusetts Institute of Technology B.S. thesis on representing scores in Music11 Trumpet on MIT Symphony Orchestra recordings available on Vox/Turnabout Opera and symphony chorus tenor; have performed for Alsop, Nagano, Ozawa Worked in software usability at SAP and DEC before founding Recordare in 2000 17 November 2006 Copyright © 2006 Recordare LLC 3 What is MusicXML? The first standard computer format for common Western music notation Covers 17th century onwards Available via a royalty-free license Supported by over 60 applications, including Finale, Sibelius, capella, and music scanners Useful for music display, performance, retrieval, and analysis applications Based on industry standard XML technology 17 November 2006 Copyright © 2006 Recordare LLC 4 The Importance of XML XML is a language for developing specialized formats like MusicXML, MathML, and ODF XML files can be read in any computer text editor Fully internationalized via Unicode The files are human readable as well as machine readable Each specialized format can use standard XML tools Allows musicians to leverage the large
    [Show full text]
  • Composers' Bridge!
    Composers’ Bridge Workbook Contents Notation Orchestration Graphic notation 4 Orchestral families 43 My graphic notation 8 Winds 45 Clefs 9 Brass 50 Percussion 53 Note lengths Strings 54 Musical equations 10 String instrument special techniques 59 Rhythm Voice: text setting 61 My rhythm 12 Voice: timbre 67 Rhythmic dictation 13 Tips for writing for voice 68 Record a rhythm and notate it 15 Ideas for instruments 70 Rhythm salad 16 Discovering instruments Rhythm fun 17 from around the world 71 Pitch Articulation and dynamics Pitch-shape game 19 Articulation 72 Name the pitches – part one 20 Dynamics 73 Name the pitches – part two 21 Score reading Accidentals Muddling through your music 74 Piano key activity 22 Accidental practice 24 Making scores and parts Enharmonics 25 The score 78 Parts 78 Intervals Common notational errors Fantasy intervals 26 and how to catch them 79 Natural half steps 27 Program notes 80 Interval number 28 Score template 82 Interval quality 29 Interval quality identification 30 Form Interval quality practice 32 Form analysis 84 Melody Rehearsal and concert My melody 33 Presenting your music in front Emotion melodies 34 of an audience 85 Listening to melodies 36 Working with performers 87 Variation and development Using the computer Things you can do with a Computer notation: Noteflight 89 musical idea 37 Sound exploration Harmony My favorite sounds 92 Harmony basics 39 Music in words and sentences 93 Ear fantasy 40 Word painting 95 Found sound improvisation 96 Counterpoint Found sound composition 97 This way and that 41 Listening journal 98 Chord game 42 Glossary 99 Welcome Dear Student and family Welcome to the Composers' Bridge! The fact that you are being given this book means that we already value you as a composer and a creative artist-in-training.
    [Show full text]
  • The Development of Musical Notation Carolyn S
    Cedarville University DigitalCommons@Cedarville The Research and Scholarship Symposium The 2015 yS mposium Apr 1st, 2:20 PM - 2:40 PM Slashes, Dashes, Points, and Squares: The Development of Musical Notation Carolyn S. Gorog Cedarville University, [email protected] Follow this and additional works at: http://digitalcommons.cedarville.edu/ research_scholarship_symposium Part of the Composition Commons, and the Music Theory Commons Gorog, Carolyn S., "Slashes, Dashes, Points, and Squares: The eD velopment of Musical Notation" (2015). The Research and Scholarship Symposium. 5. http://digitalcommons.cedarville.edu/research_scholarship_symposium/2015/podium_presentations/5 This Podium Presentation is brought to you for free and open access by DigitalCommons@Cedarville, a service of the Centennial Library. It has been accepted for inclusion in The Research and Scholarship Symposium by an authorized administrator of DigitalCommons@Cedarville. For more information, please contact [email protected]. Slashes, Dashes, Points, and Squares: The development of Musical Notation Slashes, Dashes, Points, and Squares: The Development of Musical Notation Music has been around for a long time; in almost every culture around the world we find evidence of music. Music throughout history started as mostly vocal music, it was transmitted orally with no written notation. During the early ninth and tenth century the written tradition started to be seen and developed. This marked the beginnings of music notation. Music notation has gone through many stages of development from neumes, square notes, and four-line staff, to modern notation. Although modern notation works very well, it is not necessarily superior to methods used in the Renaissance and Medieval periods. In Western music neumes are the name given to the first type of notation used.
    [Show full text]