Music/Lyrics Composition System Considering User's Image And
Total Page:16
File Type:pdf, Size:1020Kb
Proceedings of the 2009 IEEE International Conference on Systems, Man, and Cybernetics San Antonio, TX, USA - October 2009 Music/Lyrics Composition System Considering User’s Image and Music Genre Chisa Nakamura Takehisa Onisawa Onisawa Lab., Graduate School of Systems and Graduate School of Systems and Information Engineering, Information Engineering, University of Tsukuba University of Tsukuba Tsukuba, Japan Tsukuba, Japan [email protected] [email protected] Abstract— This paper proposes a music/lyrics composition system As for music/lyrics composition, the following two consisting of two sections, a lyric composing section and a music procedures are usually considered. The one is to compose composing section, which considers user's image of a song and lyrics first and after that melody composition is followed. The music genre. First of all, a user has an image of music/lyrics to other is to compose music first and lyrics composition is compose. The lyric composing section presents initial lyrics followed. In this way music and lyrics are usually composed chosen at random from database that is constructed using separately because different technical knowledge is needed for Markov Chain and existent lyrics classified by music genres. If music composition and lyrics one. Although composer’s presented lyrics do not fit user's image, a part of lyrics not fitting impressions/image should be usually reflected to composed user's image is changed by some other words. When satisfied songs, it is difficult to reflect composer’s impressions/image to lyrics are obtained, the music composition section starts. This music/lyrics if they are composed separately by other section composes music fitting lyrics generated by the lyric composing section using the music composition system. And this composers. By the way, some artistes compose music/lyrics by section generates melody and backing patterns according to themselves. They usually compose lyrics/music checking music genres. The section presents combinations of lyrics and 16 composed lyrics and/or music repeatedly so that their measures music. A subject evaluates each combination of lyrics individual impressions/image can be reflected to songs well. It and music whether it fits his/her image of a song. According to is necessary to consider user’s impressions/image for the subject's evaluation music melody is changed by Genetic construction of a music/lyrics composition system. Moreover, Algorithms and a part of lyrics are changed. These procedures there are various genres in lyrics, e.g., lyrics of popular music, are repeated until satisfied combination of lyrics and music lyrics of nursery rhyme, lyrics of Japanese Enka (peculiar to melody is generated. In order to verify the validity of the Japanese songs), and also various genres in music, e.g., popular presented system, subject experiments are performed. music, ballade, nursery rhyme, Japanese Enka. Therefore, it is also necessary to consider genres for the construction of a Keywords—music, lyrics, genre, genetic algorithm, markov lyrics/music composition system. However, few existing chain systems consider user’s impressions/image and genres. I. INTRODUCTION This paper aims to develop a lyrics/music composition A lot of musical works in many genres such as classical system considering user’s impressions/image and music music, popular music, modern music are heard everywhere at genres. Furthermore, even if a user has little knowledge of the present day, and music is indispensable to our daily lives. lyrics and/or music composition, he/she can compose Jean-Jacques Rousseau says There is a sound, the soul grasps lyrics/music using the presented system. This paper has for it, and there it has a ringing word in Essay on the Origin of following organization. Chapter 2 shows the structure of a Language [1]. That is, music and words are inseparably music/lyrics composition system. Chapter 3 describes related to each other. Music has a wealth of expression in experiments using the presented system and shows itself. However, a song, i.e., music with words has more experimental results with discussion. The final chapter wealth of expression. Therefore, a song sometimes stirs one’s concludes this study. heart harder than only words or only music. II. STRUCTURE OF MUSIC/LYRICS COMPOSITION SYSTEM There are many studies on automatic music composition and automatic lyrics composition in order to realize intelligent A. Outline of Music/Lyrics Composition System music information processing of human. For instance, Fig. 1 shows the outline of a music/lyrics composition LYRICA [2] composes lyrics automatically to existing system consisting of two sections, a lyric composing section melodies. Tra-ra-Lyrics [3] aims to create a computer and a music composing section. Sixteen measures songs are program capable of generating lyrics to given melodies, and generated by this system, where a musical work including VOCALOID [4] is known as a singing software. There are music and lyrics is called a song in this paper. also some other studies on music composition [5, 6]. 1826 978-1-4244-2794-9/09/$25.00 ©2009 IEEE USER LYRIC COMPOSING SECTION USER LYRIC COMPOSING SECTION Generation of Lyrics Genre First Candidates Lyrics Database Lyrics Database Repeat Input of Genre Composition Generation of New Candidates Presentation of Lyrics of Lyrics Repeat MUSIC COMPOSING SECTION Selection Presentation of Lyrics Music Genre Lyrics Fitness Function Evaluation Generation of Melody Repeat Composed Lyrics Lyrics Melody Figure 2. Structure of lyric composing section Figure 1. Outline of music/lyric composition system In the lyric composing section, at the first step, a user inputs TABLE 1. COMBINATION OF WORDS AND PROBABILITIES Set of Words The Number of Sets Probability a lyrics genre, i.e., popular music lyrics, nursery rhyme lyrics, Word 1 Word 2 or Japanese Enka lyrics. Then, the section presents the first your Face kkk / candidates of lyrics chosen from lyrics database at random, 1 1 your Look where lyrics database are constructed using Markov Chain [7] kk2 k2 / your feeling and have lyrics of three genres as mentioned above. If kk3 k3 / presented lyrics don’t fit user’s image, a part of lyrics not your Song kkk / fitting user’s image is changed by some other words, where 4 4 = + + + presented lyrics as the next candidates are chosen according to k k1 k2 k3 k4 probabilities in Markov Chain. After repeating the presentation popular music, 250 songs of nursery rhyme, and 228 songs of of lyrics and evaluation, if satisfied lyrics are obtained, the Japanese Enka. Database of each lyrics genre are constructed music composing section starts. using Markov Chain [7] as follows. Collected lyrics are In the music composing section, at the first step, a user divided into morphemes using Morphological Analysis [14]. inputs a music genre, i.e., popular music, ballade, nursery Then, a word set of the combination of morpheme 1(written as rhyme, or Japanese Enka. Based on generated lyrics and the word 1) and morpheme 2 (written as word 2) is considered, and inputted genre, the music composing section using the music the number of the sets is counted for all collected songs in each composing system [8, 9] generates melodies using Interactive genre. For example, let the combination of word 1 and word 2, Genetic Algorithms [10, 11], where the accompaniment part is and the number of their combinations be obtained as shown in generated according to an inputted music genre. In addition to Table 1 as the results of searching web sites. Then, the fitness function evaluating the difference between the probabilities of the combination of your face, your look, your k / k k / k k / k number of words in lyrics composed by the lyrics composing feeling or your song are 1 , 2 , k3 / k , and 4 , = + + + section and the number of notes in melodies composed by the respectively, as shown in Table 1, where k k1 k2 k3 k4 . music composing section, user’s subjective evaluations are considered in the music composing section. A user evaluates 3) Lyrics composing using databse: The lyric composing each combination of lyrics and music whether it fits user’s section uses words sets shown by expression (1). That is, the image/impressions of a song. contents of Table 1 are expressed by expression (1). B. Lyric Composing Section § a :X · §a : b (P ) b (P ) ... b (P )· ¨ 1 1 ¸ ¨ 1 11 11 12 12 1m 1m ¸ 1) Structure of lyric composing section: Fig. 2 shows the a :X a : b (P ) b (P ) ... b (P ) ¨ 2 2 ¸ = ¨ 2 21 21 22 22 1m 2m ¸ , (1) structure of the lyric composing section. The section chooses ¨ : ¸ ¨ : : : : : ¸ ¨ ¸ ¨ ¸ ¨ ¸ ¨ ¸ the first candidates of lyrics from lyrics database at random ©an:Xn ¹ ©an: bn1(Pn1) bn2(Pn2) ... bnm(Pnm)¹ according to the lyrics genre inputted by a user. If presented = lyrics don’t fit user’s image, a part of lyrics not fitting user’s where X i (i 1,2,...,n) consist of elements bij and probabilities image is modified by some other words, where presented = = Pij (i 1,2,...,n, j 1,2,..., m) . Elements ai are morphemes obtained words following modified words as candidates are chosen by Morphological Analysis of existent lyrics, elements b are according to probabilities in Markov Chain as mentioned after. ij a P b A user can also modify lyrics by himself/herself freely. morphemes following i , ij are probabilities of elements ij m 2) Database construction: In this paper three kinds of = following elements ai , ¦ Pij 1 , n is the total number of lyrics genres are considered, popular music rylics, nursery j=1 rhyme lyrics, and Japanese Enka lyrics. Many lyrics are morphemes, and m is the maximum number of bij following collected using lyrics web search sites [12, 13]; 834 songs of < ai .