The 21st International Society for Music Information Retrieval Conference (ISMIR 2020) Analysis of Song/Artist Latent Features and Its Application for Song Search Kosetsu Tsukuda and Mastaka Goto National Institute of Advanced Industrial Science and Technology (AIST)

1 Embed song/artist vectors into the same feature space 3 Application examples In music recommendation, artists and songs are represented by latent vectors Familiarity-oriented search Typicality-oriented search Analogy search The vectors are usually used only to compute a user’s preference toward a song Which song represents We embed song/artist vectors in the same feature space to leverage the vectors What are unexpected What Aerosmith song Lady Gaga’s typical songs of The Black Keys? corresponds to That Means for realizing new song search applications characteristics well? A Lot by The Beatles? k-dimensional k-dimensional High popularity latent vectors feature space Query: Lady Gaga Query Factorization Machines B A Rank Song by OS Source artist The Beatles = + + + - Same Old Thing - Gold on the Ceiling 1 2 3 … 𝑎𝑎1 1 California Curls / Katy Perry Source song That Means A Lot + , + , + , 𝑠𝑠 𝑠𝑠 𝑠𝑠 1 2 - I Got Mine - Lonely Boy 𝑥𝑥�𝑢𝑢𝑢𝑢 𝛼𝛼 𝛽𝛽𝑢𝑢 𝛽𝛽𝑠𝑠 𝛽𝛽𝑎𝑎𝑠𝑠 𝑠𝑠 𝑠𝑠 Low High Play logs 2 Racy Lacey / Girls Aloud Target artist Aerosmith : 𝑢𝑢 𝑠𝑠 𝑢𝑢 𝑎𝑎𝑠𝑠 𝑎𝑎𝑠𝑠 𝑠𝑠 Embed 3 PA PA user,𝝂𝝂 : 𝝂𝝂song,𝝂𝝂 :𝝂𝝂 artist 𝝂𝝂of 𝝂𝝂 𝑠𝑠 - Can’t Fine My Mind - Yearnin’ 3 Gimme More / Britney Spears 3 1 , , , : bias terms 𝑎𝑎 𝑎𝑎 - Howling For You - Grown So Ugly Rank Song 𝑢𝑢 𝑠𝑠 𝑎𝑎𝑠𝑠 𝑠𝑠 𝑎𝑎1 𝑎𝑎2 𝑎𝑎3 … 4 Cannibal / Ke$ha , , : latent𝑠𝑠 vectors 1 Milk Cow Blues 𝛼𝛼 𝛽𝛽𝑢𝑢 𝛽𝛽𝑠𝑠 𝛽𝛽𝑎𝑎 D C 5 Piece of Me / Britney Spears 𝑠𝑠 Low popularity 2 Face 𝝂𝝂𝑢𝑢 𝝂𝝂𝑠𝑠 𝝂𝝂𝑎𝑎 2 Overall similarity (OS) and prominent affinity (PA)  3 Temperature A: for users who are not Given artist , all songs in the familiar with the artist dataset can be ranked in terms Search for the target artist’s songs Overall similarity 1 Prominent affinity B: for users who want to of OS or PA 𝑎𝑎 that have a similar relationship 1 𝑎𝑎 2 𝑠𝑠 𝑠𝑠 know the artist’s diversity By showing such songs to a between the source artist and 1 3  𝑠𝑠 1 𝑠𝑠 C: for users who want to user who is a fan of Lady Gaga, the source song 1 3 𝑎𝑎 1 3 𝑎𝑎 𝑎𝑎 𝑎𝑎 𝑠𝑠 C: listen to unexpected songs she may be willing to listen to The similarity is defined by the D: for users who want to unfamiliar songs because they angle between vectors and the When𝟎𝟎 a song is fairly close to an artist, When a song is𝟎𝟎 fairly close to the extended D: become an artist devotee are highly related to Lady Gaga ratio of vector lengths the song is similar overall to the artist position of an artist, the song prominently represents the artist’s characteristics 4 Contributions Overall similarity is defined by the Prominent affinity is defined by the closeness between an artist and a song inner product of an artist and a song Propose the concepts of overall similarity and prominent affinity Artist: The Beatles Artist: The Beatles Relationships between songs and artists in a latent feature space We want other researchers to Rank Song Rank Song 1 I’m So Tired 1 Something Show characteristics of overall similarity and prominent affinity leverage our proposed concepts 2 Get Back 2 All You Need Is Love Latent vectors are generated by using Last.fm play logs for two years and realize useful music 3 The End 3 Come Together information retrieval systems 4 Sun King 4 Hey Jude Demonstrate three applications for music information retrieval Familiarity-oriented search, typicality-oriented search, and analogy search 5 Here Comes the Sun 5 I Am the Walrus