Recommending Music with Waveform-Based Architectures at Scale

Total Page:16

File Type:pdf, Size:1020Kb

Recommending Music with Waveform-Based Architectures at Scale Recommending Music with Waveform-based Architectures at Scale ORIOL NIETO SEMINAR SERIES IN DATA SCIENCE UNIVERSITY OF SAN FRANCISCO FEB 1, 2019 Pandora Confidential OUTLINE Motivation: The Long Tail Background: Collaborative Filtering Music Recommendation Demo OUTLINE Motivation: The Long Tail Background: Collaborative Filtering Music Recommendation Demo The Long Tail Most Popular Tracks 0.01 % Pandora Confidential The Long Tail Most Popular Tracks 1 % Pandora Confidential The Long Tail Most Popular Tracks 0 spins last week 100 % Pandora Confidential OUTLINE Motivation: The Long Tail Background: Collaborative Filtering Music Recommendation Demo Collaborative Filtering RECOMMENDING POPULAR MUSIC ? ? [ ? ? ? ? Items (Tracks) ? ? [ ? ? Users Collaborative Filtering PROBLEM OVERVIEW [ [ k ? ? [ ? ? ? ? k Items (Tracks) ? ? ⇡ Items (Tracks) ? ? [ [ [ Users Users Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix Factorization Techniques for Recommender Systems. Computer, 42(8), 42–49. Collaborative Filtering PROBLEM FORMULATION [ [ k ? ? [ Given Item i and User u: pu ? ? ? qi r?iu k Rating: riu Items (Tracks) ? ? ⇡ Items (Tracks) ? ? [ k[ [ Users Item Latent Factor: qi R 2 Users k User Latent Factor: pu R 2 T Rating Approximation: rˆiu = qi pu T 2 2 2 argminq ,p (rui qi pu) +λ( qi + pu ) ⇤ ⇤ − u,i || || || || Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix Factorization Techniques for Recommender Systems. Computer, 42(8), 42–49.X2S Collaborative Filtering LATENT FACTORS Complex Harmony Calm Aggressive Simple Harmony Collaborative Filtering THE GOOD AND THE BAD Rich preference-driven similarity space Latent space is generally not interpretable Can only recommend items that Powerful at matching the right song have already been rated with the right listener (what about long tail content?) OUTLINE Motivation: The Long Tail Background: Collaborative Filtering Music Recommendation Demo Music Recommendation WITH COLLABORATIVE SONG FACTORS [ [ k ? ? [ ? ? ? ? k Items (Tracks) ? ? ⇡ Items (Tracks) ? ? [ [ [ Users Users Collaborative Filtering EXAMPLE ArUst Title Query Track Journey Don’t Stop Believing Collaborative Filtering EXAMPLE ArUst Title Query Track Journey Don’t Stop Believing Ranked 1 The Ouield Your Love Ranked 2 Eagles Hotel California Ranked 3 Survivor Eye Of The Tiger Ranked 4 Queen We Will Rock You The Music Genome Project LARGE-SCALE HUMAN ANNOTATED DATASET Attribute Examples Breathy Voice Nasal Voice Odd Meter Has Banjo Joyful Lyrics … Up to ~400 attributes per track Music Genome Project EXAMPLE ArUst Title Query Track Journey Don’t Stop Believing Ranked 1 Journey Stone In Love Ranked 2 Jefferson Starship Find Your Way Back Ranked 3 David Bowie Teenage Wildlife Ranked 4 Thriving Ivory On Your Side Estimating Latent Factors [ [ k ? ? [ ? ? ? ? k Items (Tracks) ? ? ⇡ Items (Tracks) ? ? [ [ [ Users Users Estimating Latent Factors FROM THE MUSIC GENOME PROJECT k y<latexit sha1_base64="(null)">(null)</latexit> <latexit sha1_base64="(null)">(null)</latexit> x http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind-artificial-intelligence-2-970x0-970x646.jpg f(x; ✓) y <latexit sha1_base64="(null)">(null)</latexit> ⇡ Estimating Latent Factors FROM THE MUSIC GENOME PROJECT N 2048 2048 k Dense Layers Estimating Latent Factors DATA AND OPTIMIZATION • Data set : X, Y { } • ~900k tracks (from “head”) M<latexit sha1_base64="(null)">(null)</latexit> • Loss : (✓) L<latexit sha1_base64="(null)">(null)</latexit> • Cosine Distance • Dropout 10% in Dense Layers 1 f(x; ✓)T y • Batch Normalization in all layers (✓)=1 L − M f(x; ✓) 2 y 2 <latexit sha1_base64="(null)">(null)</latexit> x ,y • Adam optimizer 2XX 2Y || || || || Estimating Latent Factors RESULTS Input Cos Distance # Epochs Time / Epoch MGP 0.30 15 ~4m Latent Factor Estimations WITH THE MUSIC GENOME PROJECT ArUst Title Query Track Journey Don’t Stop Believing Ranked 1 Journey Stone In Love Ranked 2 D Drive A Linle Bina Sunshine Ranked 3 John Parr Naughty, Naughty Ranked 4 Kiss Turn On The Night Machine Listening ESTIMATING THE MUSIC GENOME PROJECT Pons, J., et al. ISMIR 2018 Estimating Latent Factors FROM THE MUSIC GENOME PROJECT ESTIMATIONS k http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind-artificial-intelligence-2-970x0-970x646.jpg Estimating Latent Factors FROM THE MUSIC GENOME PROJECT ESTIMATIONS N 2048 2048 k Dense Layers Estimating Latent Factors RESULTS Input Cos Distance # Epochs Time / Epoch MGP 0.30 15 ~4m MGP Esomaoons 0.44 21 ~4m Latent Factor Estimations WITH MACHINE LISTENING ATTRIBUTES ArUst Title Query Track Journey Don’t Stop Believing Ranked 1 Dean Friedman Don’t You Ever Dare Ranked 2 James Taylor Stand And Fight Ranked 3 The Dingoes Starong Today Ranked 4 Chuck Girad The Days Are Young Estimating Latent Factors FROM AUDIO k http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind-artificial-intelligence-2-970x0-970x646.jpg Oord, A. Van Den, Dieleman, S., & Schrauwen, B. (2013). Deep Content-based Music Recommendation. Advances in Neural Information Processing Systems, 2643–2651. Estimating Latent Factors FROM RAW WAVEFORMS k y<latexit sha1_base64="(null)">(null)</latexit> <latexit sha1_base64="(null)">(null)</latexit> x http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind-artificial-intelligence-2-970x0-970x646.jpg f(x; ✓) y <latexit sha1_base64="(null)">(null)</latexit> ⇡ Estimating Latent Factors FROM RAW WAVEFORMS Conv1D Conv1D MP Conv1D MP Conv1D MP 64 x 3 64 x 3 3 64 x 3 3 128 x 3 3 <latexit sha1_base64="(null)">(null)</latexit> x k Conv1D MP Conv1D MP Conv1D Conv1D 1024 1024 1024 128 x 3 3 128 x 3 3 128 x 3 128 x 3 y<latexit sha1_base64="(null)">(null)</latexit> Conv1D Conv1D Conv1D Conv1D 256 x 3 512 x 7 512 x 7 512 x 7 Dense Layers Auto Pooling https://github.com/jordipons/music-audio-tagging-at-scale-models Lee, J., et al., 2018 McFee, B., et al., 2018 Estimating Latent Factors DATA AND OPTIMIZATION • Data set : X, Y • ~900k tracks (from “head”) { } • 16kHz - 16 bit waveforms M<latexit sha1_base64="(null)">(null)</latexit> • 3 patches of 15 seconds per track (~2.7M patches) • Loss : (✓) L<latexit sha1_base64="(null)">(null)</latexit> • Cosine Distance • Dropout 10% in Dense Layers 1 f(x; ✓)T y • Batch Normalization in all layers (✓)=1 L − M f(x; ✓) 2 y 2 <latexit sha1_base64="(null)">(null)</latexit> x ,y • Adam optimizer 2XX 2Y || || || || Estimating Latent Factors RESULTS Input Cos Distance # Epochs Time / Epoch MGP 0.30 15 ~4m MGP Esomaoons 0.44 21 ~4m Spectrogram (35s patches) 0.37 22 ~2h Estimating Latent Factors RESULTS Input Cos Distance # Epochs Time / Epoch MGP 0.30 15 ~4m MGP Esomaoons 0.44 21 ~4m Spectrogram (35s patches) 0.37 22 ~2h Waveform (15s patches) 0.34 9 ~5h Latent Factor Estimations WITH WAVEFORMS ArUst Title Query Track Journey Don’t Stop Believing Ranked 1 The Ganes Band The Final Countdown Ranked 2 Survivor Backstreet Love Affair Ranked 3 Toto Angel Don’t Cry Ranked 4 Orion The Hunter Dark And Stormy Estimating Latent Factors COMBINING MODELS k http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind-artificial-intelligence-2-970x0-970x646.jpg Estimating Latent Factors LATE-FUSION ARCHITECTURE 2 Co Co M Co M Co M 1 1 1 k Co M Co M Co Co Co Co Co Co Pons, J., McFee, k N 4 4 k http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind- Oramas, S., et al. 2018 Estimating Latent Factors LATE-FUSION ARCHITECTURE 2048 2048 k 2048 + 1024 Dense Layers Oramas, S., et al. 2018 Estimating Latent Factors RESULTS Input Cos Distance # Epochs Time / Epoch MGP 0.30 15 ~4m MGP Esomaoons 0.44 21 ~4m Spectrogram (35s patches) 0.37 22 ~2h Waveform (15s patches) 0.34 9 ~5h Waveform + MGP Esmaons 0.32 20 ~4m Latent Factor Estimations WITH AUDIO + MACHINE LISTENING ATTRIBUTES ArUst Title Query Track Journey Don’t Stop Believing Ranked 1 Patrick Simmons Knocking at your Door Ranked 2 Night Ranger When You Close Your Eyes Ranked 3 Prism Young And Restless Ranked 4 The Front The Truth Hurts CONCLUSIONS The severe length of the Long Tail in music catalogs is real Collaborative filtering is powerful at recommending music from the “head” Waveform-based architectures are effective at recommending undiscovered/new music Pandora Confidential DEMO TIME Pandora Confidential References McFee, B., Salamon, J., Bello, J. P., Adaptive pooling operators for weakly labeled sound event detection, IEEE Transactions on Audio, Speech and Language Processing, 2018. Koren, Y., Bell, R., & Volinsky, C., Matrix Factorization Techniques for Recommender Systems. Computer, 42(8), 42–49, 2009. Lee, J., Park, J, Kim, K. L., & Nam, J. SampleCNN: End-to-end Deep Convolutional neural networks using very small filters for music classification.Applied Sciences, 8(1):150, 2018. Oord, A. Van Den, Dieleman, S., & Schrauwen, B., Deep Content-based Music Recommendation. Advances in Neural Information Processing Systems, 2643–2651, 2013. Oramas, S., Barbieri, F., Nieto, O., Serra, X., Multimodal Deep Learning for Music Genre Classification. Transactions of the International Society for Music Information Retrieval (TISMIR), 2018. Pons, J., Nieto, O., Prockup, M., Schmidt, E., Ehmann, A., Serra, X., End-to-End Learning for Music Audio Tagging at Scale. Proc. of the 19th International Society for Music Information Retrieval Conference (ISMIR). Paris, France, 2018. Pandora Confidential.
Recommended publications
  • Movie Genome: Alleviating New Item Cold Start in Movie Recommendation
    User Modeling and User-Adapted Interaction https://doi.org/10.1007/s11257-019-09221-y Movie genome: alleviating new item cold start in movie recommendation Yashar Deldjoo, et al. [full author details at the end of the article] Received: 23 December 2017 / Accepted in revised form: 19 January 2019 © The Author(s) 2019 Abstract As of today, most movie recommendation services base their recommendations on col- laborative filtering (CF) and/or content-based filtering (CBF) models that use metadata (e.g., genre or cast). In most video-on-demand and streaming services, however, new movies and TV series are continuously added. CF models are unable to make predic- tions in such a scenario, since the newly added videos lack interactions—a problem technically known as new item cold start (CS). Currently, the most common approach to this problem is to switch to a purely CBF method, usually by exploiting textual meta- data. This approach is known to have lower accuracy than CF because it ignores useful collaborative information and relies on human-generated textual metadata, which are expensive to collect and often prone to errors. User-generated content, such as tags, can also be rare or absent in CS situations. In this paper, we introduce a new movie recommender system that addresses the new item problem in the movie domain by (i) integrating state-of-the-art audio and visual descriptors, which can be automati- cally extracted from video content and constitute what we call the movie genome; (ii) exploiting an effective data fusion method named canonical correlation analysis, which was successfully tested in our previous works Deldjoo et al.
    [Show full text]
  • Intelligent User Interfaces for Music Discovery
    Knees, P., et al. (2020). Intelligent User Interfaces for Music Discovery. Transactions of the International Society for Music Information 7,60,5 Retrieval, 3(1), pp. 165–179. DOI: https://doi.org/10.5334/tismir.60 OVERVIEW ARTICLE Intelligent User Interfaces for Music Discovery Peter Knees*, Markus Schedl† and Masataka Goto‡ Assisting the user in finding music is one of the original motivations that led to the establishment of Music Information Retrieval (MIR) as a research field. This encompasses classic Information Retrieval inspired access to music repositories that aims at meeting an information need of an expert user. Beyond this, however, music as a cultural art form is also connected to an entertainment need of potential listeners, requiring more intuitive and engaging means for music discovery. A central aspect in this process is the user interface. In this article, we reflect on the evolution of MIR-driven intelligent user interfaces for music browsing and discovery over the past two decades. We argue that three major developments have transformed and shaped user interfaces during this period, each connected to a phase of new listening practices. Phase 1 has seen the development of content-based music retrieval interfaces built upon audio processing and content description algorithms facilitating the automatic organization of repositories and finding music according to sound qualities. These interfaces are primarily connected to personal music collections or (still) small commercial catalogs. Phase 2 comprises interfaces incorporating collaborative and automatic semantic description of music, exploiting knowledge captured in user-generated metadata. These interfaces are connected to collective web platforms. Phase 3 is dominated by recommender systems built upon the collection of online music interaction traces on a large scale.
    [Show full text]
  • Recommender Systems User-Facing Decision Support Systems
    Recommender Systems User-Facing Decision Support Systems Michael Hahsler Intelligent Data Analysis Lab (IDA@SMU) CSE, Lyle School of Engineering Southern Methodist University EMIS 5/7357: Decision Support Systems February 22, 2012 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 1 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 2 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 3 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 4 / 44 Table of Contents 1 Recommender Systems & DSS 2 Content-based Approach 3 Collaborative Filtering (CF) Memory-based CF Model-based CF 4 Strategies for the Cold Start Problem 5 Open-Source Implementations 6 Example: recommenderlab for R 7 Empirical Evidence Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 5 / 44 Decision Support Systems ? Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 6 / 44 Decision Support Systems \Decision Support Systems are defined broadly [...] as interactive computer-based systems that help people use computer communications, data, documents, knowledge, and models to solve problems and make decisions." Power (2002) Main Components: Knowledge base Model User interface Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 6 / 44 ! A recommender system is a decision support systems which help a seller to choose suitable items to offer given a limited information channel. Recommender Systems Recommender systems apply statistical and knowledge discovery techniques to the problem of making product recommendations. Sarwar et al. (2000) Advantages of recommender systems (Schafer et al., 2001): Improve conversion rate: Help customers find a product she/he wants to buy.
    [Show full text]
  • Pandora's Music Recommender 1 Introduction to Pandora 2 Description of Pandora Problem Space
    Pandora’s Music Recommender Michael Howe 1 Introduction to Pandora One of the great promises of the internet and Web 2.0 is the opportunity to expose people to new types of content. Companies like Amazon and Netflix provide customers with ideas for new items to purchase based on current or previous selections. For instance, someone who rented “Star Wars” at Netflix might be presented with “The Matrix” as another movie to rent. The challenge in this strategy is to make suggestions in a reasonable amount of time that the user will mostly like based on the known list of what the user already enjoys. People will only pay attention to the recommendations of a service a finite number of times before they lose trust. Repeatedly suggest content that the user hates and the user will look for new content elsewhere. Also, a user will only pay attention to a service’s recommendation if they arrive in a reasonable amount of time. Make the user wait longer than they are willing and they will again turn elsewhere for content suggestions. Accuracy and speed are critical to a service’s success. Pandora exposes people to music with an online radio station where a user builds up “stations” based on musical interests. The user indicates in each station one or more songs or artists that he or she likes. Based on these preferences Pandora plays similar songs that the user might also like. As Pandora plays the user can further refine the station by giving a “thumbs up” or a “thumbs down” to a particular song.
    [Show full text]
  • Music Recommendation Algorithms: Discovering Weekly Or Discovering
    MUSIC RECOMMENDATION ALGORITHMS Music Recommendation Algorithms: Discovering Weekly or Discovering Weakly? Jennie Silber Muhlenberg College, Allentown, PA, USA Media & Communication Department Undergraduate High Honors Thesis April 1, 2019 1 MUSIC RECOMMENDATION ALGORITHMS 2 MUSIC RECOMMENDATION ALGORITHMS Abstract This thesis analyzes and assesses the cultural impact and economic viability that the top music streaming platforms have on the consumption and discovery of music, with a specific focus on recommendation algorithms. Through the support of scholarly and journalistic research as well as my own user experience, I evaluate the known constructs that fuel algorithmic recommendations, but also make educated inferences about the variables concealed from public knowledge. One of the most significant variables delineated throughout this thesis is the power held by human curators and the way they interact with algorithms to frame and legitimize content. Additionally, I execute my own experiment by creating new user profiles on the two streaming platforms popularly used for the purpose of discovery, Spotify and SoundCloud, and record each step of the music discovery process experienced by a new user. After listening to an equal representation of all genre categories within each platform, I then compare the genre, release year, artist status, and content promotion gathered from my listening history to the algorithmically-generated songs listed in my ‘Discover Weekly’ and ‘SoundCloud Weekly’ personalized playlists. The results from this experiment demonstrate that the recommendation algorithms that power these discovery playlists intrinsically facilitate the perpetuation of a star- driven, “winner-take-all” marketplace, where new, popular, trendy, music is favored, despite how diverse of a selection the music being listened to is.
    [Show full text]
  • UNIVERSITY of CALIFORNIA, SAN DIEGO Bag-Of-Concepts As a Movie
    UNIVERSITY OF CALIFORNIA, SAN DIEGO Bag-of-Concepts as a Movie Genome and Representation A Thesis submitted in partial satisfaction of the requirements for the degree Master of Science in Computer Science by Colin Zhou Committee in charge: Professor Shlomo Dubnov, Chair Professor Sanjoy Dasgupta Professor Lawrence Saul 2016 The Thesis of Colin Zhou is approved, and it is acceptable in quality and form for publication on microfilm and electronically: Chair University of California, San Diego 2016 iii DEDICATION For Mom and Dad iv TABLE OF CONTENTS Signature Page........................................................................................................... iii Dedication.................................................................................................................. iv Table of Contents....................................................................................................... v List of Figures and Tables.......................................................................................... vi Abstract of the Thesis................................................................................................ vii Introduction................................................................................................................ 1 Chapter 1 Background............................................................................................... 3 1.1 Vector Space Models............................................................................... 3 1.1.1. Bag-of-Words........................................................................
    [Show full text]
  • A Movie Recommender System: MOVREC Using Machine Learning Techniques Ashrita Kashyap1, Sunita
    ISSN 2321 3361 © 2020 IJESC Research Article Volume 10 Issue No.6 A Movie Recommender System: MOVREC using Machine Learning Techniques Ashrita Kashyap1, Sunita. B2, Sneh Srivastava3, Aishwarya. PH4, Anup Jung Shah5 Department of Computer Science & Engineering SAIT, Bengaluru, Karnataka, India Abstract: This paper discuss about recommendations of the movies. A movie recommendation is important in our social life due to its strength in providing enhanced entertainment. Such a system can suggest a set of movies to users based on their interest, or the popularities of the movies. A recommendation system is used for the purpose of suggesting items to purchase or to see. They direct users towards those items which can meet their needs through cutting down large database of Information. A recommender system, or a recommendation system (sometimes replacing 'system' with a synonym such as platform or engine), is a subclass of information filtering system that seeks to predict the "rating" or "preference" a user would give to an item[1][2]. They are primarily used in commercial applications. MOVREC also help users to find the movies of their choices based on the movie experience of other users in efficient and effective manner without wasting much time in useless browsing. Keywords: Filtering, Recommendation System, Recommender. I. INTRODUCTION emphasizing other attributes when a user "likes" a song. This is an example of a content-based approach. Recommender systems usually make use of either or both collaborative filtering and content-based filtering (also known as Each type of system has its strengths and weaknesses. In the the personality-based approach),[3] as well as other systems above example, Last.fm requires a large amount of information such as knowledge-based systems.
    [Show full text]
  • Five Approaches to Collecting Tags for Music
    FIVE APPROACHES TO COLLECTING TAGS FOR MUSIC Douglas Turnbull Luke Barrington Gert Lanckriet UC San Diego UC San Diego UC San Diego [email protected] [email protected] [email protected] ABSTRACT There are a number of key concepts to consider when com- paring these approaches. The cold start problem refers to the We compare five approaches to collecting tags for music: fact songs that are not annotated cannot be retrieved. This conducting a survey, harvesting social tags, deploying anno- problem is related to popularity bias in that popular songs (in tation games, mining web documents, and autotagging audio the short-head) tend to be annotated more thoroughly than content. The comparison includes a discussion of both scala- unpopular songs (in the long-tail)[11]. This often leads bility (financial cost, human involvement, and computational to a situation in which a short-head song is ranked above resources) and quality (the cold start problem & popularity a long-tail song despite the fact that the long-tail song may bias, strong vs. weak labeling, vocabulary structure & size, be more semantically relevant. We prefer an approach that and annotation accuracy). We then describe one state-of- avoids the cold start problem (e.g., autotagging). If this is the-art system for each approach. The performance of each not possible, we prefer approaches in which we can explic- system is evaluated using a tag-based music information itly control which songs are annotated (e.g., survey, games), retrieval task. Using this task, we are able to quantify the rather than an approach in which only the more popular songs effect of popularity bias on each approach by making use are annotated (e.g., social tags, web documents).
    [Show full text]
  • DEEP LEARNING for MUSIC RECOMMENDATION: Machine Listening & Collaborative Filtering
    DEEP LEARNING FOR MUSIC RECOMMENDATION: Machine Listening & Collaborative Filtering ORIOL NIETO [email protected] SEMINAR ON MUSIC KNOWLEDGE EXTRACTION USING MACHINE LEARNING POMPEU FABRA UNIVERSITY BARCELONA DECEMBER 4, 2016 Outline • Pandora Overview • Large Scale Music Recommendation with Deep Learning: • Machine Listening • Collaborative Filtering Outline • Pandora Overview • Large Scale Music Recommendation with Deep Learning: • Machine Listening • Collaborative Filtering TODAY 78 M 22 H 75 B + Monthly Listeners Average Listening per Month Thumbs 10 B 180 K 55 % Stations Artists Spinning per Month of all Music Streaming in USA Content&Based Collective) Intelligence Personalized Filtering Outline • Pandora Overview • Large Scale Music Recommendation with Deep Learning: • Machine Listening • Collaborative Filtering Content&Based Collective) Intelligence Personalized Filtering Short Time Fourier Transform MY GUITAR GENTLY WEEPS - THE BEATLES Extracting Information Beats Downbeats Chords Structure “electric guitar”, “drums”, “male singer”, “pop”, “classic rock” Hand Crafted Features Beats Downbeats Chords MFCCs Structure Spectral Rolloff Spectral Centroid Structural Features Chromagrams Tempograms “electric guitar”, CERNs “drums”, … “male singer”, “pop”, “classic rock” Learned Features Beats Downbeats Chords Structure DEEP LEARNING (Mostly Convolutional Neural Networks) “electric guitar”, “drums”, “male singer”, “pop”, http://blogs-images.forbes.com/kevinmurnane/files/2016/03/google-deepmind-artificial-intelligence-2-970x0-970x646.jpg
    [Show full text]
  • A Hybrid Approach to Music Recommendation: Exploiting Collaborative Music Tags and Acoustic Features Jaime C
    UNF Digital Commons UNF Graduate Theses and Dissertations Student Scholarship 2014 A Hybrid Approach to Music Recommendation: Exploiting Collaborative Music Tags and Acoustic Features Jaime C. Kaufman University of North Florida Suggested Citation Kaufman, Jaime C., "A Hybrid Approach to Music Recommendation: Exploiting Collaborative Music Tags and Acoustic Features" (2014). UNF Graduate Theses and Dissertations. 540. https://digitalcommons.unf.edu/etd/540 This Master's Thesis is brought to you for free and open access by the Student Scholarship at UNF Digital Commons. It has been accepted for inclusion in UNF Graduate Theses and Dissertations by an authorized administrator of UNF Digital Commons. For more information, please contact Digital Projects. © 2014 All Rights Reserved A HYBRID APPROACH TO MUSIC RECOMMENDATION: EXPLOITING COLLABORATIVE MUSIC TAGS AND ACOUSTIC FEATURES by Jaime C. Kaufman A thesis submitted to the School of Computing in partial fulfillment of the requirements for the degree of Master of Science in Computer and Information Sciences UNIVERSITY OF NORTH FLORIDA SCHOOL OF COMPUTING December 2014 Copyright (©) 2014 by Jaime C. Kaufman All rights reserved. Reproduction in whole or in part in any form requires the prior written permission of Jaime C. Kaufman or designated representative. ii The thesis, “A Hybrid Approach to Music Recommendation: Exploiting Collaborative Music Tags and Acoustic Features,” submitted by Jaime C. Kaufman in partial fulfillment of the requirements for the degree of Master of Science in Computer and Information Sciences has been Approved by the thesis committee: Date Dr. Ching-Hua Chuan Thesis Advisor and Committee Chairperson Dr. Sherif Elfayoumy Dr. Karthikeyan Umapathy Accepted for the School of Computing: Dr.
    [Show full text]
  • Combining Content Information with an Item-Based Collaborative Filter
    Volume 2 │ Issue 2 │ 2017 Combining Content Information with an Item-Based Collaborative Filter Daryl Bagley Harding University Arkansas Eta Chapter Vol. 2(2), 2017 Article Title: Combining Content Information with an Item-Based Collaborative Filter DOI: 10.21081/AX0126 ISSN: 2381-800X Key Words: algorithms, anime, collaborative filtering, content analysis, recommendation This work is licensed under a Creative Commons Attribution 4.0 International License. Author contact information is available from the Editor at [email protected]. Aletheia—The Alpha Chi Journal of Undergraduate Scholarship • This publication is an online, peer-reviewed, interdisciplinary undergraduate journal, whose mission is to promote high quality research and scholarship among undergraduates by showcasing exemplary work. • Submissions can be in any basic or applied field of study, including the physical and life sciences, the social sciences, the humanities, education, engineering, and the arts. • Publication in Aletheia will recognize students who excel academically and foster mentor/mentee relationships between faculty and students. • In keeping with the strong tradition of student involvement in all levels of Alpha Chi, the journal will also provide a forum for students to become actively involved in the writing, peer review, and publication process. • More information and instructions for authors is available under the publications tab at www.AlphaChiHonor.org. Questions to the editor may be directed to [email protected]. Alpha Chi is a national college honor society that admits students from all academic disciplines, with membership limited to the top 10 percent of an institution’s juniors, seniors, and graduate students. Invitation to membership comes only through an institutional chapter.
    [Show full text]
  • Kandidat 109
    INFO310 0 Advanced Topics in Model-Based Information Systems Kandidat 109 Oppgaver Oppgavetype Vurdering Status Introduction Dokument Automatisk poengsum Levert Plagiarism and Declaration Dokument Automatisk poengsum Levert 1 Essay Filopplasting Manuell poengsum Levert INFO310 0 Advanced Topics in Model-Based Information Systems Emnekode INFO310 PDF opprettet 16.11.2016 16:36 Vurderingsform INFO310 Opprettet av Andreas Lothe Opdahl Starttidspunkt: 03.11.2016 14:00 Antall sider 22 Sluttidspunkt: 09.11.2016 14:00 Oppgaver inkludert Nei Sensurfrist Ikke satt Skriv ut automatisk rettede Nei 1 Kandidat 109 Seksjon 1 1 OPPGAVE Essay Upload your file here. Maximum one file. BESVARELSE Filopplasting Filnavn 9066477_cand-9333784_9157556 Filtype pdf Filstørrelse 1660.232 KB Opplastingstid 09.11.2016 09:38:21 Neste side Besvarelse vedlagt INFO310 0 Advanced Topics in Model-Based Information Systems Page 2 av 22 Kandidat 109 SEMANTICS TECHNOLOGIES IN STREAMING SERVICES By Gonzalo Molina Gallego INFO310 0 Advanced Topics in Model-Based Information Systems Page 3 av 22 Kandidat 109 INDEX INTRODUCTION ......................................................................................................................... 3 THE ARISING OF STREAMING SERVICES ............................................................................ 3 VIDEO STREAMING SERVICES .......................................................................................... 4 MUSIC STREAMING SERVICES .........................................................................................
    [Show full text]