User Based Hybrid Algorithms for Music Recommendation Systems

Total Page:16

File Type:pdf, Size:1020Kb

User Based Hybrid Algorithms for Music Recommendation Systems User Based Hybrid Algorithms for Music Recommendation Systems By Murtadha Sami Luaibi Al-Maliki The thesis is submitted in partial fulfilment of the requirements for the award of the degree of Doctor of Philosophy of the University of Portsmouth September 2018 Declaration Whilst registered as a candidate for the above degree, I have not been registered for any other research award. The results and conclusions embodied in this dissertation are the work of the named candidate and have not been submitted for any other academic award. Murtadha Sami Luaibi Al-Maliki i Acknowledgment I would like to express my gratitude to my country Iraq, represented by the Prime Minister Office – Higher Committee for Education Development (HCED) in Iraq for giving me this full scholarship to study PhD in the University of Portsmouth; This work would not have been possible without their support and encouragement. Foremost, I would like to express my sincere gratitude to my supervisor Dr. Linda Yang for the continuous support of my PhD study and research, for her patience, motivation, enthusiasm, and immense knowledge. Her guidance helped me in all the time of research and writing of this thesis. I could not have imagined having a better supervisor and mentor for my PhD study. Besides my supervisor, I would like to thank the University of Portsmouth, represented by the School of Energy and Electronic Engineering, the University library and the graduate school – represented by Dr. Heather MacKenzie for being very supportive by providing me an excellent environment and wise advice during my PhD study. Last but not the least, I would like to show my deepest thankful and gratitude to my parents, my brothers, my sisters and my friends (Mahmoud Al-Faris, Mohammed Ibrahim, Mohammed Al- Wattar, Haider Murad, Ahmed Ahmed, Muntadher Fadhil, Mohanad Al-Behadili, Wassem and his wife Maha, Mr. & Mrs. Kirby, etc.) for their love, prayers, courage and moral support they gave me throughout the study. ii Dedication Every challenging work needs self-efforts as well as guidance of elders especially those who were very close to our heart. My humble effort I dedicate to my sweet and loving Father & Mother Whose affection, love, encouragement and prays of day and night make me able to get such success and honour, Along with all hard working and respected Teachers I will be forever grateful to whomever teaches me anything worth learning iii Abstract The amount of music available digitally is overwhelmingly increasing. The main purpose of music recommendation systems is to suggest quality relevant songs that fit with the user’s preferences. Currently, most of the streaming music systems recommend songs based on Collaborative Filtering and Content-Based filtering techniques. However these systems fail in dealing with the Cold-Start problem. This thesis presents user-based hybrid algorithms for music recommendation systems to address the Cold-Start problem and to recommend music for both new and existing users based on their context by integrating the social information to provide context aware personalized music recommendation. This thesis makes two major contributions: First, hybrid recommendation algorithms are developed using multi-strategy approach to give more accurate recommendations by combining collaborative filtering, content based and the user’s context obtained from social network in order to provide both new and existing users with an easy way to discover new songs. In this way, the system is able to estimate what artist/song would match user preferences. Second, a generic Context-Aware Personalised Music (CAPM) framework is proposed for supporting the rapid development of context-aware music recommendation systems and for clarifying the whole process of recommendation. As there are myriad approaches of recommendation, there is a need for a generic framework not only to gather these approaches, but also to interpret them under the proposed framework. Recommendation algorithm types differ by the input structure. For example, social recommendation algorithm uses social information, collaborative filtering uses users rating data, whereas content based recommendation uses item’s characteristics. This difference affects enormously the representation of data and consequently the process of recommendation. CAPM is able to present different input data and uniforms the recommendation process. The proposed algorithms and the framework have been successfully evaluated via practical experiments by real users. The practical experiments are carried out by presenting a Context- Aware Personalised Music (CAPMusic) application in Google Play which helps users to discover new artists, albums or songs. Satisfactory results have been obtained which indicate that using the proposed hybrid recommendation algorithms leads to better results compared with using the pure content based and collaborative filtering techniques. iv Table of Content Declaration ....................................................................................................................................... i Acknowledgment ............................................................................................................................ ii Dedication ....................................................................................................................................... iii Abstract .......................................................................................................................................... iv Chapter 1 Introduction..................................................................................................................1 1.1. Motivation ............................................................................................................................2 1.2. Aims and Objectives ..................................................................................................................... 3 1.3. Contributions........................................................................................................................4 1.4. Thesis Outline ......................................................................................................................4 Chapter 2 Background and Related Work ..................................................................................6 2.1. Recommender systems: main approaches and challenges ........................................................6 2.1.1. Collaborative Filtering Models ............................................................................................7 2.1.2. Content-Based Models .........................................................................................................9 2.1.3. Hybrid Recommender systems ..........................................................................................11 2.2. Music Recommendation Systems ...........................................................................................13 2.3. Factors that Affect Music Recommendation .........................................................................17 2.3.1. Music-related factors .........................................................................................................17 2.3.2. Listener-related factors ......................................................................................................19 2.3.3. Listener context-related factors..........................................................................................20 2.3.4. Music use-related factors ...................................................................................................21 2.4. Mood Categories .....................................................................................................................23 2.5. Summary ................................................................................................................................24 Chapter 3 Context-Aware Personalised Music (CAPM) Framework ....................................26 3.1. System Framework and Design .........................................................................................26 3.2. Server Side .........................................................................................................................28 3.2.1. Data Collection ..................................................................................................................28 3.2.1.1. Last.fm Crawler ...........................................................................................................28 3.2.1.2. Lyric Searcher ..............................................................................................................29 3.2.1.3. LDSD Calculator .........................................................................................................30 v I. Linked Data Semantic Distance (Direct) ........................................................................31 II. Linked Data Semantic Distance (Indirect) .....................................................................33 III. Linked Data Semantic Distance (LDSD) .......................................................................33 3.2.1.4. User Profile Manager ...................................................................................................35 3.2.1.4a. Tweets Collector .............................................................................................................37 3.2.1.4b. Facebook Collector .........................................................................................................38
Recommended publications
  • The Use of Time Dimension in Recommender Systems for Learning
    The Use of Time Dimension in Recommender Systems for Learning Eduardo José de Borba1, Isabela Gasparini1 and Daniel Lichtnow2 1Graduate Program in Applied Computing (PPGCA), Department of Computer Science (DCC), Santa Catarina State University (UDESC), Paulo Malschitzki 200, Joinville, Brazil 2Polytechnic School, Federal University of Santa Maria (UFSM), Av. Roraima 1000, Santa Maria, Brazil Keywords: Recommender System, Context-aware, Time, Learning. Abstract: When the amount of learning objects is huge, especially in the e-learning context, users could suffer cognitive overload. That way, users cannot find useful items and might feel lost in the environment. Recommender systems are tools that suggest items to users that best match their interests and needs. However, traditional recommender systems are not enough for learning, because this domain needs more personalization for each user profile and context. For this purpose, this work investigates Time-Aware Recommender Systems (Context-aware Recommender Systems that uses time dimension) for learning. Based on a set of categories (defined in previous works) of how time is used in Recommender Systems regardless of their domain, scenarios were defined that help illustrate and explain how each category could be applied in learning domain. As a result, a Recommender System for learning is proposed. It combines Content-Based and Collaborative Filtering approaches in a Hybrid algorithm that considers time in Pre- Filtering and Post-Filtering phases. 1 INTRODUCTION potential to improve the quality of recommendation (Campos et al., 2014). Nowadays, there are distinct educational approaches, This work aims to identify how Time-aware RS e.g. online learning, blended learning, face-to-face (Context-aware RS that uses time context) can be learning, etc.
    [Show full text]
  • DSA Partnership Award Submission
    DSA Partnership Award Submission Multibrain Network, Inc. | 11022 Santa Monica Blvd, Suite 330 | Los Angeles, CA 90025 | [email protected] | (855) 34 BRAIN | www.multibrain.net HELLO MULTIBRAIN In 2012, Chief Brain and CEO of Multibrain Scott Kramer met a table full of legends in Direct Selling during a DSA luncheon. From there, the entertainment and media pioneer, dedicated his company (Multibrain) to building the tools and training much needed to take the Direct Selling industry to the next level in technology, and a mission of defining Social Selling in the digital arena. Over the last (7) years, the team at Multibrain has given total focus to training, supporting and providing the tools for Direct Selling consultants to build their business, via social media and establishing their own communities/networks. Today, Multibrain provides solutions for the four core aspects of what they define as Social Selling, beginning with Training the field on the ever-changing world of Social Media. Multibrain has evolved in step with technology and developed a business focused on four pillars for enterprise corporate success, termed “controlled empowerment,” with an approach of “bottom up” beginning at the field level. To date, the Multibrain platform has been successfully implemented by top Direct Selling companies and over 280,000 individual consultants who have generated over 10 million new prospects (connections) in a funnel approach to generating new sales and recruits. Multibrain thrives in its ability to “find new people to talk to” for its users, and a platform as easy to use with a single click. Multibrain Network, Inc.
    [Show full text]
  • Holmen Highlights
    HOLMEN HIGHLIGHTS FEBRUARY, 2020 Hello Students and Families, INSIDE THIS ISSUE: Term 3 is off to a great start! Many students have started new courses and we continue to work and grow in our Professional Learning Communities (PLCs). In our PLCs our teach- ers talk about continuous improvement with a focus on three major areas: student learn- ing, collaboration, and results. Our staff is striving to answer four key questions: what do we want all students to know and be able to do, how will we know if they have learned it, how will we respond when some students do not learn, and how will we extend the learn- ing for students who are already proficient? Our teachers are working to implement a guaranteed and viable curriculum unit by unit: selecting priority standards and learning targets, developing common formative assessments, developing common summative assessments, and using data to improve instruction. We have course level teams in vari- ous places of this process and we are committed to learn and grow as we continuously improve in the focus area of student learning. Junior class and Sophomore class Advisors have started to work through our 2020 ACT Test Prep. In December we shared the Parent/Student Method Test Prep Video. The 11th Grade ACT Test, March 3rd, along with our 10th and 9th grade Aspire Test, April 22nd and 23rd, play an important part of our School Report Card. We use this data to determine where we have gaps in our curriculum or instruction. Please encourage your 11th and 10th grade son/daughter to take full advantage of the free Method Test Prep.
    [Show full text]
  • How to Market Music to Gen-Z: Current Tips & Future Trends PAGE 2 2020 WHAT a YEAR, HUH?
    How To Market Music To Gen-Z: Current Tips & Future Trends PAGE 2 2020 WHAT A YEAR, HUH? HERE AT FANBYTES WE'VE BEEN KEEPING AN EYE ON THINGS AND A LOT HAS CHANGED... 2020, the year of coronavirus, the shutting of venues and the cancelling of festivals. It's been an unprecedented time for all of us but particularly trying for us working in music. As we come out of the other side of summer we wanted to share with you some of the biggest trends across social media from over the summer, some of our most recent standout campaigns, a few tips and tricks on how to market to Gen-Z and finally our two cents on some of the coming future trends that you can tap into. PAGE 3 TIPS & TRICKS FOR MARKETING MUSIC TO GEN-Z PAGE 4 TIPS & TRICKS FOR MARKETING MUSIC TO GEN-Z UNDERSTAND YOUR AUDIENCE Gen Z refers to people born between 1995 and 2009. They’re called ‘digital natives’, having grown up with the internet around them. Gen Z’s environment shapes their preferences: 66% of them use more than one internet device at a time, 75% strongly prefer their smartphone to other devices and the average Gen Z’er spends 10 and a half hours online daily. They spend 23 hours a week online watching video content, and prefer short- form content on TikTok or YouTube. Feeling the pressure to be perfect on Instagram, Gen Z are looking for other ways to connect online, leading to younger audiences on networks like TikTok and Snapchat.
    [Show full text]
  • A Grouplens Perspective
    From: AAAI Technical Report WS-98-08. Compilation copyright © 1998, AAAI (www.aaai.org). All rights reserved. RecommenderSystems: A GroupLensPerspective Joseph A. Konstan*t , John Riedl *t, AI Borchers,* and Jonathan L. Herlocker* *GroupLensResearch Project *Net Perceptions,Inc. Dept. of ComputerScience and Engineering 11200 West78th Street University of Minnesota Suite 300 Minneapolis, MN55455 Minneapolis, MN55344 http://www.cs.umn.edu/Research/GroupLens/ http://www.netperceptions.com/ ABSTRACT identifying sets of articles by keyworddoes not scale to a In this paper, wereview the history and research findings of situation in which there are thousands of articles that the GroupLensResearch project I and present the four broad contain any imaginable set of keywords. Taken together, research directions that we feel are most critical for these two weaknesses represented an opportunity for a new recommender systems. type of filtering, that would focus on finding which INTRODUCTION:A History of the GroupLensProject available articles matchhuman notions of quality and taste. The GroupLens Research project began at the Computer Such a system would be able to produce a list of articles Supported Cooperative Work (CSCW)Conference in 1992. that each user wouldlike, independentof their content. Oneof the keynote speakers at the conference lectured on a Wedecided to apply our ideas in the domain of Usenet his vision of an emerging information economy,in which news. Usenet screamsfor better information filtering, with most of the effort in the economywould revolve around hundreds of thousands of articles posted daily. Manyof the production, distribution, and consumptionof information, articles in each Usenet newsgroupare on the sametopic, so rather than physical goods and services.
    [Show full text]
  • The Example of Swedish Independent Music Fandom by Nancy K
    First Monday Online groups are taking new forms as participants spread themselves amongst multiple Internet and offline platforms. The multinational online community of Swedish independent music fans exemplifies this trend. This participant–observation analysis of this fandom shows how sites are interlinked at multiple levels, and identifies several implications for theorists, researchers, developers, industry and independent professionals, and participants. Contents Introduction Fandom Swedish popular music The Swedish indie music fan community Discussion Conclusion Introduction The rise of social network sites is often taken to exemplify a shift from the interest–based online communities of the Web’s “first” incarnation to a new “Web 2.0” in which individuals are the basic unit, rather than communities. In a recent First Monday article, for instance, boyd (2006) states, “egocentric networks replace groups.” I argue that online groups have not been “replaced.” Even as their members build personal profiles and egocentric networks on MySpace, Facebook, BlackPlanet, Orkut, Bebo, and countless other emerging social network sites, online groups continue to thrive on Web boards, in multiplayer online games, and even on the all–but–forgotten Usenet. However, online communities are also taking a new form somewhere between the site-based online group and the egocentric network, distributing themselves throughout a variety of sites in a quasi–coherent networked fashion. This new form of distributed community poses particular problems for its members, developers, and analysts. This paper, based on over two years of participant–observation, describes this new shape of online community through a close look at the multinational online community of fans of independent rock music from Sweden.
    [Show full text]
  • Coping with Covid-19
    COPING WITH COVID-19 Being Social While Social Distancing Margaret Machara, Ph.D., CFLE, Professor, Department of Human Sciences Contact: 615-963-5628, [email protected] Beatrice Harris, Ph.D., Associate Professor & Extension Specialist Rita Fleming, M.S., Assistant Professor & Extension Specialist Kane Reeves, Ed.D., Extension Agent & County Director “Cherish your human connections: your relationships with friends and family” ― Barbara Bush At a time when most of us have been encouraged to stay home as much as possible, we are reminded how important human connection is. While we’ve struggled to maintain a balance of personal space and connection with the family in our home, we also are missing our other friends and family. Social relationships are connected to positive mental health. We may just need to be creative in how we maintain it right now! KICK IT OLD SCHOOL Make a schedule to remind yourself to call Remember letters? At a time occasionally. If you don’t have a lot to say, write when a trip to the mailbox is down some memories to relive or jokes to share. your big outing for the day, give your friends and family AT YOUR something pleasant to pull out. CONVIENENCE A card, a letter, a postcard, even a package is a nice surprise. This is a busy and strange Even if you don’t have a lot of time for all of us. Many news, saying hello and that people are working from you’re thinking of them keeps home and some may be educating their children the connection alive.
    [Show full text]
  • Mobile Application Recommender System
    UPTEC IT 10 025 Examensarbete 30 hp December 2010 Mobile Application Recommender System Christoffer Davidsson Abstract Mobile Application Recommender System Christoffer Davidsson Teknisk- naturvetenskaplig fakultet UTH-enheten With the amount of mobile applications available increasing rapidly, users have to put a lot of effort into finding applications of interest. The purpose of this thesis is to Besöksadress: investigate how to aid users in the process of discovering new mobile applications by Ångströmlaboratoriet Lägerhyddsvägen 1 providing them with recommendations. A prototype system is then built as a Hus 4, Plan 0 proof-of-concept. Postadress: The work of the thesis is divided into three phases where the aim of the first phase is Box 536 751 21 Uppsala to study related work and related systems to identify promising concepts and features. During the second phase, a prototype system is designed and implemented. Telefon: The outcome and result of the first two phases is then evaluated and analyzed in the 018 – 471 30 03 third and final phase. Telefax: 018 – 471 30 00 The prototype system integrates and extends an existing recommender engine previously used to recommend media items. As a part of the system, an Android Hemsida: application is developed, which observes user actions and presents recommended http://www.teknat.uu.se/student applications to the user. In parallel to the development, the system was tested by a small group of users recruited among colleagues at Ericsson. The data generated during this test period is analyzed to show the usefulness of observed user actions over explicit ratings and the dependency on context for application usage.
    [Show full text]
  • A Systematic Review and Taxonomy of Explanations in Decision Support and Recommender Systems
    Noname manuscript No. (will be inserted by the editor) A Systematic Review and Taxonomy of Explanations in Decision Support and Recommender Systems Ingrid Nunes · Dietmar Jannach Received: date / Accepted: date Abstract With the recent advances in the field of artificial intelligence, an increasing number of decision-making tasks are delegated to software systems. A key requirement for the success and adoption of such systems is that users must trust system choices or even fully automated decisions. To achieve this, explanation facilities have been widely investigated as a means of establishing trust in these systems since the early years of expert systems. With today's increasingly sophisticated machine learning algorithms, new challenges in the context of explanations, accountability, and trust towards such systems con- stantly arise. In this work, we systematically review the literature on expla- nations in advice-giving systems. This is a family of systems that includes recommender systems, which is one of the most successful classes of advice- giving software in practice. We investigate the purposes of explanations as well as how they are generated, presented to users, and evaluated. As a result, we derive a novel comprehensive taxonomy of aspects to be considered when de- signing explanation facilities for current and future decision support systems. The taxonomy includes a variety of different facets, such as explanation objec- tive, responsiveness, content and presentation. Moreover, we identified several challenges that remain unaddressed so far, for example related to fine-grained issues associated with the presentation of explanations and how explanation facilities are evaluated. Keywords Explanation · Decision Support System · Recommender System · Expert System · Knowledge-based System · Systematic Review · Machine Learning · Trust · Artificial Intelligence I.
    [Show full text]
  • Hello! ● Amy Ochoa-Autism Coordinator ● Dr
    Supporting Our Children’s academic & Social Emotional Needs during this challenging time 2 Irvine Unified School District Community Advisory Committee (CAC) Meeting May 28, 2020 Hello! ● Amy Ochoa-Autism Coordinator ● Dr. Stephanie Pettey-Coordinator, Educationally Related Mental Health Services (ERMHS) ● Christina Reyes- Program Specialist Training objectives... 3 • To Review and Understand Strategies/Suggestions for Social Emotional Wellness During School Closure • To Explore General Behavioral Strategies to Use at Home with Your Children • To Provide a Comprehensive Resource Bank How do we adapt this new “normal?” 4 Let’s first recognize the“COVID-19 journey” was unexpected… and none of us were given a guidebook to navigate this! How do we create a new normal? https://www.uth.edu/news/story.htm?id=e5c159f0-11af-4091-9f1d-342b5a64583a 5 Key Components to Social Emotional Wellness For Children during Covid-19 Closure 1. Routines! 2. Communication! 3. Staying Connected! 4. Understanding the Warning Signs! 5. Teaching Coping Skills at Home! 6. Community Resources! Routines!: Gaining Balance Through a Routine 6 https://www.healthychildren.org/English/health-issues/conditions/chest-lungs/Pages/Working-and-Learning-from-Home-During-the-COVID-19-Outbreak.aspx https://www.thisnthatparenting.com/create-a-daily-routine-for-your-family/ https://www.thisnthatparenting.com/create-a-daily-routine-for-your-family/ Routines! :Creating a Routine 7 Develop a Routine that Utilizes the 6 Stress Busting Strategies! 1. Supportive Relationships 2. Exercise 3. Sleep 4. Nutrition 5. Mental Health and Behavioral Health Support 6. Mindfulness/Meditation/Prayer Link: CA Surgeon General Stress Busting Playbook Link: Common Sense edia: Keeping Kids otivated During Online Learning/Routines Link: Sample Schedules for Younger Children Link: Sample Schedule for Teens Communication!: Check-in Frequently and Listen 8 Encourage open communication and provide developmentally appropriate explanations: .
    [Show full text]
  • User Data Analytics and Recommender System for Discovery Engine
    User Data Analytics and Recommender System for Discovery Engine Yu Wang Master of Science Thesis Stockholm, Sweden 2013 TRITA-ICT-EX-2013: 88 User Data Analytics and Recommender System for Discovery Engine Yu Wang [email protected] Whaam AB, Stockholm, Sweden Royal Institute of Technology, Stockholm, Sweden June 11, 2013 Supervisor: Yi Fu, Whaam AB Examiner: Prof. Johan Montelius, KTH Abstract On social bookmarking website, besides saving, organizing and sharing web pages, users can also discovery new web pages by browsing other’s bookmarks. However, as more and more contents are added, it is hard for users to find interesting or related web pages or other users who share the same interests. In order to make bookmarks discoverable and build a discovery engine, sophisticated user data analytic methods and recommender system are needed. This thesis addresses the topic by designing and implementing a prototype of a recommender system for recommending users, links and linklists. Users and linklists recommendation is calculated by content- based method, which analyzes the tags cosine similarity. Links recommendation is calculated by linklist based collaborative filtering method. The recommender system contains offline and online subsystem. Offline subsystem calculates data statistics and provides recommendation candidates while online subsystem filters the candidates and returns to users. The experiments show that in social bookmark service like Whaam, tag based cosine similarity method improves the mean average precision by 45% compared to traditional collaborative method for user and linklist recommendation. For link recommendation, the linklist based collaborative filtering method increase the mean average precision by 39% compared to the user based collaborative filtering method.
    [Show full text]
  • A Recommender System for Groups of Users
    PolyLens: A Recommender System for Groups of Users Mark O’Connor, Dan Cosley, Joseph A. Konstan, and John Riedl Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN 55455 USA {oconnor;cosley;konstan;riedl}@cs.umn.edu Abstract. We present PolyLens, a new collaborative filtering recommender system designed to recommend items for groups of users, rather than for individuals. A group recommender is more appropriate and useful for domains in which several people participate in a single activity, as is often the case with movies and restaurants. We present an analysis of the primary design issues for group recommenders, including questions about the nature of groups, the rights of group members, social value functions for groups, and interfaces for displaying group recommendations. We then report on our PolyLens prototype and the lessons we learned from usage logs and surveys from a nine-month trial that included 819 users. We found that users not only valued group recommendations, but were willing to yield some privacy to get the benefits of group recommendations. Users valued an extension to the group recommender system that enabled them to invite non-members to participate, via email. Introduction Recommender systems (Resnick & Varian, 1997) help users faced with an overwhelming selection of items by identifying particular items that are likely to match each user’s tastes or preferences (Schafer et al., 1999). The most sophisticated systems learn each user’s tastes and provide personalized recommendations. Though several machine learning and personalization technologies can attempt to learn user preferences, automated collaborative filtering (Resnick et al., 1994; Shardanand & Maes, 1995) has become the preferred real-time technology for personal recommendations, in part because it leverages the experiences of an entire community of users to provide high quality recommendations without detailed models of either content or user tastes.
    [Show full text]