DOCSLIB.ORG

Arxiv:1606.07659V3 [Cs.LG] 29 Dec 2017 Rate This Item

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Arxiv:1606.07659V3 [Cs.LG] 29 Dec 2017 Rate This Item Hybrid Recommender System based on Autoencoders Florian Strub Jer´ emie´ Mary Romaric Gaudel fl[email protected] [email protected] [email protected] Univ. Lille, CNRS, Centrale Lille, Inria Univ. Lille, CNRS, Centrale Lille, Inria Univ. Lille, CNRS, Centrale Lille, Inria Abstract systems [Wen et al., 2016] to temporal user-item interac- tions [Dai et al., 2016] through heterogeneous classification Proficient Recommender Systems heavily rely on applied to the recommendation setting [Cheng et al., 2016], Matrix Factorization (MF) techniques. MF aims few attempts have been done to use Neural Networks (NN) in at reconstructing a matrix of ratings from an in- CF. Deep Learning key successes have mainly been on fully complete and noisy initial matrix; this prediction is observable data [LeCun et al., 2015] while CF relies on in- then used to build the actual recommendation. Si- put with missing values. This constraint has received less at- multaneously, Neural Networks (NN) met tremen- tention and remains a challenging problem for NN. Handling dous successes in the last decades but few attempts missing values for CF has first been tackled by Salakhutdi- have been made to perform recommendation with nov et al. [Salakhutdinov et al., 2007] for the Netflix chal- autoencoders. In this paper, we gather the best lenge by using Restricted Boltzmann Machines. More recent practice from the literature to achieve this goal. works train autoencoders to perform CF tasks on explicit data We first highlight the link between these autoen- [Sedhain et al., 2015; Strub et al., 2016] and implicit data coder based approaches and MF. Then, we refine [Zheng et al., 2016]. Other approaches rely on recurrent net- the training approach of autoencoders to handle in- works [Wang et al., 2016]. Although those methods report complete data. Second, we design an end-to-end excellent results, they ignore the cold start scenario and pro- system which handles external information. Fi- vide little insights. nally, we empirically evaluate these approaches on The key contribution of this paper is to collect the best the MovieLens and Douban dataset. practices of autoencoder approaches in order to standardize the use of autoencoders for CF tasks. We first highlight autoencoders perform a factorization of the matrix of rat- 1 Introduction ings. Then we contribute to an end-to-end autoencoder based Recommendation systems advise users on which items approach in two points: (i) we introduce a proper training (movies, music, books etc.) they are more likely to be inter- loss/process of autoencoders on incomplete data, (ii) we in- ested in. A good recommendation system may dramatically tegrate the side information to autoencoders to alleviate the increase the number of sales of a firm or retain customers. cold start problem. Compared to previous attempts in that For instance, 80% of movies watched on Netflix come from direction [Salakhutdinov et al., 2007; Sedhain et al., 2015; the recommender system of the company [Gomez-Uribe and Wu et al., 2016], our framework integrates both ratings and Hunt, 2015]. Collaborative Filtering (CF) aims at recom- side information into a unique network. This joint model mending an item to a user by predicting how a user would leads to a scalable and robust approach which beats state- of-the-art results in CF. Reusable source code is provided in arXiv:1606.07659v3 [cs.LG] 29 Dec 2017 rate this item. To do so, the feedback of one user on some items is combined with the feedback of all other users on all Lua/Torch to reproduce the results. items to predict a new rating. For instance, if someone rated The paper is organized as follows. First, Sec. 2 fixes the a few books, CF objective is to estimate the ratings he would setting and highlights the link between autoencoders and ma- have given to thousands of other books by using the ratings of trix factorization in the context of CF. Then, Sec. 3 describes all the other readers. The most successful approach in CF is to our model. Finally, Sec. 4 details several experimental results factorize an incomplete matrix of ratings [Koren et al., 2009; from our approach. Zhou et al., 2008]. This approach simultaneously learns a representation of users and items that encapsulate the taste, 2 State of the art genre, writing styles, etc. A well-known limit of this ap- proach is the cold start setting: how to recommend an item to 2.1 Matrix Factorization based Collaborative a user when few rating exists for either the user or the item? Filtering While Deep Learning methods start to be used for several One of the most successful approach of CF consists of com- scenarios in recommendation system that goes from dialogue pleting the matrix of ratings through Matrix Factorization (MF) [Koren et al., 2009]. Given N users and M items, we vectors. The task with missing data is all the more difficult as th th denote rij the rating given by the i user for the j item. the missing data have an impact on both input and target vec- It entails an incomplete matrix of ratings R 2 RN×M . MF tors. Miranda et al. [Miranda et al., 2012] study the impact N×M of missing values on autoencoders with industrial data. Yet, aims at finding a rank k matrix Rb 2 R which matches known values of R and predicts unknown ones. Typically, they only have 5% of missing values in her dataset, whereas CF tasks usually have more than 95% of missing values. R = UVT with U 2 N×k, V 2 M×k and (U ,V) the b R R [ et al. ] solution of Autorec Sedhain , 2015 handles the missing values by associating one autoencoder per sample, whose input size X T 2 2 2 arg min (rij − ui vj) + λ(kuikF + kvjkF ); matches the number of known values. The corresponding U;V (i;j)2K(R) weight matrices are shared among the autoencoders. Even if this approach is intellectually appealing, it faces techni- where K(R) is the set of indices of known ratings of R,(ui, cal limitations. First, sharing weights among networks pre- vj) are column-vectors of the low rank rows of (U, V) and vent efficient computations (especially on GPU). Secondly, it k:kF is the Frobenius norm. In the following, ri;: and r:;j will prevents gradient optimization methods such as momentum, respectively be the i-th row and j-th column of R. weight decay, etc. from being applied to missing data. In the rest of the paper, we introduce a new method based on a sin- 2.2 Autoencoder based Collaborative Filtering gle autoencoder to fully regain the benefits of NN techniques. Recently, autoencoders have been used to handle CF prob- Although this architecture is mathematically equivalent to a lems [Sedhain et al., 2015; Strub et al., 2016]. Autoencoders mixture of autoencoders [Sedhain et al., 2015], it turns out to are NN popularized by Kramer [Kramer, 1991].They are un- be a more flexible framework. supervised networks where the output of the network aims CF systems also face the cold start problem. The main at reconstructing the input. The network is trained by back- solution is to supplant the lack of ratings by integrating side propagating the squared error loss on the output. More specif- information. Some approaches [Burke, 2002] mix CF with a ically, when the network limits itself to one hidden layer, its second system based only on side information. Recent work output is tends to incorporate the side information into the matrix com- [ def pletion by modifying the training error Adams et al., 2010; nn(x) = σ(W2σ(W1x + b1) + b2); Chen et al., 2012; Rendle, 2010; Porteous et al., 2010]. In this line of research, some papers incorporate NN embedding with x 2 N the input, W 2 k×N and W 2 N×k the R 1 R 2 R on side information. For instance, [Wang et al., 2014] re- weight matrices, b 2 k and b 2 N the bias vectors, and 1 R 2 R spectively auto-encode bag-of-words from movie plots, [Li et σ(:) a non-linear transfer function. al., 2015] auto-encode heterogeneous side information from In the context of CF, the autoencoder is fed with incom- users and items. Finally, [Wang and Wang, 2014] uses con- plete rows r (resp. columns r ) of R [Sedhain et al., 2015; i;: :;j volutional networks on music samples. From the best of our Strub et al., 2016]. It then outputs a vector ^r (resp. ^r ) i;: :;j knowledge, training a NN from end to end on both ratings which predict the missing entries. Note that these approaches and heterogeneous side information has never been done. In perform a non-linear low-rank approximation of R. Using Sec. 3.2, we build such NN by integrating side information MF notations and assuming that the network works on rows into our CF system. ri;: of R, we recover a predicted vector ^ri;: of the form ^r = σ (Vu ): i;: i 3 End-to-End Collaborative Filtering with 0 1 Autoencoders B σ(W1ri;: + b1) C ^ri;: = nn(ri;:) = σ B [W2 IN ] C : Our approach builds upon an autoencoder to predict full vec- B b2 C @ | {z } A tors ^ri;:/^r:;j from incomplete vectors ri;:/r:;j. As in [Salakhut- V | {z } dinov and Mnih, 2008; Sedhain et al., 2015; Strub et al., ui 2016], we define two types of autoencoders: U-CFN is de- The activation of the hidden units of the autoencoder ui itera- fined as ^ri;: = nn(ri;:) and predicts the missing ratings given tively builds the low rank matrix U.
Load more

Recommended publications
  • Evaluation of Recommendation System for Sustainable E-Commerce: Accuracy, Diversity and Customer Satisfaction
    Preprints (www.preprints.org) | NOT PEER-REVIEWED | Posted: 2 January 2020 doi:10.20944/preprints202001.0015.v1 Article Evaluation of Recommendation System for Sustainable E-Commerce: Accuracy, Diversity and Customer Satisfaction Qinglong Li 1, Ilyoung Choi 2 and Jaekyeong Kim 3,* 1 Department of Social Network Science, KyungHee University, 26, Kyungheedae-ro, Dongdaemun-gu, Seoul, 02453, Republic of Korea; [email protected] 2 Graduate School of Business Administration, KyungHee University, 26, Kyungheedae-ro, Dongdaemun- gu, Seoul, 02453, Republic of Korea; [email protected] 3 School of Management, KyungHee University, 26, Kyungheedae-ro, Dongdaemun-gu, Seoul, 02453, Republic of Korea; [email protected] * Correspondence: [email protected]; Tel.: +82-2-961-9355 (F.L.) Abstract: With the development of information technology and the popularization of mobile devices, collecting various types of customer data such as purchase history or behavior patterns became possible. As the customer data being accumulated, there is a growing demand for personalized recommendation services that provide customized services to customers. Currently, global e-commerce companies offer personalized recommendation services to gain a sustainable competitive advantage. However, previous research on recommendation systems has consistently raised the issue that the accuracy of recommendation algorithms does not necessarily lead to the satisfaction of recommended service users. It also claims that customers are highly satisfied when the recommendation system recommends diverse items to them. In this study, we want to identify the factors that determine customer satisfaction when using the recommendation system which provides personalized services. To this end, we developed a recommendation system based on Deep Neural Networks (DNN) and measured the accuracy of recommendation service, the diversity of recommended items and customer satisfaction with the recommendation service.
    [Show full text]
  • Collaborative Filtering: a Machine Learning Perspective by Benjamin Marlin a Thesis Submitted in Conformity with the Requirement
    Collaborative Filtering: A Machine Learning Perspective by Benjamin Marlin A thesis submitted in conformity with the requirements for the degree of Master of Science Graduate Department of Computer Science University of Toronto Copyright c 2004 by Benjamin Marlin Abstract Collaborative Filtering: A Machine Learning Perspective Benjamin Marlin Master of Science Graduate Department of Computer Science University of Toronto 2004 Collaborative filtering was initially proposed as a framework for filtering information based on the preferences of users, and has since been refined in many different ways. This thesis is a comprehensive study of rating-based, pure, non-sequential collaborative filtering. We analyze existing methods for the task of rating prediction from a machine learning perspective. We show that many existing methods proposed for this task are simple applications or modifications of one or more standard machine learning methods for classification, regression, clustering, dimensionality reduction, and density estima- tion. We introduce new prediction methods in all of these classes. We introduce a new experimental procedure for testing stronger forms of generalization than has been used previously. We implement a total of nine prediction methods, and conduct large scale prediction accuracy experiments. We show interesting new results on the relative performance of these methods. ii Acknowledgements I would like to begin by thanking my supervisor Richard Zemel for introducing me to the field of collaborative filtering, for numerous helpful discussions about a multitude of models and methods, and for many constructive comments about this thesis itself. I would like to thank my second reader Sam Roweis for his thorough review of this thesis, as well as for many interesting discussions of this and other research.
    [Show full text]
  • A Recommender System for Groups of Users
    PolyLens: A Recommender System for Groups of Users Mark O’Connor, Dan Cosley, Joseph A. Konstan, and John Riedl Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN 55455 USA {oconnor;cosley;konstan;riedl}@cs.umn.edu Abstract. We present PolyLens, a new collaborative filtering recommender system designed to recommend items for groups of users, rather than for individuals. A group recommender is more appropriate and useful for domains in which several people participate in a single activity, as is often the case with movies and restaurants. We present an analysis of the primary design issues for group recommenders, including questions about the nature of groups, the rights of group members, social value functions for groups, and interfaces for displaying group recommendations. We then report on our PolyLens prototype and the lessons we learned from usage logs and surveys from a nine-month trial that included 819 users. We found that users not only valued group recommendations, but were willing to yield some privacy to get the benefits of group recommendations. Users valued an extension to the group recommender system that enabled them to invite non-members to participate, via email. Introduction Recommender systems (Resnick & Varian, 1997) help users faced with an overwhelming selection of items by identifying particular items that are likely to match each user’s tastes or preferences (Schafer et al., 1999). The most sophisticated systems learn each user’s tastes and provide personalized recommendations. Though several machine learning and personalization technologies can attempt to learn user preferences, automated collaborative filtering (Resnick et al., 1994; Shardanand & Maes, 1995) has become the preferred real-time technology for personal recommendations, in part because it leverages the experiences of an entire community of users to provide high quality recommendations without detailed models of either content or user tastes.
    [Show full text]
  • Indian Regional Movie Dataset for Recommender Systems
    Indian Regional Movie Dataset for Recommender Systems Prerna Agarwal∗ Richa Verma∗ Angshul Majumdar IIIT Delhi IIIT Delhi IIIT Delhi [email protected] [email protected] [email protected] ABSTRACT few years with a lot of diversity in languages and viewers. As per Indian regional movie dataset is the rst database of regional Indian the UNESCO cinema statistics [9], India produces around 1,724 movies, users and their ratings. It consists of movies belonging to movies every year with as many as 1,500 movies in Indian regional 18 dierent Indian regional languages and metadata of users with languages. India’s importance in the global lm industry is largely varying demographics. rough this dataset, the diversity of Indian because India is home to Bollywood in Mumbai. ere’s a huge base regional cinema and its huge viewership is captured. We analyze of audience in India with a population of 1.3 billion which is evident the dataset that contains roughly 10K ratings of 919 users and by the fact that there are more than two thousand multiplexes in 2,851 movies using some supervised and unsupervised collaborative India where over 2.2 billion movie tickets were sold in 2016. e box ltering techniques like Probabilistic Matrix Factorization, Matrix oce revenue in India keeps on rising every year. erefore, there Completion, Blind Compressed Sensing etc. e dataset consists of is a huge need for a dataset like Movielens in Indian context that can metadata information of users like age, occupation, home state and be used for testing and bench-marking recommendation systems known languages.
    [Show full text]
  • Recommender Systems User-Facing Decision Support Systems
    Recommender Systems User-Facing Decision Support Systems Michael Hahsler Intelligent Data Analysis Lab (IDA@SMU) CSE, Lyle School of Engineering Southern Methodist University EMIS 5/7357: Decision Support Systems February 22, 2012 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 1 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 2 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 3 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 4 / 44 Table of Contents 1 Recommender Systems & DSS 2 Content-based Approach 3 Collaborative Filtering (CF) Memory-based CF Model-based CF 4 Strategies for the Cold Start Problem 5 Open-Source Implementations 6 Example: recommenderlab for R 7 Empirical Evidence Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 5 / 44 Decision Support Systems ? Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 6 / 44 Decision Support Systems \Decision Support Systems are defined broadly [...] as interactive computer-based systems that help people use computer communications, data, documents, knowledge, and models to solve problems and make decisions." Power (2002) Main Components: Knowledge base Model User interface Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 6 / 44 ! A recommender system is a decision support systems which help a seller to choose suitable items to offer given a limited information channel. Recommender Systems Recommender systems apply statistical and knowledge discovery techniques to the problem of making product recommendations. Sarwar et al. (2000) Advantages of recommender systems (Schafer et al., 2001): Improve conversion rate: Help customers find a product she/he wants to buy.
    [Show full text]
  • Incorporating Contextual Information in Recommender Systems Using a Multidimensional Approach
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by CiteSeerX Incorporating Contextual Information in Recommender Systems Using a Multidimensional Approach Gediminas Adomavicius Department of Information & Decision Sciences Carlson School of Management University of Minnesota [email protected] Ramesh Sankaranarayanan Department of Information, Operations & Management Sciences Stern School of Business New York University [email protected] Shahana Sen Marketing Department Silberman College of Business Fairleigh Dickinson University [email protected] Alexander Tuzhilin Department of Information, Operations & Management Sciences Stern School of Business New York University [email protected] Abstract The paper presents a multidimensional (MD) approach to recommender systems that can provide recommendations based on additional contextual information besides the typical information on users and items used in most of the current recommender systems. This approach supports multiple dimensions, extensive profiling, and hierarchical aggregation of recommendations. The paper also presents a multidimensional rating estimation method capable of selecting two- dimensional segments of ratings pertinent to the recommendation context and applying standard collaborative filtering or other traditional two-dimensional rating estimation techniques to these segments. A comparison of the multidimensional and two-dimensional rating estimation approaches is made, and the tradeoffs between the two are studied. Moreover, the paper introduces a combined rating estimation method that identifies the situations where the MD approach outperforms the standard two-dimensional approach and uses the MD approach in those situations and the standard two-dimensional approach elsewhere. Finally, the paper presents a pilot empirical study of the combined approach, using a multidimensional movie recommender system that was developed for implementing this approach and testing its performance.
    [Show full text]
  • Movie Recommendations Using Matrix Factorization
    DEGREE PROJECT IN COMPUTER ENGINEERING, FIRST CYCLE, 15 CREDITS STOCKHOLM, SWEDEN 2016 Movie recommendations using matrix factorization JAKOB IVARSSON MATHIAS LINDGREN KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF COMPUTER SCIENCE AND COMMUNICATION CSC KTH Movie recommendations using matrix factorization Jakob Ivarsson and Mathias Lindgren Degree Project in Computer Science DD143X Supervised by Arvind Kumar Examiner Orjan¨ Ekeberg 11 maj 2016 Abstract A recommender system is a tool for recommending personalized con- tent for users based on previous behaviour. This thesis examines the impact of considering item and user bias in matrix factorization for im- plementing recommender systems. Previous work have shown that user bias have an impact on the predicting power of a recommender system. In this study two different implementations of matrix factorization us- ing stochastic gradient descent are applied to the MovieLens 10M dataset to extract latent features, one of which takes movie and user bias into consideration. The algorithms performed similarly when looking at the prediction capabilities. When examining the features extracted from the two algorithms there was a strong correlation between extracted features and movie genres. We show that each feature form a distinct category of movies where each movie is represented as a combination of the categories. We also show how features can be used to recommend similar movies. Sammanfattning Ett rekommendationssystem ¨ar ett verktyg f¨or att rekommendera an- passat inneh˚allf¨or anv¨andare baserat p˚atidigare beteende hos anv¨andare. I denna avhandling unders¨oker vi hur ett system som anv¨ander matrisfak- torisering p˚averkas n¨ar man tar h¨ansyn till partiskhet.
    [Show full text]
  • Matrix Factorization Technique for Movielens Recommender System
    Matrix Factorization Technique for MovieLens Recommender System Shilpa Balan College of Business and Economics, Department of Information Systems California State University, Los Angeles [email protected] Pamella Howell College of Business and Economics, Department of Information Systems California State University, Los Angeles [email protected] Yash Choksi College of Business and Economics, Department of Information Systems California State University, Los Angeles [email protected] Abstract. Users have online access to millions of audio tracks and movies. Online streaming platforms widely use AI-based recommender systems to help users choose the songs to listen to and the movies to watch. As the volume of available content rises, a standardized methodology to evaluate recommender systems is required. This paper focuses on collaborative-based filtering method of recommender systems. Leveraging the matrix factorization technique, we provide comprehensive information on an algorithm for improving prediction accuracy using standardized Python code and validated with the MovieLens data set. Introduction Researchers estimate that retail e-commerce sales will increase from 3.5 billion in 2019 to 6.5 billion in 2023 (Clement, 2020). The growth of e-commerce has flooded customers with product choices. Consumers inundated with product offerings have to assess what options will meet their needs. As a result, customers face an increased cognitive burden to process data and gather meaningful information for making purchase decisions (Kim, Kim, & Lee, 2000; B. Schafer, Konstan, & Riedl, 2001). Businesses that pair consumers with content meeting their needs will increase satisfaction and retention. Therefore, recommender systems are useful to retailers and content providers. Recommender systems are an algorithmically based technique for providing suggestions to users.
    [Show full text]
  • User- and System Initiated Approaches to Content Discovery
    Degree project User- and system initiated approaches to content discovery Author: Olga Rudakova Supervisor: Ola Petersson Date: 2015-01-15 Level: Master Course code: 5DV00E, 30 credits Department of Computer Science Abstract Social networking has encouraged users to find new ways to create, post, search, collaborate and share information of various forms. Unfortunately there is a lot of data in social networks that is not well-managed, which makes the experience within these networks less than optimal. Therefore people generally need more and more time as well as advanced tools that are used for seeking relevant information. A new search paradigm is emerging, where the user perspective is completely reversed: from finding to being found. The aim of present thesis research is to evaluate two approaches of identifying content of interest: user-initiated and system-initiated. The most suitable approaches will be implemented. Various recommendation systems for system-initiated content recommendations will also be investigated, and the best suited ones implemented. The analysis that was performed demonstrated that the users have used all of the implemented approaches and have provided positive and negative comments for all of them, which reinforces the belief that the methods for the implementation were selected correctly. The results of the user testing of the methods were evaluated based on the amount of time it took the users to find the desirable content and on the correspondence of the result compared to the user expectations. Keywords: user-initiated content discovery, system-initiated content discovery, content-based filtering, collaborative filtering, recommender systems. i Table of Contents 1 Introduction ………………………………………………………..
    [Show full text]
  • Combining Multiple Metadata Types in Movies Recommendation Using Ensemble Algorithms
    Universidade de São Paulo Biblioteca Digital da Produção Intelectual - BDPI Departamento de Ciências de Computação - ICMC/SCC Comunicações em Eventos - ICMC/SCC 2014-11 Combining multiple metadata types in movies recommendation using ensemble algorithms Brazilian Symposium on Multimedia and the Web, 20th, 2014, João Pessoa. http://www.producao.usp.br/handle/BDPI/48641 Downloaded from: Biblioteca Digital da Produção Intelectual - BDPI, Universidade de São Paulo Combining Multiple Metadata Types in Movies Recommendation Using Ensemble Algorithms Bruno Cabral Renato D. Beltrão Marcelo G. Manzato Department of Computer Mathematics and Computing Mathematics and Computing Science Institute - University of São Institute - University of São Federal University of Bahia Paulo Paulo Salvador, Brazil São Carlos, SP – Brazil São Carlos, SP – Brazil [email protected] [email protected] [email protected] Frederico Araújo Durão Department of Computer Science Federal University of Bahia Salvador, Brazil [email protected] ABSTRACT important tools in assisting users to filter what is relevant In this paper, we analyze the application of ensemble al- in this complex information world. There are a number of gorithms to improve the ranking recommendation problem ways to build recommender systems; they are classified as with multiple metadata. We propose three generic ensemble content-based filtering, collaborative filtering or the hybrid strategies that do not require modification of the recom- approach, which combines both filtering strategies [1, 5]. mender algorithm. They combine predictions from a recom- Content-based filtering recommends multimedia content mender trained with distinct metadata into a unified rank to the user based on a profile containing information re- of recommended items.
    [Show full text]
  • Improve the “Long Tail" Recommendation Through Popularity-Sensitive Clustering
    Improve the “Long Tail" Recommendation through Popularity-Sensitive Clustering Huaiyi Huang, Ying Zhao, Jiabao Yan, Lei Yang Department of Computer Science and Technology / Department of Software Engineering Tsinghua University, Beijing, 100084, China {huanghy11, yanjb11, yanglei11}@mails.tsinghua.edu.cn [email protected] ABSTRACT popular items for the lack of information. Several recom- Collaborative filtering(CF) is one of the most successful ap- mendation methods were proposed in the literature with proaches to build recommender system. In recommender the aim of improving the \long tail" recommendation per- system, \long tail" items are considered to be particularly formance [10, 21, 13, 14, 22]. They are either specific rec- valuable. Many clustering algorithms based on CF designed ommendation methods targeting only \long tail" items [10, only to tackle the \long tail" items, while others trade off 21, 22], or comprehensive ones trading-off between overall the overall recommendation accuracy and \long tail" perfor- recommendation accuracy and \long tail" performance [13, mance. Our approach is based on utilizing the item popular- 14]. ity information. We demonstrate that \long tail" recommen- dation can be inferred precisely by balanced item popularity We propose to tackle this problem from a clustering perspec- of each cluster. We propose a novel popularity-sensitive clus- tive. In addition to reaching the common goals of clustering, tering method. In terms of \long tail" and overall accuracy, such as grouping users with similar behaviors or to increase our method outperforms previous ones via experiments on the density of the user-item matrix for each cluster, our clus- MovieLens, citeUlike, and MobileApp.
    [Show full text]
  • Item-Based Collaborative Filtering Recommendation Algorithms
    Item-based Collaborative Filtering Recommendation Algorithms Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl GroupLens Research Group/Army HPC Research Center Department of Computer Science and Engineering University of Minnesota, Minneapolis, MN 55455 {sarwar, karypis, konstan, riedl}@cs.umn.edu Appears in WWW10, May 1-5, 2001, Hong Kong. Abstract Recommender systems apply knowledge discovery techniques to the problem of making personalized recom- mendations for information, products or services during a live interaction. These systems, especially the k-nearest neighbor collaborative filtering based ones, are achieving widespread success on the Web. The tremendous growth in the amount of available information and the number of visitors to Web sites in recent years poses some key challenges for recommender systems. These are: producing high quality recommendations, performing many recommendations per second for millions of users and items and achieving high coverage in the face of data sparsity. In traditional collaborative filtering systems the amount of work increases with the number of participants in the system. New recommender system technologies are needed that can quickly produce high quality recommendations, even for very large-scale problems. To address these issues we have explored item-based collaborative filtering techniques. Item- based techniques first analyze the user-item matrix to identify relationships between different items, and then use these relationships to indirectly compute recommendations for users. In this paper we analyze different item-based recommendation generation algorithms. We look into different techniques for computing item-item similarities (e.g., item-item correlation vs. cosine similarities between item vec- tors) and different techniques for obtaining recommendations from them (e.g., weighted sum vs.
    [Show full text]