DOCSLIB.ORG

Using Implicit Feedback for Task Recommendation In

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Using Implicit Feedback for Task Recommendation In Signals in the Silence: Models of Implicit Feedback in a Recommendation System for Crowdsourcing Christopher H. Lin∗ Ece Kamar and Eric Horvitz Department of Computer Science and Engineering Microsoft Research University of Washington Redmond, WA 98052 Seattle, WA 98195 feckamar,[email protected] [email protected] Abstract al. 1992). A collaborative filtering methodology can handle the inherent diversity of crowdsourcing tasks; the creativity We exploit the absence of signals as informative observations in the context of providing task recommendations in crowd- encouraged by crowdsourcing makes it difficult to create ex- sourcing. Workers on crowdsourcing platforms do not pro- plicit profiles using a fixed set of features for tasks and users. vide explicit ratings about tasks. We present methods that en- Observing the behaviors of users in the crowdsourcing able a system to leverage implicit signals about task prefer- marketplace provides evidence about users’ preferences in ences. These signals include types of tasks that have been the form of implicit feedback. Previous work in collabora- available and have been displayed, and the number of tasks tive filtering uses positive implicit feedback in the context of workers select and complete. In contrast to previous work, a TV recommendation system, by representing the degree to we present a general model that can represent both positive which a viewer likes a certain TV show with the number of and negative implicit signals. We introduce algorithms that times that viewer watches the show (Hu, Koren, and Volin- can learn these models without exceeding the computational complexity of existing approaches. Finally, using data from a sky 2008). While we demonstrate that this approach can be high-throughput crowdsourcing platform, we show that rea- used to generate crowdsourcing recommendations, we show soning about both positive and negative implicit feedback can that it has a significant shortcoming: the prior approach does improve the quality of task recommendations. not address negative implicit feedback. For example, it does not model when viewers may dislike certain shows, leading to a system that only learns the shows that users like and not Introduction the shows they dislike. Although the growth of crowdsourcing has facilitated an un- With crowdsourcing, worker behavior in the marketplace precedented explosion of open-call work, such growth has provides both positive and negative implicit feedback that also brought to the fore new inefficiencies and opportuni- can be used to learn more comprehensive models of work- ties for optimization. For example, the large number of tasks ers’ preferences. Workers who complete large quantities of presented in an unorganized way in marketplaces like Ama- a task provide a signal that they have a preference for that zon’s Mechanical Turk, where over 1,300 types of tasks can task, whereas workers who do not work on tasks that have 1 be available at a given time , can make it challenging for high availability on the system provide a signal that they crowdworkers to identify tasks that they enjoy or that they may not desire those tasks. We present a general-purpose have special competency with solving. Such problems with model that can represent both positive and negative implicit task identification can reduce overall throughput, accuracy, feedback. Our model is expensive to learn with existing ap- and engagement in a crowdsourcing system. proaches. To address this computational challenge, we pro- We present methods that help crowdworkers discover pose a modified coordinate-descent algorithm for tractable tasks that they have not yet worked on, but would be in- learning. We show that the complexity of this approach does terested in performing. A key challenge in crowdsourcing is not exceed the complexity of learning simpler models that that users do not typically provide explicit feedback about consider only positive implicit feedback. In addition, we their preferences by asserting which tasks they like and dis- propose an alternative sampling-based approach that can like through ratings. To help workers find desirable tasks, generate recommendations efficiently by combining multi- we explore methods for leveraging the absence of explicit ple models learned independently via sampling subsets of signals in task recommendation for crowdsourcing. We take the data. inaction in the face of displayed information on available We make the following contributions: tasks as evidence of preferences. Rather than take a content- based approach, we build a collaborative filter (Goldberg et • We develop two new methods for incorporating negative implicit feedback into a predictive modeling system in a ∗Research was performed while the author was an intern at Mi- computationally efficient way. crosoft Research. Copyright c 2014, Association for the Advancement of Artificial • We present what we believe to be the first application of Intelligence (www.aaai.org). All rights reserved. recommendation systems to crowdsourcing. We demon- 1retrieved February 2014 strate how implicit signals can be extracted from the logs of a crowdsourcing platform. Harnessing Implicit Positive Feedback for • We evaluate the proposed approaches on a dataset col- Task Recommendation in Crowdsourcing lected from a live crowdsourcing platform and show that We use the terms workers and users interchangeably. Users the addition of negative implicit feedback is beneficial. may have different backgrounds and capabilities and may have preferences about which types of tasks to work on. A Background on Collaborative Filtering user works on an abstract task by completing at least one Two common types of methods used in collaborative filter- of a collection of instances of that task posted by a single ing systems are neighborhood-based approaches and matrix requester. factorization approaches. Neighborhood-based approaches We define the problem of task recommendation in crowd- (Herlocker et al. 1999) estimate ratings based on either the sourcing as follows: Given a set of users and a set of tasks, ratings of like-minded users or the ratings for similar items we would like to compile, for each user, a personalized rec- (Linden, Smith, and York 2003; Sarwar et al. 2001). Re- ommendation list with tasks that the user has not worked on cent work has shown that matrix factorization approaches yet but that we predict the user would like to work on in have superior performance compared to neighborhood- the future. Since users cannot express explicitly which tasks based models (Koren, Bell, and Volinsky 2009), so we focus they like and which tasks they dislike, we use implicit sig- on matrix factorization models but we present a comparison nals about their behaviors as evidence about their interests. of these models in the experimental section. Specifically, we take the number of times a worker com- We first review matrix factorization approaches for ex- pletes a given task as a positive signal, such that more com- plicit feedback domains. Then, we move on to approaches pletions signal a stronger preference for the task. for harnessing implicit feedback. Let m be the number of IFMF can be applied to the problem of recommending users and let n be the number of items. Let R be an m × n crowdsourcing tasks as follows: Let cij, the implicit posi- matrix where most entries are missing and each non-missing tive signal, be the number of times user i worked on task j. Let the weighting function f be f(c ) = 1+c . Intuitively, rij 2 R is an explicit rating given by user i to item j. The ij ij goal is to learn an m × k matrix U and a k × n matrix V that for every task j that user i has worked on, pij is set to 1, de- minimize the loss function noting that user i likes task j; and for any task j that the user has not worked on, pij is 0, denoting that user i dislikes task X 2 2 2 L(U; V ) = (rij − uivj) + λ(jjUjj2 + jjV jj2) j. By weighting the positive entries of P with the number of i;j tasks a user has completed, we are able to express our con- fidence in each pij = 1, and when we learn the factors U where ui denotes row i of U, vj denotes column j of V , and V , we try harder to fit the entries we have higher confi- and λ denotes a regularization parameter. Then, R^ = UV dence in. For instance, if a user has worked on a given task contains the desired predictions. k can be picked by cross 10,000 times, then we are confident that the user likes that validation, and U and V can be estimated by a variety task (p = 1), and we would very much like to predict p^ = 1. of methods, including stochastic gradient descent (Funk 2006) and alternating least squares (Bell and Koren 2007; Incorporating Implicit Negative Feedback Zhou et al. 2008). Learning U and V exactly is a non-convex IFMF treats all tasks that a user has not worked on the same minimization problem (Srebro and Jaakkola 2003). by assigning the minimum weight to the corresponding en- When explicit feedback is not available, implicit feedback tries. Since this model cannot represent negative implicit can be used to make predictions about users. We general- feedback, the loss function has little emphasis on learn- ize the implicit feedback matrix factorization model (IFMF) ing about the tasks that users dislike. We introduce a novel proposed by Hu, Koren, and Volinsky to use any function model, IFMF2, to address this shortcoming of the IFMF ap- of some positive implicit feedback signal as confidences in proach. IFMF2 uses IFMF as its building block and extends matrix factorization. Given a set of positive implicit feed- it in the following way: Let p = 1 if c > 0 and p = 0 back signals c ≥ 0, we fit and predict an m × n binary ij ij ij ij otherwise.
Load more

Recommended publications
  • CRUC: Cold-Start Recommendations Using Collaborative Filtering in Internet of Things
    CRUC: Cold-start Recommendations Using Collaborative Filtering in Internet of Things Daqiang Zhanga,*, Qin Zoub, Haoyi Xiongc a School of Computer Science, Nanjing Normal University, Nanjing, Jiangsu Province, 210046,China b School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, Hubei Province, 430072, China c Department of Telecommunication, Institute Telecome – Telecom SudParis, Evry, 91011, France Abstract The Internet of Things (IoT) aims at interconnecting everyday objects (including both things and users) and then using this connection information to provide customized user services. However, IoT does not work in its initial stages without adequate acquisition of user preferences. This is caused by cold-start problem that is a situation where only few users are interconnected. To this end, we propose CRUC scheme --- Cold-start Recommendations Using Collaborative Filtering in IoT, involving formulation, filtering and prediction steps. Extensive experiments over real cases and simulation have been performed to evaluate the performance of CRUC scheme. Experimental results show that CRUC efficiently solves the cold-start problem in IoT. Keywords: Cold-start Problem, Internet of Things, Collaborative Filtering 1. Introduction The Internet of Things (IoT) refers to a self-configuring network in which everyday objects are interconnected to the Internet [1] [2]. IoT deploys sensors in infrastructures (e.g., rooms and buildings) to get a heightened awareness of real-time events. It also employs sensors capturing contextual information about objects (e.g., user preferences) to achieve an enhanced situational awareness [3] [21-26]. Readings from a large number of sensors for various objects are enormous, but only a few of them are useful for a specific user.
    [Show full text]
  • Efficient Pseudo-Relevance Feedback Methods for Collaborative Filtering Recommendation
    Efficient Pseudo-Relevance Feedback Methods for Collaborative Filtering Recommendation Daniel Valcarce, Javier Parapar, and Álvaro Barreiro Information Retrieval Lab Computer Science Department University of A Coruña, Spain {daniel.valcarce,javierparapar,barreiro}@udc.es Abstract. Recently, Relevance-Based Language Models have been dem- onstrated as an effective Collaborative Filtering approach. Nevertheless, this family of Pseudo-Relevance Feedback techniques is computationally expensive for applying them to web-scale data. Also, they require the use of smoothing methods which need to be tuned. These facts lead us to study other similar techniques with better trade-offs between effective- ness and efficiency. Specifically, in this paper, we analyse the applicability to the recommendation task of four well-known query expansion tech- niques with multiple probability estimates. Moreover, we analyse the ef- fect of neighbourhood length and devise a new probability estimate that takes into account this property yielding better recommendation rank- ings. Finally, we find that the proposed algorithms are dramatically faster than those based on Relevance-Based Language Models, they do not have any parameter to tune (apart from the ones of the neighbourhood) and they provide a better trade-off between accuracy and diversity/novelty. Keywords: Recommender Systems, Collaborative Filtering, Query Expansion, Pseudo-Relevance Feedback. 1 Introduction Recommender systems are recognised as a key instrument to deliver relevant information to the users. Although the problem that attracts most attention in the field of Recommender Systems is accuracy, the emphasis on efficiency is increasing. We present new Collaborative Filtering (CF) algorithms. CF methods exploit the past interactions betweens items and users. Common approaches to CF are based on nearest neighbours or matrix factorisation [17].
    [Show full text]
  • Combining User-Based and Item-Based Collaborative Filtering Using Machine Learning
    Combining User-Based and Item-Based Collaborative Filtering Using Machine Learning Priyank Thakkar, Krunal Varma, Vijay Ukani, Sapan Mankad and Sudeep Tanwar Abstract Collaborative filtering (CF) is typically used for recommending those items to a user which other like-minded users preferred in the past. User-based collaborative filtering (UbCF) and item-based collaborative filtering (IbCF) are two types of CF with a common objective of estimating target user’s rating for the target item. This paper explores different ways of combining predictions from UbCF and IbCF with an aim of minimizing overall prediction error. In this paper, we propose an approach for combining predictions from UbCF and IbCF through multiple linear regression (MLR) and support vector regression (SVR). Results of the proposed approach are compared with the results of other fusion approaches. The comparison demonstrates the superiority of the proposed approach. All the tests are performed on a large publically available dataset. Keywords User-based collaborative filtering · Item-based collaborative filtering Machine learning · Multiple linear regression · Support vector regression P. Thakkar (B) · K. Varma · V. Ukani · S. Mankad · S. Tanwar Institute of Technology, Nirma University, Ahmedabad 382481, India e-mail: [email protected] K. Varma e-mail: [email protected] V. Ukani e-mail: [email protected] S. Mankad e-mail: [email protected] S. Tanwar e-mail: [email protected] © Springer Nature Singapore Pte Ltd. 2019 173 S. C. Satapathy and A. Joshi (eds.), Information and Communication Technology for Intelligent Systems, Smart Innovation, Systems and Technologies 107, https://doi.org/10.1007/978-981-13-1747-7_17 174 P.
    [Show full text]
  • Towards an Effective Crowdsourcing Recommendation System a Survey of the State-Of-The-Art
    2015 IEEE Symposium on Service-Oriented System Engineering Towards an Effective Crowdsourcing Recommendation System A Survey of the State-of-the-Art Eman Aldhahri, Vivek Shandilya, Sajjan Shiva Computer Science Department, The University of Memphis Memphis, USA {aldhahri, vmshndly, sshiva}@memphis.edu Abstract—Crowdsourcing is an approach where requesters can behaviors. User behavior can be interpreted as preferable call for workers with different capabilities to process a task for features.. Explicit profiles are based on asking users to complete monetary reward. With the vast amount of tasks posted every a preferable features form. Two techniques common in this area day, satisfying workers, requesters, and service providers--who are: a collaborative filtering approach (with cold start problems, are the stakeholders of any crowdsourcing system--is critical to scarcity and scalability in large datasets [6]), and a content- its success. To achieve this, the system should address three based approach (with problems due to overspecialization, etc.). objectives: (1) match the worker with a suitable task that fits the A hybrid approach that combines the two techniques has also worker’s interests and skills, and raise the worker’s rewards; (2) been used. give requesters more qualified solutions with lower cost and II. MOTIVATION time; and (3) raise the accepted tasks rate which will raise the The main objective in this study is to investigate various online aggregated commissions accordingly. For these objectives, we recommendation systems by analyzing their input parameters, present a critical study of the state-of-the-art in effectiveness, and limitations in order to assess their usage in recommendation systems that are ubiquitous among crowdsourcing systems.
    [Show full text]
  • Wiki-Rec: a Semantic-Based Recommendation System Using Wikipedia As an Ontology
    Wiki-Rec: A Semantic-Based Recommendation System Using Wikipedia as an Ontology Ahmed Elgohary, Hussein Nomir, Ibrahim Sabek, Mohamed Samir, Moustafa Badawy, Noha A. Yousri Computer and Systems Engineering Department Faculty of Engineering, Alexandria University Alexandria, Egypt {algoharyalex, hussein.nomier, ibrahim.sabek, m.samir.galal, moustafa.badawym}@gmail.com, [email protected] Abstract— Nowadays, satisfying user needs has become the Hybrid models try to overcome the limitations of each in main challenge in a variety of web applications. Recommender order to generate better quality recommendations. systems play a major role in that direction. However, as most Since most of the information on the web is present in a of the information is present in a textual form, recommender textual form, recommendation systems have to deal with systems face the challenge of efficiently analyzing huge huge amounts of unstructured text. Efficient text mining amounts of text. The usage of semantic-based analysis has techniques are, therefore, needed to understand documents in gained much interest in recent years. The emergence of order to extract important information. Traditional term- ontologies has yet facilitated semantic interpretation of text. based or lexical-based analysis cannot capture the underlying However, relying on an ontology for performing the semantic semantics when used on their own. That is why semantic- analysis requires too much effort to construct and maintain the based analysis approaches have been introduced [1] [2] to used ontologies. Besides, the currently known ontologies cover a small number of the world's concepts especially when a non- overcome such a limitation. The use of ontologies have also domain-specific concepts are needed.
    [Show full text]
  • User Relevance for Item-Based Collaborative Filtering R
    User Relevance for Item-Based Collaborative Filtering R. Latha, R. Nadarajan To cite this version: R. Latha, R. Nadarajan. User Relevance for Item-Based Collaborative Filtering. 12th International Conference on Information Systems and Industrial Management (CISIM), Sep 2013, Krakow, Poland. pp.337-347, 10.1007/978-3-642-40925-7_31. hal-01496080 HAL Id: hal-01496080 https://hal.inria.fr/hal-01496080 Submitted on 27 Mar 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License User Relevance for Item-based Collaborative Filtering R. Latha, R. Nadarajan Department of Applied Mathematics and Computational Sciences, PSG College of Technology, Coimbatore Tamil Nadu, India [email protected], [email protected] Abstract. A Collaborative filtering (CF), one of the successful recommenda- tion approaches, makes use of history of user preferences in order to make pre- dictions. Common drawback found in most of the approaches available in the literature is that all users are treated equally. i.e., all users have same im- portance. But in the real scenario, there are users who rate items, which have similar rating pattern.
    [Show full text]
  • Collaborative Filtering: a Machine Learning Perspective by Benjamin Marlin a Thesis Submitted in Conformity with the Requirement
    Collaborative Filtering: A Machine Learning Perspective by Benjamin Marlin A thesis submitted in conformity with the requirements for the degree of Master of Science Graduate Department of Computer Science University of Toronto Copyright c 2004 by Benjamin Marlin Abstract Collaborative Filtering: A Machine Learning Perspective Benjamin Marlin Master of Science Graduate Department of Computer Science University of Toronto 2004 Collaborative filtering was initially proposed as a framework for filtering information based on the preferences of users, and has since been refined in many different ways. This thesis is a comprehensive study of rating-based, pure, non-sequential collaborative filtering. We analyze existing methods for the task of rating prediction from a machine learning perspective. We show that many existing methods proposed for this task are simple applications or modifications of one or more standard machine learning methods for classification, regression, clustering, dimensionality reduction, and density estima- tion. We introduce new prediction methods in all of these classes. We introduce a new experimental procedure for testing stronger forms of generalization than has been used previously. We implement a total of nine prediction methods, and conduct large scale prediction accuracy experiments. We show interesting new results on the relative performance of these methods. ii Acknowledgements I would like to begin by thanking my supervisor Richard Zemel for introducing me to the field of collaborative filtering, for numerous helpful discussions about a multitude of models and methods, and for many constructive comments about this thesis itself. I would like to thank my second reader Sam Roweis for his thorough review of this thesis, as well as for many interesting discussions of this and other research.
    [Show full text]
  • User Data Analytics and Recommender System for Discovery Engine
    User Data Analytics and Recommender System for Discovery Engine Yu Wang Master of Science Thesis Stockholm, Sweden 2013 TRITA-ICT-EX-2013: 88 User Data Analytics and Recommender System for Discovery Engine Yu Wang [email protected] Whaam AB, Stockholm, Sweden Royal Institute of Technology, Stockholm, Sweden June 11, 2013 Supervisor: Yi Fu, Whaam AB Examiner: Prof. Johan Montelius, KTH Abstract On social bookmarking website, besides saving, organizing and sharing web pages, users can also discovery new web pages by browsing other’s bookmarks. However, as more and more contents are added, it is hard for users to find interesting or related web pages or other users who share the same interests. In order to make bookmarks discoverable and build a discovery engine, sophisticated user data analytic methods and recommender system are needed. This thesis addresses the topic by designing and implementing a prototype of a recommender system for recommending users, links and linklists. Users and linklists recommendation is calculated by content- based method, which analyzes the tags cosine similarity. Links recommendation is calculated by linklist based collaborative filtering method. The recommender system contains offline and online subsystem. Offline subsystem calculates data statistics and provides recommendation candidates while online subsystem filters the candidates and returns to users. The experiments show that in social bookmark service like Whaam, tag based cosine similarity method improves the mean average precision by 45% compared to traditional collaborative method for user and linklist recommendation. For link recommendation, the linklist based collaborative filtering method increase the mean average precision by 39% compared to the user based collaborative filtering method.
    [Show full text]
  • Recommender Systems User-Facing Decision Support Systems
    Recommender Systems User-Facing Decision Support Systems Michael Hahsler Intelligent Data Analysis Lab (IDA@SMU) CSE, Lyle School of Engineering Southern Methodist University EMIS 5/7357: Decision Support Systems February 22, 2012 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 1 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 2 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 3 / 44 Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 4 / 44 Table of Contents 1 Recommender Systems & DSS 2 Content-based Approach 3 Collaborative Filtering (CF) Memory-based CF Model-based CF 4 Strategies for the Cold Start Problem 5 Open-Source Implementations 6 Example: recommenderlab for R 7 Empirical Evidence Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 5 / 44 Decision Support Systems ? Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 6 / 44 Decision Support Systems \Decision Support Systems are defined broadly [...] as interactive computer-based systems that help people use computer communications, data, documents, knowledge, and models to solve problems and make decisions." Power (2002) Main Components: Knowledge base Model User interface Michael Hahsler (IDA@SMU) Recommender Systems EMIS 5/7357: DSS 6 / 44 ! A recommender system is a decision support systems which help a seller to choose suitable items to offer given a limited information channel. Recommender Systems Recommender systems apply statistical and knowledge discovery techniques to the problem of making product recommendations. Sarwar et al. (2000) Advantages of recommender systems (Schafer et al., 2001): Improve conversion rate: Help customers find a product she/he wants to buy.
    [Show full text]
  • A Recommender System Based on Collaborative Filtering Using Ontology and Dimensionality Reduction Techniques
    Expert Systems With Applications 92 (2018) 507–520 Contents lists available at ScienceDirect Expert Systems With Applications journal homepage: www.elsevier.com/locate/eswa A recommender system based on collaborative filtering using ontology and dimensionality reduction techniques ∗ Mehrbakhsh Nilashi a,b, , Othman Ibrahim a, Karamollah Bagherifard c a Faculty of Computing, Universiti Teknologi Malaysia, 81310 Skudai, Johor, Malaysia b Department of Computer Engineering, Lahijan Branch, Islamic Azad University, Lahijan, Iran c Young Researchers and Elite Club, Yasooj Branch, Islamic Azad University, Yasooj, Iran a r t i c l e i n f o a b s t r a c t Article history: Improving the efficiency of methods has been a big challenge in recommender systems. It has been also Received 22 July 2017 important to consider the trade-off between the accuracy and the computation time in recommending Revised 23 September 2017 the items by the recommender systems as they need to produce the recommendations accurately and Accepted 24 September 2017 meanwhile in real-time. In this regard, this research develops a new hybrid recommendation method Available online 29 September 2017 based on Collaborative Filtering (CF) approaches. Accordingly, in this research we solve two main draw- Keywords: backs of recommender systems, sparsity and scalability, using dimensionality reduction and ontology Recommender systems techniques. Then, we use ontology to improve the accuracy of recommendations in CF part. In the CF Ontology part, we also use a dimensionality reduction technique, Singular Value Decomposition (SVD), to find the Clustering most similar items and users in each cluster of items and users which can significantly improve the scal- Dimensionality reduction ability of the recommendation method.
    [Show full text]
  • Recommending Web Pages Using Item-Based Collaborative Filtering Approaches
    Recommending Web Pages Using Item-Based Collaborative Filtering Approaches 1 1( ) 2 Author Proof Sara Cadegnani ,FrancescoGuerra B , Sergio Ilarri , Mar´ıa del Carmen Rodr´ıguez-Hern´andez2,RaquelTrillo-Lado2, and Yannis Velegrakis3 1 Universit`adiModenaeReggioEmilia,Modena,Italy [email protected], [email protected] 2 University of Zaragoza, Zaragoza, Spain silarri.raqueltl @unizar.es, [email protected] { } 3 University of Trento, Trento, Italy [email protected] AQ1 Abstract. Predicting the next page a user wants to see in a large web- site has gained importance along the last decade due to the fact that the Web has become the main communication media between a wide set of entities and users. This is true in particular for institutional govern- ment and public organization websites, where for transparency reasons alotofinformationhastobeprovided.The“longtail”phenomenon affects also this kind of websites and users need support for improving the effectiveness of their navigation. For this reason, complex models and approaches for recommending web pages that usually require to process personal user preferences have been proposed. In this paper, we propose three different approaches to leverage infor- mation embedded in the structure of web sites and their logs to improve the effectiveness of web page recommendation by considering the context of the users, i.e., their current sessions when surfing a specific web site. This proposal does not require either information about the personal preferences of the users to be stored and processed or complex struc- tures to be created and maintained. So, it can be easily incorporated to current large websites to facilitate the users’ navigation experience.
    [Show full text]
  • Collaborative Filtering at Linkedin
    The Browsemaps: Collaborative Filtering at LinkedIn Lili Wu Sam Shah Sean Choi LinkedIn LinkedIn LinkedIn [email protected] [email protected] [email protected] Mitul Tiwari Christian Posse LinkedIn Google [email protected] [email protected] ABSTRACT Many web properties make extensive use of item-based collabo- rative filtering, which showcases relationships between pairs of items based on the wisdom of the crowd. This paper presents LinkedIn’s horizontal collaborative filtering infrastructure, known as browsemaps. The platform enables rapid development, deployment, and computation of collaborative filtering recommendations for al- most any use case on LinkedIn. In addition, it provides centralized management of scaling, monitoring, and other operational tasks for online serving. We also present case studies on how LinkedIn uses this platform in various recommendation products, as well as lessons learned in the field over the several years this system has been in (a) Profiles (b) Jobs production. Keywords: collaborative filtering, social networks, recommender systems 1. INTRODUCTION The proliferation of data and information-rich user experiences have transformed data mining into a core production use case, espe- cially in the consumer web space. A typical example is showcasing relationships between pairs of items based on the wisdom of the crowd, also known as item-to-item collaborative filtering (ICF) [13]. At LinkedIn, the largest online professional social network, item-to- (c) Groups (d) Companies item collaborative filtering is used for people, job, company, group, Figure 1: and other entity recommendations and is a principal component of Examples of browsemaps generated for various enti- engagement. That is, for each entity type on the site, there exists a ties.
    [Show full text]