Exploring the Value of Folksonomies for Creating Semantic Metadata Hend S
Total Page:16
File Type:pdf, Size:1020Kb
Int’l Journal on Semantic Web & Information Systems, 3(1), 13-39, January-March 2007 13 Exploring The Value Of Folksonomies For Creating Semantic Metadata Hend S. Al-Khalifa, University of Southampton, UK Hugh C. Davis, University of Southampton, UK ABSTRACT Finding good keywords to describe resources is an on-going problem. Typically, we select such words manually from a thesaurus of terms, or they are created using auto- matic keyword extraction techniques. Folksonomies are an increasingly well-populated source of unstructured tags describing Web resources. This article explores the value of the folksonomy tags as a potential source of keyword metadata by examining the relationship between folksonomies, community produced annotations, and keywords extracted by machines. The experiment has been carried out in two ways: subjectively, by asking two human indexers to evaluate the quality of the generated keywords from both systems; and automatically, by measuring the percentage of overlap between the folksonomy set and machine generated keywords set. The results of this experiment show that the folksonomy tags agree more closely with the human generated keywords than those automatically generated. The results also showed that the trained indexers pre- ferred the semantics of folksonomy tags compared to keywords extracted automatically. These results can be considered as evidence for the strong relationship of folksonomies to the human indexer’s mindset, demonstrating that folksonomies used in the del.icio. us bookmarking service are a potential source for generating semantic metadata to annotate Web resources. Keywords: metadata; Web technologies; folksonomy; keyword extraction; tags; social bookmarking services; collaborative tagging INTRODUCTION us2, and Furl3 rely extensively on folk- Nowadays, contemporary Web sonomies. Folksonomies, as a widely applications such as Flickr1, del.icio. accepted neologism and one of Web Copyright © 2007, Idea Group Inc. Copying or distributing in print or electronic forms without written permission of Idea Group Inc. is prohibited. 14 Int’l Journal on Semantic Web & Information Systems, 3(1), 13-39, January-March 2007 2.0 signatures, can be thought of as social bookmarking services, followed keywords that describe what a docu- by a review of related work concerning ment is about. folksonomies and keyword extraction Since people started using the del. techniques. We then discuss the ex- icio.us service in late 2003, many re- perimental setup and the data selection, sources have been bookmarked and along with the four experiments we tagged collaboratively. Using the ser- have carried out to examine the degree vice, people usually tag a resource with of the relationship. Finally, the results words they feel best describe what it is of these experiments, as well as a case about; these words or tags are popularly study, conclusion, and future work are known as folksonomies and the process discussed. as collaborative tagging. We believe that most folksonomy FOLKSONOMY AND SOCIAL words are more related to a profes- BOOKMARKING SERVICES sional indexer’s mindset than keywords The growing popularity of folkson- extracted using generic or proprietary omies and social bookmarking services automatic keyword extraction tech- has changed how people interact with niques. the Web. Many people have used social The main questions this experiment bookmarking services to bookmark Web tries to answer are (1) Do folksonomies resources they feel most interesting to only represent a set of keywords that them; and folksonomies were used in describe what a document is about, or these services to represent knowledge do they go beyond the functionality about the bookmarked resource. of index keywords? (2) What is the relationship between folksonomy tags Folksonomies and keywords assigned by an expert The word folksonomy is a blend of indexer? (3) Where are folksonomies the two words “folks” and “taxonomy.” positioned in the spectrum from profes- It was first coined by the information sionally assigned keywords to context- architect Thomas Vander Wal in August based machine extracted keywords? of 2004. Folksonomy, as Vander Wal In order to find out if folksonomies (2006) defines, is: can improve on automatically extracted keywords, it is significant to examine … the result of personal free tagging of the relationship between them, and information and objects (anything with between them and professional human a URL) for one’s own retrieval. The indexer keywords. tagging is done in a social environment To study these relationships, our (shared and open to others). The act of article is organized as follows: we begin tagging is done by the person consuming with an overview of folksonomies and the information. Copyright © 2007, Idea Group Inc. Copying or distributing in print or electronic forms without written permission of Idea Group Inc. is prohibited. Int’l Journal on Semantic Web & Information Systems, 3(1), 13-39, January-March 2007 15 Figure 1. Excerpt from the del.icio.us service showing the tags (Blogs, Internet, ... ,cool) for the URL of the article by Jonathan J. Harris, the last bookmarker (pacoc, 3mins ago) and the number of people who bookmarked this URL (1494 other people) From a categorization perspec- Social Bookmarking Service tive, folksonomy and taxonomy can Social bookmarking services are be placed at the two opposite ends of server-side Web applications where categorization spectrum. The major people can use these services to save difference between folksonomies and their favorite links for later retrieval. taxonomies is discussed thoroughly in Each bookmarked URL is accompanied Shirky (2005) and Quintarelli (2005). by a line of text describing it and a set Taxonomy is a top-down approach. of tags (aka folksonomies) assigned by It is a simple kind of ontology that pro- people who bookmarked the resource vides hierarchical and domain specific (as shown in Figure 1). vocabulary, which describes the ele- A plethora of bookmarking services ments of a domain and their hierarchal such as Furl4, Spurl5, and del.icio.us ex- relationship. Moreover, they are created ists; however, del.icio.us is considered by domain experts and librarians, and one of the largest social bookmarking require an authoritative source. services on the Web. Since its introduc- In contrast, folksonomy is a bottom- tion in December 2003, it has gained up approach. It does not hold a specific popularity over time and there have vocabulary nor does it have an explicit been more than 90,000 registered users hierarchy. It is the result of peoples’ using the service and over a million own vocabulary, thus, it has no limit (it unique tagged bookmarks (Menchen, is open ended), and tags are not stable 2005; Sieck, 2005). Visitors and users nor comprehensive. Most importantly, of the del.icio.us service can browse folksonomies are generated by people the bookmarked URLs by user, by who have spent their time exploring keywords (i.e., tags or folksonomies), and interacting with the tagged resource or by a combination of both techniques. (Wikipedia, 2006). By browsing others’ bookmarks, people can learn how other people tag their Copyright © 2007, Idea Group Inc. Copying or distributing in print or electronic forms without written permission of Idea Group Inc. is prohibited. 16 Int’l Journal on Semantic Web & Information Systems, 3(1), 13-39, January-March 2007 resources thus increasing their aware- icio.us community). By the same token, ness of the different usage of the tags. Guber is working on a system called In addition, any user can create an “TagOntology” to build ontologies inbox for other users’ bookmarks by out of folksonomies, and in his article subscribing to another user’s del.icio. entitled “Ontology of Folksonomy: us pages. Also, users can subscribe to A Mash-up of Apples and Oranges” RSS feeds for a particular tag, group of (Gruber, 2005) he casts some light on tags or other users. design considerations needed to be taken into account when constructing ontolo- RELATED WORK gies from tags. In addition, Ohmukai, In this section, we review related Hamasaki, and Takeda (2005) proposed work discussing state-of-the-art folk- a social bookmark system called “so- sonomy research and various techniques cialware” using several representations in the keyword extraction domain. of personal network and metadata to construct a community-based ontology. State-of-the-Art Folksonomy The personal network was constructed Research using Friend-Of-A-Friend (FOAF), There is alot of recent research deal- Rich Site Summary (RSS), and simple ing with folksonomies, among these are Resource Description Framework overviews of social bookmarking tools Schema (RDFS), while folksonomies with special emphasis on folksonomies were used as the metadata. Their system as provided by Hammond, Hannay, allows users to browse friends’ book- Lund, and Scott (2005) and other re- marks on their personal networks and search papers that discuss the strengths map their own tag onto more than one and weaknesses of folksonomies (Guy tag from different friends, so that they & Tonkin, 2006; Kroski, 2006; Mathes, are linked by the user. This technique 2004; Quintarelli, 2005). will allow for efficient recommenda- Another genre of research has ex- tion for tags because it is derived from perimented with folksonomy systems. personal interest and trust. They also For instance, Mika (2005) has carried used their social bookmark system out a study to construct a community- “socialware” to design an RDF-based based ontology using del.icio.us as a metadata framework to support open data source. He created two lightweight and distributed models. ontologies out of folksonomies; one is Golder and Huberman (2006) have the actor-concept (user-concept) ontol- analyzed the structure of collaborative ogy and the other is the concept-instance tagging folksonomies) to discover the ontology. The goal of his experiment regularities in user activity, tag frequen- was to show that ontologies can be built cies, the kind of tags used, and bursts of using the context of the community in popularity in bookmarked URLs in the which they are created (i.e., the del.