A Study on Vertical and Broad-Based Search Engines
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Internet Economy 25 Years After .Com
THE INTERNET ECONOMY 25 YEARS AFTER .COM TRANSFORMING COMMERCE & LIFE March 2010 25Robert D. Atkinson, Stephen J. Ezell, Scott M. Andes, Daniel D. Castro, and Richard Bennett THE INTERNET ECONOMY 25 YEARS AFTER .COM TRANSFORMING COMMERCE & LIFE March 2010 Robert D. Atkinson, Stephen J. Ezell, Scott M. Andes, Daniel D. Castro, and Richard Bennett The Information Technology & Innovation Foundation I Ac KNOW L EDGEMEN T S The authors would like to thank the following individuals for providing input to the report: Monique Martineau, Lisa Mendelow, and Stephen Norton. Any errors or omissions are the authors’ alone. ABOUT THE AUTHORS Dr. Robert D. Atkinson is President of the Information Technology and Innovation Foundation. Stephen J. Ezell is a Senior Analyst at the Information Technology and Innovation Foundation. Scott M. Andes is a Research Analyst at the Information Technology and Innovation Foundation. Daniel D. Castro is a Senior Analyst at the Information Technology and Innovation Foundation. Richard Bennett is a Research Fellow at the Information Technology and Innovation Foundation. ABOUT THE INFORMATION TECHNOLOGY AND INNOVATION FOUNDATION The Information Technology and Innovation Foundation (ITIF) is a Washington, DC-based think tank at the cutting edge of designing innovation policies and exploring how advances in technology will create new economic opportunities to improve the quality of life. Non-profit, and non-partisan, we offer pragmatic ideas that break free of economic philosophies born in eras long before the first punch card computer and well before the rise of modern China and pervasive globalization. ITIF, founded in 2006, is dedicated to conceiving and promoting the new ways of thinking about technology-driven productivity, competitiveness, and globalization that the 21st century demands. -
Evaluation of Web-Based Search Engines Using User-Effort Measures
Evaluation of Web-Based Search Engines Using User-Effort Measures Muh-Chyun Tang and Ying Sun 4 Huntington St. School of Information, Communication and Library Studies Rutgers University, New Brunswick, NJ 08901, U.S.A. [email protected] [email protected] Abstract This paper presents a study of the applicability of three user-effort-sensitive evaluation measures —“first 20 full precision,” “search length,” and “rank correlation”—on four Web-based search engines (Google, AltaVista, Excite and Metacrawler). The authors argue that these measures are better alternatives than precision and recall in Web search situations because of their emphasis on the quality of ranking. Eight sets of search topics were collected from four Ph.D. students in four different disciplines (biochemistry, industrial engineering, economics, and urban planning). Each participant was asked to provide two topics along with the corresponding query terms. Their relevance and credibility judgment of the Web pages were then used to compare the performance of the search engines using these three measures. The results show consistency among these three ranking evaluation measures, more so between “first 20 full precision” and search length than between rank correlation and the other two measures. Possible reasons for rank correlation’s disagreement with the other two measures are discussed. Possible future research to improve these measures is also addressed. Introduction The explosive growth of information on the World Wide Web poses a challenge to traditional information retrieval (IR) research. Other than the sheer amount of information, some structural factors make searching for relevant and quality information on the Web a formidable task. -
Internet and Information About Nuclear Sciences
SK00K0107 INTERNET AND INFORMATION ABOUT NUCLEAR SCIENCES. THE WORLD WIDE WEB VIRTUAL LIBRARY: NUCLEAR SCIENCES Jozef KURUC Department of Nuclear Chemistry, Faculty of Natural Sciences, Comenius University, Mlynska dolina CH-1, SK-842 15 Bratislava, Slovak Republic, E-mail: [email protected] Similarly as in other areas, as well as in chemistry, INTERNET has brought revolutionary changes in searching, processing of information and in.the teaching of chemistry [1], The powerful instrument in searching of information in INTERNET are different browsers of the web-pages (www.altavista.com, www.yahoo.com, search.excite.com, www.webcrawier.com, www.iycos.com, infoseeek.go.com, www.hotbot.com, www.zoznam.sk, www.kompas.sk www.seznam.cz and other) [2], but they usually give over-much number of web-pages. Sometimes is ill and slowly to obtain necessary information from so over- much number searched and offered web-pages. By searching in the INTERNET assists the advanced searching, but sometimes it does not conduce to searched information. For assistance by the solving of these problems and for speeding-up of the work serve specialised servers, which give grouped information from certain scientific area and first and foremost links for next relative relevant web-links and web-pages, which are in the area of chemistry, for example, Yahoo- Chemistry-Server [3], list of Mendeleev periodic tables of elements [4], from which each provides certain supplementary information about properties of individual elements, isotopes, occasionally radionuclides. Some of them provide more detail information about radioisotopes [5-7], in nuclear physics it is, for example, Nuclear Info WWW Server [8}. -
How to Choose a Search Engine Or Directory
How to Choose a Search Engine or Directory Fields & File Types If you want to search for... Choose... Audio/Music AllTheWeb | AltaVista | Dogpile | Fazzle | FindSounds.com | Lycos Music Downloads | Lycos Multimedia Search | Singingfish Date last modified AllTheWeb Advanced Search | AltaVista Advanced Web Search | Exalead Advanced Search | Google Advanced Search | HotBot Advanced Search | Teoma Advanced Search | Yahoo Advanced Web Search Domain/Site/URL AllTheWeb Advanced Search | AltaVista Advanced Web Search | AOL Advanced Search | Google Advanced Search | Lycos Advanced Search | MSN Search Search Builder | SearchEdu.com | Teoma Advanced Search | Yahoo Advanced Web Search File Format AllTheWeb Advanced Web Search | AltaVista Advanced Web Search | AOL Advanced Search | Exalead Advanced Search | Yahoo Advanced Web Search Geographic location Exalead Advanced Search | HotBot Advanced Search | Lycos Advanced Search | MSN Search Search Builder | Teoma Advanced Search | Yahoo Advanced Web Search Images AllTheWeb | AltaVista | The Amazing Picture Machine | Ditto | Dogpile | Fazzle | Google Image Search | IceRocket | Ixquick | Mamma | Picsearch Language AllTheWeb Advanced Web Search | AOL Advanced Search | Exalead Advanced Search | Google Language Tools | HotBot Advanced Search | iBoogie Advanced Web Search | Lycos Advanced Search | MSN Search Search Builder | Teoma Advanced Search | Yahoo Advanced Web Search Multimedia & video All TheWeb | AltaVista | Dogpile | Fazzle | IceRocket | Singingfish | Yahoo Video Search Page Title/URL AOL Advanced -
Acquisition Research Sponsored Report Series
65536= 1pt ACQUISITION RESEARCH SPONSORED REPORT SERIES ReSEARCH: A Requirements Search Engine: Progress Report 2 September 2008 by Paige Adams ([email protected]) Pranav Anand ([email protected]) Grant Gehrke ([email protected]) Ralucca Gera ([email protected]) Marco Draeger ([email protected]) Craig Martell ([email protected]) Kevin Squire ([email protected]) Approved for public release, distribution is unlimited. Prepared for: Naval Postgraduate School, Monterey, California 93943 The research presented in this report was supported by the Acquisition Chair of the Grad- uate School of Business & Public Policy at the Naval Postgraduate School. To request Defense Acquisition Research or to become a research sponsor, please contact: NPS Acquisition Research Program Attn: James B. Greene, RADM, USN, (Ret) Acquisition Chair Graduate School of Business and Public Policy Naval Postgraduate School 555 Dyer Road, Room 332 Monterey, CA 93943-5103 Tel: (831) 656-2092 Fax: (831) 656-2253 email: [email protected] Copies of the Acquisition Sponsored Research Reports may be printed from our website www.acquisitionresearch.org Abstract This research addresses three closely related problems. (1) Most current search technology is based on a popularity metric (e.g., PageRank or ExpertRank), but not on the semantic content of the searched document. (2) When building components in a service- oriented architecture (SOA), developers must investigate whether components that meet certain requirements already exist. (3) There is no easy way for writers of requirements documents to formally specify the meaning and domain of their requirements. Our goal in the research presented here is to address these concerns by designing a search engine that searches over the “meanings" of requirements documents. -
Meta Search Engine with an Intelligent Interface for Information Retrieval on Multiple Domains
International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), Vol.1, No.4, October 2011 META SEARCH ENGINE WITH AN INTELLIGENT INTERFACE FOR INFORMATION RETRIEVAL ON MULTIPLE DOMAINS D.Minnie1, S.Srinivasan2 1Department of Computer Science, Madras Christian College, Chennai, India [email protected] 2Department of Computer Science and Engineering, Anna University of Technology Madurai, Madurai, India [email protected] ABSTRACT This paper analyses the features of Web Search Engines, Vertical Search Engines, Meta Search Engines, and proposes a Meta Search Engine for searching and retrieving documents on Multiple Domains in the World Wide Web (WWW). A web search engine searches for information in WWW. A Vertical Search provides the user with results for queries on that domain. Meta Search Engines send the user’s search queries to various search engines and combine the search results. This paper introduces intelligent user interfaces for selecting domain, category and search engines for the proposed Multi-Domain Meta Search Engine. An intelligent User Interface is also designed to get the user query and to send it to appropriate search engines. Few algorithms are designed to combine results from various search engines and also to display the results. KEYWORDS Information Retrieval, Web Search Engine, Vertical Search Engine, Meta Search Engine. 1. INTRODUCTION AND RELATED WORK WWW is a huge repository of information. The complexity of accessing the web data has increased tremendously over the years. There is a need for efficient searching techniques to extract appropriate information from the web, as the users require correct and complex information from the web. A Web Search Engine is a search engine designed to search WWW for information about given search query and returns links to various documents in which the search query’s key words are found. -
DEEP WEB IOTA Report for Tax Administrations
DEEP IOTA Report for Tax Administrations IOTA Report for Tax Administrations – Deep Web DEEP WEB IOTA Report for Tax Administrations Intra-European Organisation of Tax Administrations (IOTA) Budapest 2012 1 IOTA Report for Tax Administrations – Deep Web PREFACE This report on deep Web investigation is the second report from the IOTA “E- Commerce” Task Team of the “Prevention and Detection of VAT Fraud” Area Group. The team started operations in January 2011 in Wroclaw, Poland initially focusing its activities on problems associated with the audit of cloud computing, the report on which was published earlier in 2012. During the Task Teams’ second phase of work the focus has been on deep Web investigation. What can a tax administration possibly gain from the deep Web? For many the deep Web is something of a mystery, something for computer specialists, something they have heard about but do not understand. However, the depth of the Web should not represent a threat as the deep Web offers a very important source of valuable information to tax administrations. If you want to understand, to master and to fully exploit the deep Web, you need to see the opportunities that arise from using information buried deep within the Web, how to work within the environment and what other tax administrations have already achieved. This report is all about understanding, mastering and using the deep Web as the key to virtually all audits, not just those involving E-commerce. It shows what a tax administration can achieve by understanding the deep Web and how to use it to their advantage in every audit. -
Rising to the Top: Evoluoting the Lmprove Retrievol of World Wide
258/ Risingto the Top:Evoluoting the Useof the HTMLMETA Tog lo lmproveRetrievol of WorldWide WebDocuments through InfernefSeorch Engines ThomqsP. Turner ond LiseBrockbill imp rooe re sourc e dis cot: ery. rn |. he problernot'finding materialson the details the number of pagesindexed byvar- \\brld \\'ide \\zeb has been discussed in ious Intemet search enflnes; in addition, library and in{brmation science journals, the speed ol the systerns is evaluated computer literature, and the popular me- (Mele; 1998). Other authors have analyzed dia Internet search engines have been particular aspects of Internet search en- developed to aid in finding rnaterials; how- gines, such as their retrieval precision ever,their per{brmances vary considerably. (Leighton and Srivastava1997), their us- Numerous re.searchers have evaluated abillty (Pollock and Hockley 1997), and these tools and have detailedtheir streneths their indexins methods (Srinivasan, Ruiz, and rveaknesses.Melee's lndexing Cover- and Larn 1906). Some researchers ha't'e ageAnalysis (MICA) report. issuedrveekly, ofl'ered advice to the authors of Hypertext THoMAs P Tunr-rn (tpt2@corr-relledu) is lvletadataLibrarian, Albert R Mann Library, Cornell University, Ithaca, Nerv York Ltst BnacxsILL ([email protected] lib,or us) is Technol- ogv Trarner, Multnomal.r County Library Portland, Oregon Manuscript received February 4, 1998; accepted lbr publication April 17, 1998 LRTS . 12(4) . Rising to the Top /259 Markup Language (HTML) documents METADATA AND THE about improving retrieval of their materials HTML META TeC The current research rvas designed to de- termine how uselul one rnithod, the Much has been rvritten about the impor- HTML META tag. is in irnprovingaccessi- tance of metadata for understanding and bility via Interneisearch engnes; here lve usingelectronic resources This literiture focus on indexins rather than on search en- shedslight on the types of issuesthat the gine per{ormance. -
Information Rereival, Part 1
11/4/2019 Information Retrieval Deepak Kumar Information Retrieval Searching within a document collection for a particular needed information. 1 11/4/2019 Query Search Engines… Altavista Entireweb Leapfish Spezify Ask Excite Lycos Stinky Teddy Baidu Faroo Maktoob Stumpdedia Bing Info.com Miner.hu Swisscows Blekko Fireball Monster Crawler Teoma ChaCha Gigablast Naver Walla Dogpile Google Omgili WebCrawler Daum Go Rediff Yahoo! Dmoz Goo Scrub The Web Yandex Du Hakia Seznam Yippy Egerin HotBot Sogou Youdao ckDuckGo Soso 2 11/4/2019 Search Engine Marketshare 2019 3 11/4/2019 Search Engine Marketshare 2017 Matching & Ranking matched pages ranked pages 1. 2. query 3. muddy waters matching ranking “hits” 4 11/4/2019 Index Inverted Index • A mapping from content (words) to location. • Example: the cat sat on the dog stood on the cat stood 1 2 3 the mat the mat while a dog sat 5 11/4/2019 Inverted Index the cat sat on the dog stood on the cat stood 1 2 3 the mat the mat while a dog sat a 3 cat 1 3 dog 2 3 mat 1 2 on 1 2 sat 1 3 stood 2 3 the 1 2 3 while 3 Inverted Index the cat sat on the dog stood on the cat stood 1 2 3 the mat the mat while a dog sat a 3 cat 1 3 dog 2 3 mat 1 2 Every word in every on 1 2 web page is indexed! sat 1 3 stood 2 3 the 1 2 3 while 3 6 11/4/2019 Searching the cat sat on the dog stood on the cat stood 1 2 3 the mat the mat while a dog sat a 3 cat 1 3 query dog 2 3 mat 1 2 cat on 1 2 sat 1 3 stood 2 3 the 1 2 3 while 3 Searching the cat sat on the dog stood on the cat stood 1 2 3 the mat the mat while a dog sat a 3 cat -
Cut Foliage Grower Volume 15, Number 4 October–December, 2000
EXTENSION Institute of Food and Agricultural Sciences Editor: Robert H. Stamps Christine Taylor Waddill, Dean, Cooperative Extension Cut Foliage Grower Volume 15, Number 4 October–December, 2000 Searching for Information on the Internet Please note: In the fast 1 moving world of the Robert H. Stamps Internet, companies, web sites, addresses, The amount of information available on the Internet is immense and categories, features, etc. growing rapidly. It is estimated that there are 2 billion pages (2) on the change and come and WWW (see Table 1 - glossary) alone. Despite, or perhaps because of, this go rapidly. Therefore, plethora of knowledge, it can be frustrating trying to find information some of the information about a specific topic. Of course, the quality of the information found can contained herein may be obsolete by the time this vary from worthless to extremely useful — but that is a topic for another is published. article. Luckily there are tools that can make the job of finding the information you need easier. These are directories and search engines. In addition, there are metasearch tools that can connect to several directories and/or search engines at a time, purportedly saving you time and effort and returning a greater number of informative hits than available from a single directory or search engine (more on this later). Directories (Table 2) are classification systems created by editors. They are a hierarchal set of specific categories into which selected Web sites are placed. Yahoo, which has evolved into a Web portal (see glossary), started out and still contains a directory. -
Harnessing the Deep Web: Present and Future
Harnessing the Deep Web: Present and Future Jayant Madhavan Loredana Afanasiev Lyublena Antova Alon Halevy Google Inc. Universiteit van Amsterdam Cornell University Google Inc. [email protected] [email protected] [email protected] [email protected] 1. INTRODUCTION pre-compute queries to forms and inserts the resulting pages The Deep Web refers to content hidden behind HTML into a web-search index. These pages are then treated like forms. In order to get to such content, a user has to perform any other page in the index and appear in answers to web- a form submission with valid input values. The name Deep search queries. We have pursued both approaches in our Web arises from the fact that such content was thought to work. In Section 3 we explain our experience with both, be beyond the reach of search engines. The Deep Web is and where each approach provides value. also believed to be the biggest source of structured data on We argue that the value of the virtual integration ap- the Web and hence accessing its contents has been a long proach is in constructing vertical search engines in specific standing challenge in the data management community [1, domains. It is especially useful when it is not enough to 8, 9, 13, 14, 18, 19]. just focus on retrieving data from the underlying sources, Over the past few years, we have built a system that ex- but when users expect a deeper experience with the con- posed content from the Deep Web to web-search users of tent (e.g., making purchases) after they found what they Google.com. -
Search Engines and Power: a Politics of Online (Mis-) Information
5/2/2020 Search Engines and Power: A Politics of Online (Mis-) Information Webology, Volume 5, Number 2, June, 2008 Table of Titles & Subject Authors Home Contents Index Index Search Engines and Power: A Politics of Online (Mis-) Information Elad Segev Research Institute for Law, Politics and Justice, Keele University, UK Email: e.segev (at) keele.ac.uk Received March 18, 2008; Accepted June 25, 2008 Abstract Media and communications have always been employed by dominant actors and played a crucial role in framing our knowledge and constructing certain orders. This paper examines the politics of search engines, suggesting that they increasingly become "authoritative" and popular information agents used by individuals, groups and governments to attain their position and shape the information order. Following the short evolution of search engines from small companies to global media corporations that commodify online information and control advertising spaces, this study brings attention to some of their important political, social, cultural and economic implications. This is indicated through their expanding operation and control over private and public informational spaces as well as through the structural bias of the information they attempt to organize. In particular, it is indicated that search engines are highly biased toward commercial and popular US- based content, supporting US-centric priorities and agendas. Consequently, it is suggested that together with their important role in "organizing the world's information" search engines