This article was downloaded by: [University of North Carolina at Chapel Hill] On: 25 January 2010 Access details: Access Details: [subscription number 713585447] Publisher Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37- 41 Mortimer Street, London W1T 3JH, UK

Encyclopedia of Library and Information Sciences, Third Edition Publication details, including instructions for authors and subscription information: http://www.informaworld.com/smpp/title~content=t917508581

Search Engine Optimization Nicholas Carroll a a Hastings Research, Inc., Las Vegas, Nevada, U.S.A.

Online publication date: 09 December 2009

To cite this Article Carroll, Nicholas(2009) ' Optimization', Encyclopedia of Library and Information Sciences, Third Edition, 1: 1, 4613 — 4629

PLEASE SCROLL DOWN FOR ARTICLE

Full terms and conditions of use: http://www.informaworld.com/terms-and-conditions-of-access.pdf

This article may be used for research, teaching and private study purposes. Any substantial or systematic reproduction, re-distribution, re-selling, loan or sub-licensing, systematic supply or distribution in any form to anyone is expressly forbidden.

The publisher does not give any warranty express or implied or make any representation that the contents will be complete or accurate or up to date. The accuracy of any instructions, formulae and drug doses should be independently verified with primary sources. The publisher shall not be liable for any loss, actions, claims, proceedings, demand or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of this material. Search Engine Optimization

Nicholas Carroll Hastings Research, Inc., Las Vegas, Nevada, U.S.A.

Abstract Search engine optimization (SEO) is the craft of elevating Web sites or individual Web site pages to higher rankings on search engines through programming, marketing, or content acumen. This section covers the origins of SEO, strategies and tactics, history and trends, and the evolution of user behavior in online searching.

INTRODUCTION We conclude with a description of SEO regulation, mostly in the form of search engines policing their list- Search engine optimization (SEO) is the craft of elevating ings, and an overview of typical behavior patterns of Web sites or individual Web site pages to higher rankings search engine users. on (WWW) search engines through All the methods described have been or continue to be programming, marketing, or content acumen. The defini- effective SEO to some degree. Changes in search engine tion often includes specifications for increased traffic to a indexing protocols as well as their methods for displaying given Web site, improved quality of traffic, increased search results mean that no strict description of the best profits, or brand awareness. method or methods can remain entirely accurate indefi- In a typical online search on a topic, anywhere from nitely. This entry does not cover pay-per-click, other hundreds to millions of articles may be extracted and forms of online advertising, or the resale of Web site ranked by probability of relevance on a search engine traffic or links. results page (SERP). From the earliest appearance of Because the discipline originated in the mid-1990s, Web search engines, creators of Web sites realized that terminology is still in flux. General references at the end ranking high was vital for visits to their Web sites, since of this entry point to the more authoritative Web sites and users seldom look on even second or third screens of definitions. rankings, let alone the hundredth screen. The numbers of Web sites on the Web increased so rapidly from the be- ginning that the competition for the most desirable top DEFINITION OF HIGHER RANKINGS positions developed rapidly. In this entry, we move through several key aspects of “Higher rankings” in the popular press or lay discussion SEO. First, we define “rankings,” and review the origins generally equates with the goal of having a Web page and history of SEO. Then we discuss what is known as appear in the first 10 or 20 search records for a particular Senegal Science– “Black Hat” and “White Hat” SEO, as the competition for search term, as it is broadly established by tracking that rankings can lead to distortions and misleading rankings, few search engine users will click through to any link Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 depending on what techniques are used. beyond the 20th record. SEO professionals usually discuss The heart of the entry concerns SEO methods. We rankings in terms of SERP position (Fig. 1). review keyword selection and then attend to various Before search engines accepted paid advertisements, aspects of the content of the Web pages, such as keyword SEO was considered a unique form of promotion, radi- density, placement, and consistency. We then go on to the cally different from all traditional forms of advertising. technical aspects and review techniques such as keyword It is now more often considered a subset of search stuffing, meta tags, and cloaking, as well as strategies for engine marketing (SEM), and is sometimes referred to as boosting page rank through links from and to other Web “organic search” or “natural SEM,” as opposed to paid sites, with brief discussion of combined strategies and the advertisements placed on the pages of search engines or analytic methods applied to track results. their affiliates. The entry expands into more general issues such as Online commerce was the originating force behind broad vs. narrow targeting, page longevity and rank, geo- search engine promotion and remains the primary driving graphic targeting, and increasing competition. Trends in force behind SEO. Nonprofits and government bodies SEO practices are described from early to present time, as apply some SEO methods but tend to rely on their unique are external trends affecting SEO. identity to assure them a prominent SERP position,

Encyclopedia of Library and Information Sciences, Third Edition DOI: 10.1081/E-ELIS3-120043453 Copyright # 2010 by Taylor & Francis. All rights reserved. 4613 4614 Search Engine Optimization

Fig. 1 Typical SERP in search for chocolate, showing the first four results.

e.g., the Red Cross, Amnesty International, the Vatican, The early days of search engines were in some ways a the New York Department of Motor Vehicles, or the struggle against pornography. Visitors who started using Peoria Public Library. search engines after 2000 have little conception of how pervasive the online sex industry was at one time, with their records appearing among search results for cooking, art, quilting, travel, and other innocuous subjects. ORIGINS AND HISTORY OF SEO As search engines have grown and become more so- phisticated, and the number of Web sites has increased The term “search engine optimization” came into popular more than tenfold, aggressive maneuvering to rank well in use in 1997–1998 and is frequently attributed to Danny the SERPs has to some extent given way to a focus on Sullivan,[1] then operating “Search Engine Watch,” ranking well in particular niches, and executing well on though Sullivan states he is uncertain who coined it. Pre- fundamentals rather than exercising brilliance in manipu- vious terms included “search engine placement,” “search lating search engines.[4] Science– Senegal engine ranking,” “search engine positioning,” and “search engine promotion,” the latter attributed to Jim Rhodes,[2] author of “The Art of Search Engine Promotion.” Prede- cessors such as Heath[3] in his 1995 article “Pointers on PRACTITIONERS AND SOFTWARE how to create business Web sites that work” did not have Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 a formal name for SEO. Early Search Engine Promoters and Reporters The period from the mid-1990s to about 2000 was characterized by broad experimentation on the part of Early SEO innovation was an individualistic endeavor, both search engines seeking a business model and Web primarily developed by small-to-midsize businesses rang- site creators intent on promoting themselves. Search ing from small hotels to makers of custom sports equip- engines were relatively under-powered and minimally ment. Several such niche and popular products were staffed; their primary focus was on keeping pace with the financially successful, demonstrating that SEO was a path growth in new Web sites. SEO quickly became part of the to profit. American “wild, wild Web” metaphor, with more active Web sites with forums for exchange of SEO strategies Web site owners engaging in a huge variety of methods to began to appear by 1996, including still-existing Web gain higher rankings, as described in “SEO Methods.” In sites such as http://virtualpromote.com, http://www. a period when many multinational organizations did not searchengineforums.com, and the archived http://www. have Web sites at all, smaller and more nimble organiza- deadlock.com/promote. tions and individuals aggressively practiced SEO to estab- Web sites reporting on search engines and optimiza- lish a beachhead on the WWW. tion began about the same time, including http://www. Search Engine Optimization 4615

wilsonweb.com, http://www.searchenginewatch.com, and significant indications of entrepreneurial SEO, including http://www.webmasterworld.com. More recent additions blogs on the subject.[8] include http://www.seobook.com/blog, http://www.search engineland.com, and http://www.toprankblog.com/search- marketing-blogs. BLACK HAT VS. WHITE HAT SEO

The Current SEO Industry “White Hat” SEO typically refers to strategies and tactics that are in concordance with the policies of online search Whether offered as a subset of SEM services or sold alone engines, in a loose tacit agreement to provide Web surfers as organic search, SEO has become a niche industry with with “relevant content.” “Black Hat” SEO describes tac- its own sales forces and conventions. The service may be tics that ignore generally accepted conventions of ethical sold as a one-time audit or on an ongoing basis with WWW behavior to advance an agenda or commercial monthly billing and performance reporting. interest. The focus on search engine policies before other Pure SEO consulting firms now number in the thousands, interests flows from the pervasive position of search primarily concentrated in North America and the United engines, at the mid-point in the process of aggregating Kingdom. Tens of thousands more Web designers and Web page data and delivering it to users. The tilted point developers offer the service as ancillary to building Web of view is buttressed by the oligopoly of major search sites, and an unknown number of Webmasters and Web site engines, with a small number of them processing the vast owners apply SEO methods to their own Web sites. majority of searches, while millions of Web sites vie for Gross expenditures on SEO in 2006 were estimated at high rankings. over USD one billion, with steady annual growth antici- Technically sophisticated tactics are often equated pated. This figure describes organic search and does not with Black Hat SEO, and a focus on high-quality content include paid advertising or most in-house work in smaller with White Hat SEO. However, there is substantial over- companies.[5] lap; few if any tactics can be inherently classified as good or evil. From the perspective of a user, the main criteria of legitimate SEO is whether a given search return is rele- SEO Software (Automating the Process) vant to their interests, regardless of how it achieved its ranking. Most experienced SEO practitioners consider in- Automated Web page submission tools came into being in tent to be the defining factor. the mid-1990s soon after search engines began indexing Typically, methods considered Black Hat SEO develop the WWW. For some years, they were a vital part of SEO high page rankings faster, while those known as White strategy for large Web sites, as manually entering Hat SEO tend to create longer-lasting rankings. A prefer- thousands of into the submission pages of a dozen ence for one approach or the other is not entirely a matter search engines was extremely time-consuming. Submission of the SEO practitioner’s personal preferences; it also tools fell into disuse as search engines became more adept depends on the business model. Web sites or pages pro- at “deep crawling” (following links into the lower levels of moting products and services with short life cycles are Web sites’ file hierarchies). The ones currently in use typi- suited to Black Hat methods, as they do not suffer from cally offer additional features such as help in choosing being “burned,” meaning they have drawn the attention keywords and automated reporting on SERP positions. of search engine administrators and been banned from that Senegal Science– Web analytics tools move beyond automated reporting search engine’s index entirely. (This has also happened to to features such as tracking visitors’ paths through Web [6] sites of long-view organizations such as auto manufacturers Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 sites, and integrating the data with financials. when SEO subcontractors acted with an excess of zeal.) Most content management systems, originally focused White Hat SEO is better suited to Web sites that offer on intranets, now include management features for Web products with long life cycles. It is also suited to aca- sites, and many are programmed to allow a significant [7] demic or government Web sites, where there is likely to modification of variables important to SEO. Likewise be a consistent focus over decades—such Web sites often most blogging software includes features that encourage gain high and enduring SERP rankings simply by publish- users to add keywords to the title tags, the Web page ing high-quality content about a particular subject. body, and the filename of a given Web page.

SEO Worldwide SEO METHODS

While search engines are now used worldwide, most SEO In describing SEO it is necessary to distinguish between reporting is about the United States, Canada, and the automated search engines and manually created directories United Kingdom. Activity in other countries must be in- such as Yahoo! Directory (http://dir.yahoo.com) or the ferred. Australia, Ireland, and Russia in particular have Open Directory Project (ODP) (http://www.dmoz.org), 4616 Search Engine Optimization

where listings are added by human editors rather than almost all Web browsers by selecting the “View > Source” automated protocols. or “View > Page Source” option.)[9] SEO describes strategies and tactics for influencing page rank on search engines that use “robots” (http:// www.robotstxt.org/wc/faq.html) or “spiders” to “crawl” Web pages, traveling from page to page through hyper- ELIS—Encyclopedia of Library and Information links, and indexing those pages by algorithms and proto- Sciences 2008–2009 cols. While directories such as the original Yahoo! ODP pages can frequently be found in SERPs, it is the engines and directories.

ELIS—Encyclopedia of Library and Information Elements of a Web Page to Be Optimized Sciences

Hypertext Markup Lan- pedia cover” /> guage) is referred to throughout this entry. The markup language and page structure used are explained in Table 1

Body content written for SEO is rich in keywords below the example. (Web page structure can be viewed in and also readable. Proper nouns such as “encyclopedia”

Table 1 Tags and text in a simple Web page

Tags and text in a simple Web page, as seen through an HTML editing tool Explanation of HTML tags and structure

Flag to user’s browser: Begin parsing for HyperText Markup Language Begin the head content (which is not visible in a browser) ELIS: Encyclopedia of Library The page title is the single most important part of Web page text for search engine and Information Sciences ranking. While not shown in the body text in a Web browser, it can be seen in the title bar at the top, and is shown as the title of the Web page in almost all search engine listings orient the text towards readers rather than search engines End of the Head section Begin the text visible in a browser

ELIS: Encyclopedia of Library and Headings tags, from H1 down to H6, are the equivalent of chapter and section headings in Information Sciences

books, and are usually considered influential in SEO

Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 to store a brief description, typically keywords

Body content written for SEO is The paragraph tag is the fundamental “container” for body content rich in keywords...[etc.]”

Resources

The second-level heading tag may have influence on SERP position, as well as significance for metadata and document readability

See the encyclopedia description for further information on ELIS.

Keywords: encyclopaedia, taylor, This is an unsightly but often necessary addition to the body content, displaying related francis, marcia, bates, mary, niles, keywords in the body text, where the search engines will read and index them. This maack, mack, optimise

practice evolved when search engines stopped indexing meta keywords End of the body element Flag to user’s browser: end of HTML file

Further information on HTML is available at http://www.w3.org/MarkUp/Guide/. Search Engine Optimization 4617

are used instead of pronouns. Initializations such as medium—“ABC” is not only an initialization for the “SEO” are spelled out as “search engine optimization,” American Broadcasting Company, but hundreds or both to include alternate search terms and to increase key- thousands of other organizations throughout nations word density in the Web page. To target both sophisticated that use the Roman alphabet. and lay searchers, common terms such as “acronym” are used in addition to precise terms such as “initialization.” This leads to a fundamental truth about the limits of Concepts are described by all likely variants, such as SEO as a promotional avenue: it can only succeed if “SERP,” “search engine position,” or “ranking.”

people are searching for relevant keywords. If an idea or product is beyond the public’s conception, it cannot be

Further Encyclopedia Resources

promoted through search engines—in contrast to promo-

See the encyclopedia description for TV, or print. This usually makes SEO a poor method for further information on ELIS.

promoting radically new ideas. For example, “anti-gravity

Keywords: encyclopaedia, taylor, belts” is a search only used by 10-year-old boys. francis, marcia, bates, mary, niles, maack, mack, When possible, experienced SEO practitioners perform optimise

keyword analysis before a Web site is built, expanded, or redesigned, using paid or free online tools such as http:// www.keyworddiscovery.com, http://www.wordtracker.com, http://inventory.overture.com/d/searchinventory/suggestion/ Choosing Keywords to Target—The Core of SEO or https://adwords.google.com/select/KeywordToolExternal to view aggregated searches conducted on search engines.

Regardless of preferred methods, White Hat or Black Hat, Content content or technical, the most critical part of effective SEO is deciding which keywords to target for high rank- At its simplest, the content-focused approach to SEO is to ings. While search engines continually work to improve tell the story thoroughly and precisely, in hopes that the their ranking algorithms, they are not clairvoyant; target- words (content) will find a fit with search engine indexing ing the right keywords is still the foundation of reaching [10] algorithms, and rise in the rankings for particular search the right audience. terms. The presumption in this strategy is that the writer’s A self-centric viewpoint will usually lead an organiza- words will also find harmony with the terms used by tion to aim at high rankings for its own name, services, searchers, and if the writer does have the same interests— agendas, or products. For example, the Raffles Hotel or and frame of reference—as the target audience, this by the band U2 might focus on targeting searches for their itselfcanresultinhighlysuccessfulSEO.(Conversely, own name, in a reasonable belief that most potential cus- Web pages written in ignorance of either subject matter or tomers are specifically seeking them, rather than hotels in audience may achieve high SERP positions, but not neces- Singapore or rock music in general. sarily for the keywords that draw the desired audience.)[11] While this may be a successful strategy for broadly A highly content-oriented strategy is often seen in Web known organizations or people, it is considered poor- sites that were conceived and designed by an individual or quality SEO when an unknown product, service, or agenda small group. Content-oriented Web sites or sub-sites may is being advanced. Products and agendas without name Senegal also come into being in an organization with no SEO Science– recognition are better served by targeting a generic search strategy at all, such as a department of a university, where term such as “stainless steel ball bearings” than a term like the authors are discussing the same or related subjects. Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 “Smith Ball Bearing Company.” A multinational company such as General Electric or Hitachi—that manufactures a Density huge variety of products—might likewise target searches for the products rather than its own company name. Keyword density receives attention because it is easy Regardless of whether the focus is on the organization to understand and simple to calculate through online or the products, SEO can fail when names are chosen density-checkers such as http://www.keyworddensity. without forethought to online search, particularly when com. (Such tools are easily found through search engines they compete with long-established names. Two examples: with the term “keyword density analyzer.”) Though the effectiveness of intentionally repeating key- Any product named “Guardian” must compete in the words throughout a Web page is debated by SEO practi- SERPs with dozens of well-established newspapers tioners, a search for highly promoted products such as throughout the English-speaking world. “loans,” “chocolate,” or “discount shoes” will return nu- Organizations using initializations that might be merous high-ranking Web pages with the core keyword unique in a local telephone directory frequently face repeated dozens of times, and keyword densities reaching obscurity when competing for recognition in a global up to 7% or higher of the page’s content. (However, 4618 Search Engine Optimization

exceptionally high-density pages can suddenly plummet in of that field led virtually all search engines to stop indexing the SERPs or be dropped from the index entirely if search meta keywords. As a result, SEO practitioners reluctantly engines classify them as examples of “keyword spam- turned to placing them as a visible footer on the Web page, ming,” described in the Technical strategies section below.) though this compromises the esthetics of page design. Some Conversely, using a set of keywords only once in a examples of keyword (or “tags”) line listings: Web page usually results in SERP obscurity, even if the Synonyms, cognates, and closely related terms for a set is extremely precise. For example, even “dodo bird medical page about trigeminal neuralgia, formerly called nesting” returns tens of thousands of Web pages, and of tic douloureux: the first few dozen search engine records, almost all will “Keywords: tic douloureux, neuropathy, facial pain, have the three keywords used several times. face pain.” Many SEO practitioners and analysts favor well-written Tangential terms (statistical outliers) for a site on veg- content over keyword density, as search engines become etarian diet: better at differentiating between conventional prose and “Keywords: low sodium, low fat, organic.” deliberately enhanced Web pages. This school of thought Variants on the author’s name for a Web page written says that content should be primarily aimed at humans, not by Jon Smythe: search engines, and that good writing not only entices users “Keywords: John, Smith, Smyth.” to read and act, but is better search engine bait in the first Common misspellings for a travel Web site about place. The belief is often expressed as “Content is king.” Colombia: “Keywords: accommodation, Columbia.” Placement (However, when a keyword tag is used to repeat words already in the body content, it simply becomes “keyword The placement of keywords in a Web page is a significant stuffing”—see “Keyword Loading” below.) factor in SEO, since search engine algorithms accord more weight to certain positions, whether visible or within tags Consistency (see Table 1). Notable areas for placement include: Building a Web site with a consistent pattern of clearly Visible in Web page related keywords is commonly known as creating a Inside heading tags “theme.”[13] A Web site with a clear theme stays on a single Placed at the beginning (top) of a Web page. topic or closely related topics throughout its pages (barring Within outbound links, i.e., “” (example in such standard pages as “Contact Us”). This strategy builds Table 1). the overall ranking of the Web site and, as a consequence, Placed NEAR other keywords (generally within 10 words). the SERP positions of the individual Web pages. Visible in SERPs and browser title bar The concept “clearly related” restricts thematic rank- Inside the HTML tag. building to keyword relationships that search engines are As part of the URL capable of recognizing. Where “ship” and “marina” might begin to build a theme relating to recreational sailing, search Science– Senegal Competition over search terms and SERP positions has ex- engines would be less likely to recognize a theme in a Web panded the use of keywords to the point that they are now page with the separate keywords “ship” and “space.” Once routinely made part of file names (e.g., http://www.mysite. combined into the more specific keyword “spaceship,” the com/used-software-for-sale.html), or may even form the do- page becomes identifiable as related to science fiction or main name itself, e.g., http://www.usedsoftwareforsale.com.</p><p>Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 space exploration, and if the Web site also contains the The title tag is almost universally agreed to be highly words “galaxy” and “parsec,” a theme begins to build. important by SEO practitioners. Most other placements The interest in themes peaked around 2004, alarmists are debated. The <meta¼“keywords”> tag is largely suggesting that Web sites without a keyword theme would considered of no importance. The “alt” content in image plummet in the SERPs.[14] However, there are exceptions tags is considered to the rule: newspapers, encyclopedias, and many news significant in image SERPs, less so in the overall ranking blogs will never have a clear theme, yet they still can of a Web page.[12] reach high SERP positions for a variety of keywords, based on meeting search engine criteria other than consis- Inclusion of related keywords tency of subject matter. Due to the unpredictability of user search behavior, many SEO practitioners include synonyms, cognates, tangential Technical terms, and misspellings in Web pages. In the mid-1990s, SEO practitioners placed such related keywords in the meta A technically oriented SEO strategy emphasizes program- keywords field (see Table 1), but massive abuse and misuse ming skill or ingenuity over command of language, Search Engine Optimization 4619</p><p> familiarity with the target audience, or interweaving them to the rest of the Web site, or redirects them to an related content. Tactics vary from the simple, which can entirely different Web site.[15] Most media coverage of be executed by anyone familiar with HTML, to the so- such pages classifies them as Black Hat SEO. However, phisticated, which require knowledge of programming, there is no clear agreement on the definition of these pages Web site servers, or WWW and Internet protocols. or their relative level of deception. Many SEO practitioners observe that while bridge and jump pages may be technical Keyword loading, stuffing, and spamming and possibly Black Hat as well, all pages visible to search engines are in a real sense entry pages. Keyword density can be taken to an extreme. Efforts to increase keyword density or variety that involve excessive Cloaking or awkward repetition are known as “keyword loading.” An example would be replacing every instance of “it” in a “Cloaking” is used to describe a broad range of tactics. page with the noun in question. The common element is that the human visitor and When this repetition reaches the level of incoherence, the search engine spiders “see” different content when with the same word or words used dozens of times in the visiting a Web page. In the simplest form, the SEO prac- body, title, or tags of a Web page, it is usually called titioner creates a page tuned for high SERP position, and “keyword stuffing” (a.k.a. “cramming”), “spamming the replaces it with a human-readable page after the page has index” (“index” referring to the search engines’ databases been indexed by search engines (of course the artificially of Web pages), or “<a href="/tags/Spamdexing/" rel="tag">spamdexing</a>.” One of the earliest SEO high ranking only lasts until search engine spiders visit tactics, it began with simply repeating keywords hundreds the page again). of times, generally at the bottom of the page, and fre- Two of the more technical methods, which attempt to quently with the font color the same as the background deceive search engines on a continuing basis: color, thus rendering the text invisible to humans. As search engine algorithms began to discount this tactic, � User-agent-specific page delivery, in which the Web keyword spamming evolved into a more precise metering page server “sniffs” the incoming page request, of keyword density. This obsolete technique periodically extracts the data that identifies what browser the visi- sees a resurgence as search engine administrators let tor is running (e.g., “googlebot” or “msnbot”), and down their guard. delivers a special Web page tuned to gain higher SERP on that SE. The meta keywords tag � IP-specific page delivery, in which the Web page server delivers a special Web page based on the visi- Located in the head section of a Web page’s HTML (see tor’s Internet Protocol address (e.g., “127.0.0.1”). Table 1) and invisible to users viewing a Web page in a browser, the meta keywords tag was created purely for Cloaking is broadly considered one of the most aggres- metadata. sive and sophisticated forms of Black Hat SEO, but In the mid to late 1990s meta keywords were highly search engine analysts point out that even cloaking has popular as a quick path to higher rankings, and indeed legitimate purposes, as when a Web site is migrating to a stuffing the meta keywords field showed some success new <a href="/tags/Domain_name/" rel="tag">domain name</a>; the owners may want to keep the when only a few million pages were being indexed. old Web site available to the public until the new one Senegal Science– By the time the tactic became broadly known—with becomes established in SERPs.[16] “keyword-jacking” lawsuits over copyright and trademark Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 infringement—search engines were on their way to down- Linking ranking the meta keywords tag contents, and usually not indexing the keywords in the field at all. Links have become such an important determinant of SERP position that under some circumstances they may Entry pages override all other elements of ranking, and catapult a Web page of little or no relevance to a top SERP position. “Entry page” is the broadest descriptor for the strategy of creating particular pages to rank well with search engines, Link-weighting fundamentals sometimes finely tuned to rank well with a particular search engine. “<a href="/tags/Doorway_page/" rel="tag">Doorway page</a>” and “gateway page” imply Since the mid-1990s, search engines have routinely that a page contains some relevant content that has been tracked the links from (and to) Web sites, often assigning tuned for high SERP position. “Bridge page” or “jump a relative value based on the links’ source or destination. page” imply that a page may be little more than an unin- Links pointing to a Web site are generally called formative <a href="/tags/Landing_page/" rel="tag">landing page</a> that either urges the visitor to click “inbound links,” and links pointing to other Web sites through to the rest of the Web site, automatically redirects “outbound links.” (Inbound links are frequently called 4620 Search Engine Optimization</p><p>“<a href="/tags/Backlink/" rel="tag">backlinks</a>,” though the term has other technical mean- rankings away from a Web site’s designer. Since weight- ings in computing.)[17] ing means that not all inbound links are of equal value to “Link-weighting” is frequently described as “link pop- SERP position, the methodology also opened the door to ularity” or even “popularity” measurements by popular SEO opportunities of bewildering complexity, in which media. More accurately, search engine link analysis algo- Web sites buy, sell, and trade links to and from their Web rithms attempt to infer the value of a Web page or entire sites in order to improve their SERP positions. Web site based on four factors: Always a factor in SEO, “link building” is now broadly considered a core element of strategy, and in 1. The number of inbound links. some schools of thought the most important element.[21] 2. The “quality” of the inbound links, based on the qual- Increasing media attention brought linking as a SERP ity of the originating Web site. Assessing the quality of ranking factor to the attention of Web site owners and Web sites is where link-weighting moves into more the quickly growing number of SEO practitioners, and sophisticated and sometimes arcane mathematics.[18,19] today organizations spend substantial time and effort on In simple terms, an inbound link from a major univer- link building aimed at high rankings. sity has more value than a link from an obscure small Non-reciprocal links (a.k.a. “generosity links”) were business, and has a greater beneficial effect on SERP the first evolution, in the mid-1990s. At that time Web position. site creators linked to almost any remotely related Web 3. The “relevance” of the inbound link. A Web site site, including their competitors. By the late 1990s “recip- about a baseball team benefits more by inbound links rocal links” had become the standard, though the ex- from other baseball-oriented Web sites than by links change was offered with a view to a direct increase in from the personal pages of fans. traffic rather than SERP position. 4. The keywords contained within inbound links (the Soliciting inbound links, at first done casually, now linked text visible in a browser), known as “anchor often means assigning employees or subcontractors to text.” The most famous example was the 2003 link solicit links from high-ranking Web sites. The return on manipulation of Google SERPs (known as “Google investment is questionable—high-ranking Web sites have bombing”) in which hundreds or more Web site owners little to gain by giving an outbound link, and the site inserted the link <ahref¼“http://www.whitehouse. owners may be concerned that linking to a low-quality gov/president/gwbbio.html”>Miserable Failure</a> Web site will harm their own rankings. (Soliciting links into their pages, causing the U.S. White House bio- should not be equated with link building, a broader term graphy of George W. Bush to rise to the top ranking that covers all strategies for gaining inbound links.)[22] for the term “miserable failure.”[20] (The gwbbio.html The practice of posting links in discussion groups also page rose to #1 ranking on Google for that term even originated with the goal of direct traffic rather than influ- though it did not contain either of the keywords in encing SERP positions. “FFAs” (Free For All Web sites), question.) “link farms,” and “link rings” were crude early link- exchange schemes, most variants indiscriminately exchang- The cumulative importance of these factors in SERP po- ing thousands of links without regard to relevance. While Science– Senegal sition has led to naming the collective effect of inbound such sites are still active, their value in SEO has largely links “link juice” (American “slang definition of” “juice”: been eliminated by increasing sophistication of search en- influence, clout, http://www.m-w.com.) gine ranking protocols. Most SEO practitioners today con- Web sites with many relevant or high-quality links sider participating in them to be useless at best, and at worst, pointing to them (inbound links) are known as “authority” possibly injurious to a Web site’s SERP positions. Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 Web sites; those with many links pointing to other rele- “Paid links”—inbound links that have been purchased, vant Web sites (outbound links) as “expert” or “hub” Web sometimes masking as editorial recommendations— sites. The presumption built into the search engine algo- existed before the WWW on Internet bulletin boards, rithms is that a Web site with many inbound links from always with the intent of publicity or direct financial gain. high-quality Web pages is an authoritative source, and With the broadening awareness of SEO, using paid links that pages with many outbound links to authority Web to influence SERP position has become both a business sites serve as a WWW resource. (The mathematics can strategy and a source of contention between Web site become circular and even self-reinforcing, as when http:// owners and search engines. www.wikipedia.org Web pages briefly started to domi- Good content, the oldest link-building strategy of all, is nate #1 SERPs positions for thousands of subjects.) a somewhat indirect way to build links. Coupled with even a modest amount of self-promotion beyond good Strategies for leveraging links SEO—or occasionally just with good content that per- fectly targets a popular search—competent writing on a Link-weighting was implemented to in effect create a particular subject can generate hundreds or thousands of weighted voting scheme and take some of the control of inbound links to a given Web page, often without any Search Engine Optimization 4621</p><p> communication at all with the Web sites that are giving In either case, data is then analyzed manually, or with the links. Because content-inspired linking may produce in-house programming, or with one of the many commer- results slowly (in months or years), and is often difficult cial Web analytics programs. to quantify, few organizations devote serious effort to the The data below is a sample of some of the information method. that can be extracted from Web site server logs: visitor’s ISP, visitor’s IP address, number of pages visited, time and date, visitor’s browser and operating system, the Web Web Site and Web Page Structure site the visitor came from, the search terms they used, and the landing page. The directory (folder) structure of an SE-friendly Web A visitor from “dynamic.dsl.com” (88.104.65.226) was site looks similar to a clearly and logically organized hard logged twice, starting at 12:46:36 on Sunday, October 14, drive on a personal computer, with the additional proviso 2007. that every document is directly or indirectly linked from The initial browser was Firefox/2.0.0.7 (Windows XP; en). the home page or some other prominent Web page. This visitor first arrived from http://www.google.co.uk Ideally the structure is “shallow” (three or fewer sub- while searching “ecommerce business models 1–10” and directory levels), to make it easier for search engines to visited “digitalenterprise.org/models/models.html.” spider, though that has become less important as all major There has been a general shift in Web analytics from search engines now perform deep crawling. log analysis to page tagging, in part due to the limits of log Actual page structure of HTML pages is in theory information compared with information gained by tagging, dictated by an adherence to W3C standards. In practice, and in part driven by vendors of analytics software. Web sites use almost any markup code that can be ren- dered by a Web browser and leave the difficulties of indexing to the search engines. Combining Content, Technical, and Linking SEO There are drawbacks to unorthodoxy where search en- gine rankings are concerned. Use of highly irregular Web Strategies that combine all three forms of SEO may be the site structure, page structure, or file naming conventions most effective in gaining high SERP positions. Combined can seriously harm SERP position. In extreme cases, strategies are uncommon because Web sites are normally search engines simply do not add a Web site to their designed without regard to SEO (although the most effec- indexes; poor Web site structure can be as destructive to tive SEO is begun at the conceptual level), and because Web site rankings as the most extreme Black Hat tactics, Web site owners and managers rarely allow significant and “site maps” generated specifically to aid search changes to the structure or content of their Web sites after engines in indexing a Web site are not a substitute for they are built and online. logical Web site structure.[23] An alternate way of viewing SEO is “on page” or “off Despite a broad disregard for standards among Web page” SEO, the former being methods applied directly to site owners, most SEO practitioners consider disciplined Web sites and pages, the latter focusing on methods ex- [24] site and page structure fundamental good practice, though ternal to a Web site, such as link strategies. these are seen as a foundation for SEO rather than an SEO strategy in themselves. BROAD ISSUES IN SEO Senegal Science– Web Analytics A number of strategic issues that may affect a Web site</p><p>Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 The most thorough SEO practitioners use “Web analyt- go beyond fundamental SEO tactics or current “best ics” to analyze Web site traffic for patterns that can lead practices.” to enhanced SEO. While the term embraces areas more concerned with usability and user behavior while on a Building Downwards vs. Outwards Web site, analytics sweeps in SEO functions such as keyword analysis and SERP position monitoring. Large or growing organizations face the question of Data can be collected by “tagging” individual Web whether to house all their Web pages under a single pages with Javascript and other programming, or by plac- WWW domain, or to establish separate Web sites for ing cookies on visitors’ browsers. different services, product lines, or agendas. An estab- “Keyword analysis” is often initiated at the server level lished organization with a strong brand will usually lean through “log analysis.” Because WWW communications keyword targeting towards its own brand name in SERP protocols usually pass the full URL of the previously positions, and thus benefit from housing all its Web pages visited page to the destination Web site, the headers can under a single domain, whereas a newer organization with be processed for search terms, and those terms then separate divisions would be more likely to establish sepa- organized and further analyzed. rate Web sites for each product line or goal. 4622 Search Engine Optimization</p><p>This is not strictly a business issue; a university estab- There are now indications that the pendulum of interest lishing a new campus in a different city would probably has swung too far towards uncommon terms, and that create a new Web site for that campus, just as a business organizations are targeting long-tail terms without a clear that sells to both architects and game designers might view towards long-term benefits such as memberships or choose to divide its product lines into two separate Web profits.[27] sites. The university would certainly link its two Web sites for the link-weighting benefits; the company selling Balancing Targeting and Serendipity unrelated products might not link its Web sites at all. While some organizations have only one easily described Broad vs. Narrow Targeting and Long-Tail Terms product or agenda, for most organizations SEO can be too successful when it targets particular search terms so The potential benefits in targeting highly specific searches tightly that their Web pages can be found by little else. were known to SEO practitioners by 1995–1996. Bed and When virtually all traffic to a Web site comes from a breakfasts were one of the earliest and most evident small number of terms, analyzing incoming search terms examples, showing how highly specific keywords (e.g., becomes an exercise in analyzing what one already “bed breakfast Ireland Kilkenny”) could reach precisely knows. Ideally, improvements in SEO create an increase the right audience. in targeted traffic along with an increase in unanticipated Since the Web was still sparsely populated, the more search terms. While this can be analyzed in terms of skilled practitioners were able to gain high SERP rank- Zipfian distributions, in proactive marketing it is better ings for broad searches at the same time as they targeted represented by the APUPA (Alien–Penumbral–Umbral– narrow niches. For example, in 1997, it was possible for Penumbral–Alien) bell curve (Fig. 2). an Irish bed and breakfast’s Web site to gain a high SERP SEO can also be too successful when a Web page position for both its own locale and Irish B&Bs in gen- captures a high SERP position on a major search engine eral. That grew more difficult with increasing competi- for an extremely broad term like “health.” Where this tion, and today a search for “bed breakfast Ireland” will might be satisfactory to a large organization like the U.S. generally return a SERP dominated by bed and breakfast National Institutes of Health, an organization focusing on directories and associations. a particular niche of health could be swamped with [28] The changing situation became somewhat better un- masses of unwanted Web site visitors and e-mail. derstood in 2003, when Zipfian distributions were men- Web sites deluged by unwanted traffic sometimes convert tioned in an article by Clay Shirky about “power laws” as a liability to an asset by “reselling” the traffic or the entire applied to blogs.[25] Power laws were later popularized as Web site. “The Long Tail” by an article in Wired magazine.[26] With use of the term growing, many clients and SEO Lead Time and Longevity practitioners now refer to any three- to four-word term as a “long-tail term”; others use the description more cor- Search engines rarely assign top rankings to newly rectly to describe an uncommon search term.</p><p>Science– indexed Web pages. A Web site can take months or even Senegal Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010</p><p>Fig. 2 APUPA chart expressed in SEO terms. Source: # Hastings Research, 2005. Search Engine Optimization 4623</p><p> years to reach its “natural” position in SERPs. This is traffic source analysis remains less precise than that of sometimes called the “sandbox,” referring to the period a traditional promotion and advertising. new Web site may wait for a good SERP position or even to be listed at all by a search engine. Increased Competition Equally, search engines assign value to longevity, and older well-ranked Web sites dating from the 1990s can be The continuing growth in the number of Web sites and notoriously difficult to dislodge from their SERP posi- Web pages means newly created Web sites have increas- tions by new competitors. ing difficulty gaining rankings for common keywords, so their approach is often to use a fanciful domain name and drive Web traffic via social networking or publicity in- Geographic Targeting stead of SEO. Aside from the natural growth in Web sites, huge num- Geographic targeting through SEO had limited success bers of “made for ads” (MFA) Web sites have been cre- through the mid-00s. Few early Web site designers made ated for no purpose other than to make money by hosting a diligent attempt to anticipate all the geographic keywords online advertisements—they have no products, services, searchers might use, and those who did target searches or agendas of their own. Because advertising revenue with geographic keywords often used so many keywords indirectly comes from organizations that pay for online (e.g., “London,” “Pimlico,” “Knightsbridge,” “Belgravia,” ads, MFA Web sites often specifically target keywords “Dulwich,” “Stratford,” “Paddington,” “Fleet Street”—and used by existing organizations. Nonprofit informational every other village and neighboring town) that the pages Web sites such as Wikipedia (http://www.wikipedia.org/) were treated as index spam by search engines, and down- also compete directly for many search terms, often gain- ranked to obscurity. Other designers created dozens or ing very high search rankings. even thousands of “mirror pages” (pages with substantially similar content), each targeting a particular locale, with the result that the pages were down-ranked for “duplicate Search Engines Only Index Words content.” In a cause-and-effect loop, users learned that searching While search engines are often technically capable of by locale was nearly useless, and abandoned the effort distilling words when they are represented in images, and (with the exception of specific travel destinations), lead- in theory from audio tracks, in practice they index words ing most SEO practitioners to abandon their efforts at from readable text documents, file names, or metadata geographic targeting. attached to other forms of electronic files. There is a With the now-growing success of geographic targeting persistent failure to understand this aspect of SEO, with efforts by search engines—typically displaying maps many Web site owners believing that if the human eye showing physical locations—users have again started can read the words or grasp the meaning, the search searching geographically, and most SEO practitioners ad- engines will correctly index the files. vise making some effort to target searches containing Further restricting SEO, search engines by choice in- geographic keywords, even though geographic searches dex only certain types of text documents or metadata. At may be defined by commercial databases rather than one time that meant pure text or HTML only. Most search SEO efforts. engines are now willing to crawl and index file formats</p><p> such as PDF (Portable Document Format), Microsoft Senegal Science– Word and Excel, and in some cases Flash. SEO Source Tracking Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 The wealth of data that accompanied visitors to Web sites TRENDS led many ecommerce pioneers to think the perfection of marketing analysis had arrived. While this sometimes Fading Trends bordered on true for new businesses that were entirely WWW-based, the opposite turned out to be the case for “Meta keyword tags” were the first major chimera in SEO large, established organizations already being marketed (“The meta keywords tag” earlier) They have been fol- through advertising, mail, public relations, and retail out- lowed by other imaginary fast-tracks to high SERP posi- lets; the WWW added another layer of complexity to their tion, all beginning with a grain of truth then blown out of market tracking. Due to its 24-hr availability, the WWW proportion. also creates a “smoothing” effect on response to promo- “Google PageRank” has been one of the most persis- tional efforts, which can hinder analysis of event-driven tent areas of focus in SEO. Because of media attention spikes in visitor traffic. and the easy access to the publicly visible PageRank via Refinements in Web analytics have not entirely com- the Google Toolbar, the scale has commanded a great pensated for these factors, and in many ways Web site deal of interest from Web site owners, many of whom 4624 Search Engine Optimization</p><p> consider the published PageRank a practical scale for arisen with each evolution in Web site development, from performance-based SEO contracts. Most SEO profes- “dynamic page delivery” (assembling Web pages from sionals now consider public PageRank in itself a minor databases “on the fly”) through Cascading Style Sheets factor in a Web site’s actual SERP positions, more an and PDF files. In most previous instances, organizations’ effect than a cause. The latter opinion is to some extent design preferences have won out over SEO considera- corroborated by Google, Inc.[29] Over the course of 2007, tions, and eventually the major search engines have countless Web sites saw their Google public PageRank adapted their protocols to classify new Web page struc- drop significantly, which may further diminish interest in tures and document formats. the measurement. (“PageRank” in popular usage should Since search engines do not immediately retool for not be confused with “<a href="/tags/PageRank/" rel="tag">pagerank</a>,” an internal Google term.) new forms of Web page markup and structure, Web sites Web site “traffic”—whether measured in “hits” that employ Web 2.0 methods such as AJAX (Asynchro- (requests for individual files, whether pages or images), nous Javascript and XML) or that stream together content “page views,” “unique visitors,” or the dot-com measure from different sources (“mashups”) may drop in SERP of “more eyeballs”—is slowly losing its popular connec- positions until search engines decide how to interpret tion to rankings, as organizations focus on conversion rate these new document structures. of users’ visits to desired actions. (In extreme cases, traf- fic volume will have greater influence on SERP positions Trends Affecting SEO than relevance; however, this is uncommon and often results from a situation such as a major news event, where New search engine presentation methods the boost in rankings may be due to a proliferation of inbound links, rather than traffic volume itself.) Clusters of search records such as those displayed by http://www.clusty.com or http://www.ask.com are likely Current Trends to continue improving in relevance; if they increase in popularity, each cluster link will constitute a second-tier Link building previously described in “Link-weighting SERP, and SEO may begin targeting particular clusters. fundamentals” Drop-down contextual search suggestions are now of- Pursuing “long-tail” searches (previously described fered at http://www.ask.com and http://www.yahoo.com. in “Broad vs. Narrow Targeting and Long-Tail Terms”) Because users see contextual suggestions as they type, Bringing SEO in-house: Major companies in North even before seeing the first SERP, “contextual position” America and Europe are increasingly bringing SEO in- may become a sought-after goal of SEO. Since contextual house as their online sales grow to (USD) millions or suggestions are all displayed on the first screen of a search hundreds of millions. Companies are hiring in consul- engine’s Web site, without the need for scrolling down, [30] tants, training current employees, or both. position is not likely to be as critical as SERP position, Using best practices: Clients and employers are now and “contextual inclusion” may prove to be the desired commonly asking that practitioners follow “best prac- goal. (Contextual search flows from a given search engine’s tices.” For SEO, the term describes such basic practices database of “most likely” requests; it should not be con- Science– Senegal as prioritizing meta titles and heading tags, including key- fused with the URL suggestions that Web browsers make [31] words, and avoiding discredited (Black Hat) tactics. by accessing a user’s own search history.) (Fig. 3) Tuning metadata for search engine interfaces: Increas- With exceptions, such as the European search engine ingly, practitioners structure Web pages so that titles, Kartoo (http://www.kartoo.com), interfaces such as topic descriptions, and filenames are presented appealingly on maps and link maps show little sign of entering the main- Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 SERPs. Eye-tracking studies, where eye motion is repre- stream of WWW search, and thus do not affect SEO. sented by printed “heat maps,” are currently the basis for Blended search—the blending into the primary WWW [32] most decisions in tuning metadata. SERPs of news, images, maps, videos, and other types of Tagging Web pages: adding keywords or allowing visi- records once considered niche searches—have now been tors to add keywords to the visible text—is common on instituted by major search engines.[34] This presents many social networking Web sites and some ecommerce and media Web sites, but has shown mixed results in improving SERP positions, possibly due to the indiscrim- inately chosen keywords selected by lay users, Web site owners, and bloggers. Tagging may benefit SERP posi- tion most for Web sites that encourage commentators to use “controlled vocabularies.”[33] It may also boost SERP positions for “long-tail” search terms. Web 2.0 designs: Web 2.0 methods have been criti- cized as being detrimental to SEO. This criticism has Fig. 3 Example of drop-down contextual search suggestions. Search Engine Optimization 4625</p><p> opportunities to the more aggressive SEO practitioners, these cases do current SEO methods provide a clear path some of whom are attempting to dominate blended into SERPs, and paid listings may vie with SEO in creating SERPs with a mix of varied data formats. (Blended search online exposure for local businesses.[35] has also been called “universal search.”) Alternate search channels Specialized searches Alternate search channels could have an even more dra- Specialized searches have been offered for decades matic effect on SEO practices than blended or niche search through pre-Web online information providers. They are services: often called “vertical searches” (i.e., niche search). SEO for mobile communications devices: Analysis of Specialized search could disrupt current SEO strategies, users’ WWW search behaviors on mobile devices has whether it is offered by major search engines or niche shown an emphasis on local retail search followed by suppliers. First, if niche searches or tools proliferate in entertainment. Coupling mobile search with GPS naviga- the GYM group (Google, Yahoo, Microsoft)—each with tion feedback opens the prospect of delivering content or its own classification protocols—they may dilute the ads raises the prospect of directing mobile users to the value of SEO methods that address the GYM standard nearest restaurant or a movie showing, thus both of these algorithms. Second, niche search engines such as http:// searches are potentially lucrative advertising venues— www.vivisimo.com have entered the search race, and search engines are pursuing them, and SEO will follow. others such as http://www.northernlight.com (founded It is not yet certain whether search engines will convert 1996) are reentering public search; these specialized conventional Web pages to mobile-friendly formats, or search engines are usually less susceptible to technical whether organizations will have to create new pages spe- methods, as they tend to use proportionately more human cifically targeting mobile devices.[36,37] editing than broad reach search engines. Either trend could SMO (Social Media Optimization): It is arguable how diminish the importance of technical- or link-based SEO. much SMO involves “search” in the sense of users search- “Personal search” has been a holy grail of the Internet ing by keywords, because the spread of information on industry since the mid-1990s. Early attempts at personal social networking Web sites is largely viral (self-promotion search included Yahoo! personalization features and nu- coupled with word-of-mouth). SMO is currently practiced merous failures in “push technology” (Push technology: by creating profiles on popular social media sharing and A means of automatically delivering information via the news Web sites, building a large base of “friends” and Internet to subscribers based on their choices for custo- contributing unique promotional content with the option mized news, etc. Webster’s New Millennium Dictionary for other community members to vote in favor or against. of English, 2007. Described by H.P. Luhn as “SDI” Popular content that goes “hot” is placed on the high traffic (Selective Dissemination System), http://www.ischool. home pages of the social media sharing and news sites, utexas.edu/�ssoy/organizing/l391d2c.htm, accessed February sometimes generating tremendous amounts of exposure, 2009). The current trend is towards analyzing individual direct traffic, and secondary effect inbound links from blog- users’ search requests in the context of their previous gers that post about the content. SMO also involves using searches (remembered by the server) and delivering custo- software to make posts automatically, this latter method mized results. Taken to an extreme, this could theo- being simply spamming. There may be a growing synergy retically filter out a majority of available Web pages between SEO and SMO, and SMO may become a parallel Senegal Science– regardless of the SEO efforts invested, as search engines profession lumped under the umbrella of SEM.[38,39] “learn” to focus on individual users’ core interests. Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 “Local search” (geographic search) has become a seri- ous goal for search engines. However other than travel STANDARDS AND REGULATION IN SEO destinations, few small retail businesses have Web sites, so search engines cannot easily find data for them by crawling The practice of SEO is marked by the absence of stan- the WWW. The primary solution to date has been to buy or dards, other than those imposed by the willingness of barter for data such as traditional telephone book databases. major search engines to index Web pages, their level of Other new local search companies are aggregating local effort in returning the most relevant Web pages, and pu- data for search engines, often crawling online local direc- nitive actions (down-ranking or de-listing) taken against tories for source data search engines themselves are encour- what search engine administrators consider unacceptable aging data entry from local organizations. Some trades with manipulation of SERP positions. guilds such as law or medicine have niche Web sites with search functions; as yet few are comprehensive. Trades HTML without guild organizations such as auto repair or beauty services may depend entirely on the success of aggregation Standard Web pages (HTML) are in theory defined by if they are to be located through broad search. In few of W3C standards—which are largely ignored by both Web 4626 Search Engine Optimization</p><p> developers and amateurs. Other formats now being completely forgotten by both attackers and defenders, at indexed by search engines—including PDF, Microsoft which point it may be reintroduced by the attackers. Word and Excel, and still images and videos—follow (A medical analogy would be the mutation of microor- even fewer standards. ganisms in reaction to new antibiotics, accompanied by the resurgence of forgotten diseases when society no Certification longer guards against them.)</p><p>Certification is in beginning stages. Some businesses have Government Regulation begun offering SEO credentials, and accredited colleges are now beginning to offer courses in SEO. At present there is no hint of SEO regulation. As subcon- tractors, SEO consultancies are in a position similar to SEO Industry advertising agencies—with no actual control over organi- zations or distribution channels—so any government reg- The SEO industry may be loosely divided into SEO pro- ulation is likely to flow indirectly from regulation of Web fessionals of varying ability; Web designers and program- sites themselves (trade practices) or of search engines mers who know the rudiments; and a much more visible (particularly in the United States, where antitrust law group of low-cost SEO companies that operate through may affect conglomeration of major search engines with advertising and e-mail marketing.[40] software, hardware, or media companies). While there are no formal standards or regulation, in- formal standards are slowly evolving through consensus of trade associations and Web sites reporting on SEO. USER BEHAVIORS IN SEARCH (See “Bibliography” at the end of this entry.) User behavior while searching online shows more consis- Search Engines tency than change in the period from 1995 to 2008. This section will briefly address the consistent behaviors and Because it is difficult to mathematically determine whether available research on the course of changes. a given Web page’s content accurately reflects the page’s Users’ search behavior has a strong effect on SEO, relevance to visitors (much less the creator’s true agenda), since many users click the first listing in a SERP. On the search engines have faced and continue to face an impossi- other hand, gaining a #1 SERP position for a particular ble task in down-ranking deceptive pages without penaliz- search term does not guarantee that a user will click that ing legitimate ones. (In the classic if now simplistic link; they might click the #2 link or the #10 link if those example, a medical Web site can unwittingly trigger an page titles, descriptions, or URLs are more compelling. algorithm aimed at filtering out pornography pages.) In the same vein, there is no clear evidence that users Attempts to “game” (manipulate) search engine rank- who click the first record will take further action; many ings have been so relentless, from the first significant SEO practitioners believe the more motivated users will appearance of online search engines, that many experts scan an entire SERP before deciding which link to click. Science– Senegal consider search engine administration to be equally a Regardless, user behavior while visiting SERPs affects process of excluding Black Hat pages and elevating rele- SEO decisions as well as the search engines’ goal of vant pages.[41] While penalizing irrelevant content faces relevance. the same problem as returning relevant content—a strug- Research into specific behaviors has revealed a great gle to develop artificial intelligence—most search engines deal about what users do in the specific environment of a Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 strongly downgrade Web sites that are found to be search engine interface when tested in a laboratory using the more technically complex SEO tactics such as setting. It leaves unanswered many questions about why IP-specific page delivery (see “Cloaking” earlier). users search the way they do—in part because most re- This issue of controlling Black Hat SEO without pena- search has focused on what users do when looking at a lizing White Hat SEO is a continued source of tension SERP, without inquiring how or why they arrived at that between search engine administrators and SEO practi- particular SERP, or what actions they take after clicking a tioners. Search engines selling advertising space on their particular link. More research is required to develop con- own SERPs has exacerbated the tension by raising the sistent conclusions. Substantial research from information issue that pursues traditional media, of whether there is a science has yet to be incorporated in SEO; when it is, it true division between editorial and advertising depart- may transform strategies and tactics. ments (or search relevance and advertising, in the case of Variables that affect user search behavior: search engines). Like the evolution of military tactics, regulation is a � Users’ level of subject knowledge. game of innovation and counter-measure. The counter- � Improvements in results returned by search engines. measures may make a given tactic so ineffective that it is � Users’ confidence in the quality of search results. Search Engine Optimization 4627</p><p>� Degree of users’ sophistication in search. today than in 1997, though it is uncertain whether the � Presentation style of individual search results (title, decrease is due to a loss of interest in search syntax or an description, URL, etc.). influx of less sophisticated users.[43] � Motivation/curiosity/laziness. � Habituation among users (hardening behaviors). Search Engine Loyalty � Search engine interface design. � Number of search engines available. Available statistics strongly indicate that users are now more likely to refine or expand their search term than Basic Behaviors switch to another search engine.[44] The disinclination to switch is often called “loyalty” in a broad sense; motivat- Few users methodically click search results in sequential ing factors could be the generally improved quality of order, from the first result to the bottom of the page. Typi- search returns over the last few years, or users’ increased cally they skip over unappealing titles or URLs, and may recognition of the value of using precise search terms. bounce back and forth between organic search listings and In terms of user behavior, this could be described as a paid listings. (Depending on SERP design, users may not slight shift from “berrypicking” (wandering about and always know the difference between paid and organic list- collecting bits of information) to more linear search ings.) If a relevant Web page is not found quickly, users behaviors.[45] may change search engines, change their search term, or migrate to a general information Web site such as a dictio- Hardened User Behaviors nary, encyclopedia, or user-fed Q&A Web site. Users’ search behavior search engines may have become Searching Popular Subjects “hardened,” or fixed, by their expectations, in particular in the United States and Canada, because the majority of Patterns of search seen on Wordtracker, Yahoo! search popular search engines have presented returns as linear tool, or KeywordDiscovery continue to show a preponder- lists since the mid-1990s. Current SEO is predicated on ance of searches for celebrities and popular news, as de- the idea that users type keywords into a box, click a scribed since 1999 in the weekly “Lycos 50” listing of “Search” button, and scan a list from top to bottom.[46] the most popular topical searches (http://50.lycos.com/ Because they represent a large conceptual shift, interfaces archives.asp) with written analysis and opinion. Google that present information in clusters, topic maps, or rela- Trends (http://www.google.com/trends), which shows the tionship maps face an entry barrier. number of searches for chosen terms in chart format, is well-suited to display spikes in interest, relative interest in different subjects, or seasonal patterns in popular User Behavior Worldwide searches; like the Lycos 50, it demonstrates that a huge proportion of Web searches are for popular subjects rather Patterns of user behavior outside the United States and than niche information. Canada do not show identical evolution. While less anal- ysis has been done, in regions as disparate as England and Use of Boolean Syntax China users are apparently more willing to examine entire SERP pages, as well as second and third pages, and less Senegal Science– In the 1990s, WWW search engines typically limited the likely to click on the first or first few SERP positions. use of search syntax to Boolean AND, OR, and NOT, Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 with OR as the default. (With AND or NOT typically applied by þ/– symbols.) Initially these options were only CONCLUSION available by typing them into the search term entry box. HotBot search engine was one of the earliest to offer Beginning in the mid-1990s, SEO evolved from placing Boolean logic to untrained users, with the addition of a random keywords in all possible parts of Web pages, to drop-down box offering AND as well as “exact phrase” more focused doorway page strategies targeting particular options, but the options were rarely used. keywords. By 2000, improvements in search engines were In the late 1990s, search engines moved towards a rendering most of such tactics obsolete, and SEO practi- default (or forced) Boolean AND; by early 2003, it was tioners moved on to the integration of overall Web site the default on all major search engines search engines.[42] structure, and then on to establishing a Web site’s rela- Although this change narrowed search results, it also tionship with the WWW as a whole through linking.[47] hugely increased the relevance of results, and, at the same For most, the reluctant and secondary focus of SEO was time, reduced the average user’s motivation to learn Bool- on users or quality of content. For others, a focus on user ean syntax. Some data samples suggest that Boolean experience as well as SEO provided long term, sustain- search skills are known to a smaller percentage of users able results throughout the evolution. 4628 Search Engine Optimization</p><p>SEO now faces broad changes in search and user be- 14. Bradley, S. Using keyword themes to structure your site havior. The growth of online information is outpacing the content, 2006, http://www.vanseodesign.com/blog/seo/ indexing rates of all search engines. Search engines are keyword-themes-for-site-structure/ (accessed February 2009). struggling to deal with that overload, and in the process 15. Sullivan, D. What Are Doorway Pages? Published online, changing their strategies about what information to pres- 2007, http://www.searchenginewatch.com/showPage.html? page¼2167831 (accessed February 2009). ent and how to present it. Hardware—notably mobile 16. Sherman, C. In Defense of Search Engine Cloaking; Pub- communications devices—is redefining the technical lim- lished online, 2001, http://www.searchenginewatch.com/ its of information presentation and also creating niches in showPage.html?page¼2157261 (accessed February 2009). user search behaviors. 17. Nelson, T.H. Literary Machines; Mindful Press: Sausalito, CA, 1982. (This is the earliest specification of the term ACKNOWLEDGMENT hyperlinking, ca. 1965.) 18. Langville, A.; Meyer, C. Google PageRank and Beyond: With thanks to Jim Rhodes, Jim Heath, Lee Odden, Guy The Science of Search Engine Rankings; Princeton Univer- Shalev, Paula Sheil, and Kelly Bryan. sity Press: Princeton, NJ, 2006. 19. Kleinberg, J. Authoritative Sources in a Hyperlinked Envi- ronment, Proceedings of the 9th ACM–SIAM Symposium on Discrete Algorithms, San Francisco, CA, 1998. Ex- REFERENCES tended version in J. ACM 1999, 46. Also appears as IBM Research Report RJ 10076, May 1997, http://www.cs.cor 1. Sullivan, D. http://forums.searchenginewatch.com/showth nell.edu/home/kleinber/auth.pdf (accessed February 2009). read.php?t¼78 (accessed February 2009). 20. Sullivan, D. Google kills Bush’s miserable failure search 2. Rhodes, J. Art of search engine promotion, 1997. http:// & other Google bombs; 2007. http://searchengineland. www.deadlock.com/promote/search-engines (accessed Feb- com/070125–230048.php (accessed February 2009). ruary 2009). 21. Wall, A. The SEObook; 2007, 197–199. http://www.seo 3. Heath, J. Pointers on How to Create Business <a href="/tags/Website/" rel="tag">Websites</a> book.com. That Work, Published online, 1995. Earliest available ver- 22. Bodden, L. Making sense of linking and site promotion; sion at http://www.viacorp.com/pointers1995.html (accessed 2007. http://www.toprankblog.com/2007/09/linking-site- February 2009). promotion/ (accessed February 2009). 4. November 2006 Web Server Survey Netcraft 2006, http:// 23. Thurow, S. The right way to think about site maps; 2007. news.netcraft.com/archives/2006/11/01/november_2006_ http://searchengineland.com/070809–091501.php (accessed web_server_survey.html (accessed February 2009). February 2009). 5. Search Engine Marketing Professional Organization 24. Off Page Optimisation VS On Page Optimisation, http:// (SEMPO), The State of Search Engine Marketing 2006: www.directtraffic.org/on_page_optimisation.htm (accessed Survey of Advertisers and Agencies, 5. Search Engine Mar- February 2009). keting Professional Organization (SEMPO): Wakefield, 25. Shirky, C. Power laws, weblogs, and inequality; 2003. http:// MA, 2007. www.shirky.com/writings/powerlaw_weblog.html (accessed 6. Web Analytics Association, http://www.webanalyticsasso February 2009). ciation.org (accessed February 2009). 26. Anderson, C. The long tail. Wired Mag. 2004. http://www.</p><p>Science– 7. CMSWatch, http://www.cmswatch.com (accessed February wired.com/wired/archive/12.10/tail.html (accessed February Senegal 2009). 2009). 8. Wilsdon, N., Ed.; Global Search Report 2007, E3internet, 27. Brynjolfsson, E.; Hu, Y.; Smith, M.D. From niches to 2007. http://www.multilingual-search.com/global-search- riches: the anatomy of the long tail. Sloan Manage. Rev. report-2007-released-free-pdf/15/10/2007 (accessed February 2006. 2009). 28. Carroll, N. The anti-thesaurus: A proposal for improving Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010 9. The Global Structure of an HTML Document, http://www. internet search while reducing unnecessary traffic loads; w3.org/TR/html401/struct/global.html (accessed February 2001. http://www.hastingsresearch.com/net/06-anti-thesaurus 2009). .shtml (accessed February 2009). 10. Grappone, J.; Couzin, G. Search Engine Optimization: 29. http://www.google.com/corporate/tech.html (accessed Feb- An Hour A Day; Sybex: Hoboken, NJ, June 2006; 46–47, ruary 2009). 101. http://www.yourseoplan.com/book-inside-contents.html 30. Search Marketing Benchmark Guide 2008, 2008, 43–50. (accessed February 2009). http://www.sherpastore.com/Search-Marketing-Benchmark- 11. Whalen, J. Avoiding clueless-is as clueless-does SEO, 2008.html (accessed February 2009). http://searchengineland.com/070927–071933.php (accessed 31. Fusco, P.J. SEO Best Practices: 20 Questions; 2007, http:// February 2009). www.clickz.com/showPage.html?page¼3624560 12. Stamoulis, N. The top 8 SEO techniques (A dispute), (accessed February 2009). http://www.searchengineoptimizationjournal.com/2007/09/ 32. Whitepapers and videos on user eye tracking, http://www. 17/the-top-8-seo-techniques-a-dispute (accessed February enquiroresearch.com/ (accessed February 2009). 2009). 33. Tagging advisory from DailyKos.com political blog, 13. Seda, C. How to Win Sales & Influence Spiders; New http://www.dkosopedia.com/wiki/Standard_Tags_-_alpha_list Riders: Berkeley, CA, February 2007, 5. (accessed February 2009). Search Engine Optimization 4629</p><p>34. Sullivan, D. Search 3.0: The Blended & Vertical Search http://www.gseis.ucla.edu/faculty/bates/berrypicking.html Revolution, http://searchengineland.com/071127–091128.php (accessed February 2009). (accessed February 2009). 46. Nielsen, J. Mental models for search are getting firmer, 35. Guide on how to get your business listed on major local 2005, http://www.useit.com/alertbox/20050509.html (accessed search engines, yellow pages sites and social local February 2009). networks. http://www.locallytype.com/pages/submit.htm 47. Rhodes, J. Personal communication on early SEO practices. (accessed February 2009). 36. Carroll, N.; McGraw, M.; Brahms, S.; Rodgers, D. Wireless usability 2001–2002 report, http://www.hastings BIBLIOGRAPHY research.com/reports/62-wap-2001.shtml (accessed February 2009). 1. A timeline of SEO. http://blog.searchenginewatch.com/ 37. Holahan, C. The battle for mobile search. BusinessWeek blog/060417-130526 (accessed February 2009). 2007, http://www.businessweek.com/technology/content/ 2. http://www.searchengineland.com (accessed February feb2007/tc20070220_828216.htm (accessed February 2009). 2009). 38. Bhargava, R. 5 Rules of Social Media Optimization 3. http://www.searchenginewatch.com (accessed February (SMO), 2006. http://rohitbhargava.typepad.com/weblog/ 2009). 2006/08/5_rules_of_soci.html (accessed February 2009). 4. http://www.seopros.org (accessed February 2009). 39. Seda, C. How to Win Sales & Influence Spiders; New 5. http://www.sempo.org/learning_center (accessed February Riders: Berkeley, CA, 2007; 58–74. 2009). 40. Seda, C. How to Win Sales & Influence Spiders; 6. http://www.sempo.org/learning_center/sem_glossary New Riders: Berkeley, CA, 2007; 16–22. (accessed February 2009). 41. Price, G. Personal communication about gaming search engines, http://www.resourceshelf.com (accessed February 2009). 42. Sullivan, D. Search Features Chart; 2001, http://searchen Users section ginewatch.com/showPage.html?page¼2155981 (accessed February 2009). 1. Mezei, C. <a href="/tags/Website/" rel="tag">Website</a> and search engine user behavior analysis, 43. Hastings Research proprietary databases of real-time 2006, http://www.searchnewz.com/latestsearch/senews/ searches and web server logs, 1995–2008. sn-4-20061101WebsiteandSearchEngineUserBehaviorAnaly- 44. Search Marketing Benchmark Guide 2008, 2007, 135, sis.html (accessed February 2009). http://www.sherpastore.com/Search-Marketing-Benchmark- 2. Search Engine User Behavior Study, iProspect, 2006, http:// 2008.html. www.iprospect.com/about/whitepaper_seuserbehavior_- 45. Bates, M.J. The Design Of Browsing And Berrypicking apr06.htm (accessed February 2009). Techniques For The Online Search Interface, 1989, Senegal Science– Downloaded By: [University of North Carolina at Chapel Hill] At: 06:13 25 January 2010</p> </div> </article> </div> </div> </div> <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/3.6.1/jquery.min.js" crossorigin="anonymous" referrerpolicy="no-referrer"></script> <script> var docId = '5bcbdde6a601e28d7b1cb0c1a693fa87'; var endPage = 1; var totalPage = 18; var pfLoading = false; window.addEventListener('scroll', function () { if (pfLoading) return; var $now = $('.article-imgview .pf').eq(endPage - 1); if (document.documentElement.scrollTop + $(window).height() > $now.offset().top) { pfLoading = true; endPage++; if (endPage > totalPage) return; var imgEle = new Image(); var imgsrc = "//data.docslib.org/img/5bcbdde6a601e28d7b1cb0c1a693fa87-" + endPage + (endPage > 3 ? ".jpg" : ".webp"); imgEle.src = imgsrc; var $imgLoad = $('<div class="pf" id="pf' + endPage + '"><img src="/loading.gif"></div>'); $('.article-imgview').append($imgLoad); imgEle.addEventListener('load', function () { $imgLoad.find('img').attr('src', imgsrc); pfLoading = false }); if (endPage < 5) { adcall('pf' + endPage); } } }, { passive: true }); if (totalPage > 0) adcall('pf1'); </script> <script> var sc_project = 11552861; var sc_invisible = 1; var sc_security = "b956b151"; </script> <script src="https://www.statcounter.com/counter/counter.js" async></script> </html>