<<

Revista Interamericana de Bibliotecología ISSN: 0120-0976 Escuela Interamericana de Bibliotecología

Gasparotto, Melissa Using Google’s Custom Search Engine Product to Discover Scholarly and Cost-Free from Revista Interamericana de Bibliotecología, vol. 41, no. 2, 2018, May-August, pp. 153-166 Escuela Interamericana de Bibliotecología

DOI: https://doi.org/10.17533/udea.rib.v41n2a04

Available in: https://www.redalyc.org/articulo.oa?id=179056423004

How to cite Complete issue Scientific Information System Redalyc More information about this article Network of Scientific Journals from Latin America and the Caribbean, and Journal's webpage in redalyc.org Project academic non-profit, developed under the open access initiative Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America*

Abstract

Many Latin American scholarly monographs are available for free to read and download in a scattered fashion across the web, hosted on educational, institutional and government websites as well as commercial websites and publishing platforms. There is as of yet no single way to identify all of this content at once, but web-based discovery leveraging existing search engine indexing would seem to be a likely option. This case study suggests and evaluates one such method for discovery of open access and other cost-free scholarly monographs produced in Latin America. One possible configuration of Google’s Custom Search Engine product is proposed and evaluated, and findings suggest its usefulness for a variety of applications, including for collection development, the preparation of thematic research guides with open content, and the enrichment of existing lists of open access sources from Latin America. Unlike existing open access eBook portals, which search across known collections of such materials, search portals such as the one proposed allow users to search across the entire web to uncover scholarly free eBook sources that were previously unknown to them alongside known content sources, a key advantage to this method of discovery. The results further suggest the importance of pursuing discovery of these monograph titles outside established known collections, as an astonishing 45 % of all monographs identified through the Custom Search Engine portal were not discoverable in any edition, print or electronic, through WorldCat, and only 27 % were indexed by Google . Additionally, the low number of these eBook titles hosted in preservation-worthy repositories raises cause for concern about their long-term digital availability.

Keywords: Open Access, eBooks, scholarly monographs, search engines; Latin America.

Melissa Gasparotto Cómo citar este artículo: Gasparotto, M. (2018). Using Google’s Custom Search Assistant Director for Research Services Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from at The New York Public Library Research Latin America. Revista Interamericana de Bibliotecología, 41(2), 153‑166. doi: 10.17533/ Libraries. Master of in Library udea.rib.v41n2a04 and from Long Island University and Master of Arts in Latin Recibido: 2017/08/06 / Aceptado: 2017/12/11 American and Caribbean Studies from New York University. * This project was completed with support from the Aresty Research Center at Rutgers Uni- [email protected] versity. The author gratefully acknowledges research assistant Harry Nicolau for his help with orcid.org/0000-0002-3048-0282 data collection. .

Rev. Interam. Bibliot. Medellín () Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 153 Uso de la plataforma Google’s 1. Introduction Custom Search Engine para The idea of open access monograph discovery and descubrir fuentes académicas collection building in Latin American and Area Studies is hardly new. As digital library and cultu- de acceso abierto y libros ral heritage institution repositories have grown in electrónicos gratuitos de size and prominence, so too has the interest in pu- América Latina lling them together for ease of discovery alongside related collections. In Spain, the impressive Biblio- Resumen teca Virtual Miguel de Cervantes includes dozens of thematic collections of full-text scholarly Latin Muchas monografías académicas de América Latina están American and Iberian content including articles, disponibles para leer y descargar gratuitamente, dispersas en books, and recordings. The CLACSO and FLACSO la web, alojadas en sitios educativos, institucionales y guber- digital libraries pull together open access scholarly namentales, así como en sitios web comerciales y plataformas monographs produced by multiple regional affiliates de publicación. Aún no existe una forma única de identificar todo este contenido a la vez, pero el descubrimiento basa- under a single portal. Europe-wide efforts include do en la web para potenciar el uso de la indexación de los Europeana, which includes digital collections from motores de búsqueda existentes parece ser una alternativa. dozens of libraries, museums, and other national Este estudio de caso sugiere y evalúa uno de estos métodos institutions. HathiTrust contains a sizable subset of para el descubrimiento de acceso abierto y otras monogra- Latin American and Iberian content. And of course, fías académicas gratuitas producidas en América Latina. En the Directory of Open Access Books (DOAB) and the este trabajo, se propone y se evalúa una configuración posi- OAPEN Library are important aggregators of scho- ble de la plataforma Google’s Custom Search Engine, y los larly open access eBooks, although they remain small hallazgos sugieren su utilidad para una variedad de aplica- in size. All of these projects include known OA titles ciones, incluido el desarrollo de colecciones, la preparación de guías temáticas de investigación con contenido abierto, y currently available in existing collections, begging [Melissa Gasparotto] el enriquecimiento de listas existentes de libros electrónicos the question: what unaggregated content available de acceso abierto de América Latina. A diferencia de los por- in digital form might be missing from such compi- tales de eBook de acceso abierto, que buscan en colecciones lations? conocidas dichos materiales, las plataformas de búsqueda como la que se propone en este trabajo permiten a los usua- A growing trend has drawn attention to an additio- rios buscar en toda la web para descubrir fuentes académicas nal source of digital scholarly monographs in need gratuitas de libros electrónicos, que antes eran desconoci- of discovery: publications made available for free das, además de buscar en las fuentes de contenido conocidas, reading, and often for free download, produced by una ventaja clave para este método de descubrimiento. Los Latin American independent and university publi- resultados sugieren, además, la importancia de buscar estos shers, cultural heritage institutions and government títulos monográficos fuera de las colecciones establecidas ya conocidas, pues un asombroso 45 % de todas las monografías agencies and secretariats. Because the number of identificadas a través de la plataforma Custom Search Engine publishers participating in these activities is large no fueron detectables en ninguna edición, impresa o electró- when viewed across the region, web-based disco- nica, a través de WorldCat, y solo 27 % fueron indexadas very would appear to be a likely solution for these por Google Books. Además, el bajo número de estos libros monographs. However, search engines generally lack electrónicos alojados en repositorios dignos de preservación the user-controlled refinements necessary to restrict plantea motivos de preocupación sobre su disponibilidad di- results to quality open scholarly monograph output, gital a largo plazo. and searching without these refinements results in Palabras clave: acceso abierto, libros electrónicos, mongrafías too many unrelated websites to be useful for eBook académicas, buscadores, América Latina. discovery.

154 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 This paper proposes options for Latin American OA and humanities in other world regions unaddressed” and cost-free1 scholarly monograph discovery utilizing (p. 174). Lourdes Gutiérrez-Palacios (2012) also obser- a Google product known as Custom Search Engine ves the science-heavy focus of major commercial eBook (CSE) to create customized search portals. Unlike vendors, adding that these aggregators provide access the digital collections mentioned above, which search to primarily English-language content (p. 9). Suzan- across discrete existing known collections, search por- ne M. Ward, Robert S. Freeman and Judith M. Nixon tals and techniques such as those proposed allow users (2015) concur, noting that these issues together pose a to search across the entire web to uncover scholarly barrier to building global academic eBook collections free eBook sources that were previously unknown to (p. 4). For the purpose of Latin American eBook collec- them alongside known content sources, a key advanta- tion development, then, one major challenge is the lack ge to this method of discovery. of available content for acquisition through standard library-vendor routes.

2. Library Collections and the Latin Given the challenges associated with insufficient re- American eBook Landscape presentation of global publishers in current eBook aggregators, librarians must investigate alternate While the availability of scholarly eBooks published means to provide access to the growing scholarly eBook in Latin America has been expanding steadily, the- output outside the global north. This should include a re remains substantial room for improvement in their coordinated effort urging vendors to be more inclusive availability for library collection development. As with in their content development (see Terence Huwe’s 2017 titles published by larger global eBook providers, Latin article “The Long and Winding Road of Ebooks” for a American eBooks may be available as part of subscrip- good summary of library-vendor dialog around eBook tion or purchased packages from vendors, as well as on access), but may simultaneously involve investigating an individual title basis from a variety of providers large all appropriate models of access over ownership. and small.2 Individual publishers, organizations and re- tail bookstores offer eBooks for sale through their own websites and third-party platforms, with a variety of 3. Developing a Web Portal for Latin DRM and DRM-free options. However, these eBooks American OA and Cost-free eBooks pose challenges for libraries due to their spread-out nature, incompatibility with library digital platforms, Given the limited distribution of Latin American prin- and publisher inflexibility around licensing for insti- ted editions in library holdings outside the region, and tutional access, among other issues. Working with the the previously mentioned variation in both OA and more established eBook vendors is also a challenge. As purchased eBook distribution models, the interest in Dracine Hodges (2015) notes, the four largest global developing a web portal to provide aggregated access e-content vendors, Elsevier, Wiley, Springer and Taylor to open eBook content from the region is clear. Print & Francis, provide substantially more material in jour- runs of quality scholarly monographs by Latin Ame- nal format than eBook format. Further, they all publish rican university presses, government agencies, and content that skews heavily toward the , lea- institutes may be quite small, and distribution handled ving “the rich cultural scholarship of the social sciences informally within the region at fairs and events,

1 Cost-free is used here to distinguish those eBook titles made especially in those countries with smaller publishing [Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America] available for free without the related rights for reuse assigned industries. The formal distribution of any OA surroga- to open access works. Cost-free eBooks may also lack preser- tes that may exist is rarely attempted, although some vation-worthy hosting and permanent access options that are efforts may be made via social media (Domínguez & frequently available for works designated as open access. Ovadia, 2011; Scott, 2016). These eBooks may often be 2 JSTOR has begun offering a wider selection of Spanish-language found only on the website of the publisher, or hosted on scholarly monographs in recent years, joining e-Libro and Digi- talia, two early eBook vendors with representation of academic free publishing platforms such as issuu.com by smaller publishers from Spain and Latin America. publishers who lack the infrastructure to undertake

Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 155 digital distribution on their own.3 Government-finan- titutions with smaller budgets more adequately serve ced titles may be available for free on cultural ministry patron needs: even a small library can give access to and non-profit organization websites, as well. For area targeted collections of digital titles to supplement its studies collection development purposes, it can be cha- collection. This is not to say that a search portal for OA llenging to identify a vendor who can secure the printed and cost-free academic books can ever replace substan- edition of small print run titles, making discovery of tive budgetary commitments to specialized collections, cost-free digital surrogates an enticing proposition. particularly for regions of the world that remain Additionally, some Latin American government-finan- print-heavy due to lack of a strong market for eBooks. ced organizations and ministries are releasing books However, research libraries can complement print hol- solely in a freely downloadable digital format.4 These dings by enhancing discoverability of those electronic titles are distributed outside existing models that mi- materials available at no cost. ght ensure their inclusion in WorldCat. While Google Scholar indexes many institutional repositories and has Finally, digital preservation is of growing concern to begun indexing OA and cost-free eBook titles on a limi- librarians, and the spread-out nature of OA and cost- ted basis, the majority of such book-length works fall free monographs hosted in disparate repositories and outside its inclusion. Further, Google Scholar cannot websites only adds to this problem (Crossick, 2016). be customized to deliver only books instead of articles. How can preservation be assured when discovery is not even possible? How can one even determine the The convenience factor of eBook access is a further scope of eBook material that may be at risk? A single rationale for increasing discovery of open Latin Ameri- search point for these kinds of materials would greatly can monograph content through a web portal, coupled aid efforts to quantify the nature and extent of the OA with a high potential for use by academics. A study by scholarly monograph preservation puzzle. David Nolen (2014) found that, in a single year, nearly 38 % of all references to scholarly monographs in three These challenges emphasize the importance of efficient top Latin American Literary Studies journals were to discovery strategies for Latin American OA scholar- foreign university, academic, and governmental publi- ly monographs. However, there is still no easy way to simultaneously search across all possible sources wi- [Melissa Gasparotto] cations. This suggests that there may be a motivation for research libraries to enhance discovery of and ac- thout being overwhelmed by out of scope content. cess to the OA book production from these types of publishers. 4. Using Google’s Custom Search Engine Cost to libraries is another factor. As an ever larger Product for OA and Cost-Free Scholarly percentage of library budgets goes to serials, the at- tractiveness of high quality OA monographs is clear. Monograph Discovery Additionally, expanded discoverability for freely available digital scholarly monographs can help ins- Google released its Custom Search Engine (CSE) pro- duct in late 2006 (Hagner, 2006). The product allows 3 For example, Mexican independent publisher Ediciones La developers to specify with relative granularity several Rana and the Museo de la Palabra y la Imagen in El Salvador search parameters targeting as much or as little of the are among the many Latin American publishers distributing OA eBooks through the publishing platform issuu.com. entire indexed web as they define, making for a unique and highly tailored thematic search portal. 4 For example, this multimedia eBook on traditional textile de- signs published in 2017 by the Comisión Nacional para el De- sarrollo de los Pueblos Indígenas in is solo disponible The use of a private sector no-cost product as a plat- para consulta en línea (available only for online consultation): form for any library tool has risks. Google has regularly Santos-Concepción, L. (2016). Iconografía tének de origen an- made changes to and discontinued features of the CSE cestral. El significado de los bordados. Chihuahua, Mexico: product, and can choose to cease support at any time. Comisión Nacional para el Desarrollo de los Pueblos Indígenas. Recuperado de http://www.cdi.gob.mx/iconografia-tenek/. Ac- Therefore, other models should simultaneously be a cessed February 26 2017. focus of ongoing work in OA monograph discovery.

156 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 For example, a search engine built using open source period, several additional applications of the service in software can still leverage Google’s indexing, but it libraries were developed, including DRAG-NET, a legal would remain free from many of the uncertainties as- research database, and these are documented in Terry sociated with using products over which libraries have Ballard’s 2012 book Google This!: Putting Google and Other no control and which are subject to change without Social Media Sites to Work for Your Library. Gavali (2015) notice. This would constitute a massive effort by any published a case study in DESIDOC documenting the organization choosing to undertake the work. Howe- use of Google CSE to develop a discovery portal for en- ver, it behooves academic institutions to give it some gineering and research, and Giovanna Badia consideration sooner rather than later. If a not-for- (2015) included three paragraphs on using Google CSE profit does not enter this arena, one likelihood is that for search filtering in her chapter in the edited volume commercial entities may develop similar resources to The Complete Guide to Using Google in Libraries. Perhaps the enhance their own discovery products, potentially lea- most visible use of a Google Custom Search Engine in ding to an increase in their cost to libraries. Further, it libraries is Keely Wilczek’s Think Tank Search hosted can be argued that libraries and other academic entities at the Harvard Kennedy School Library website, which have a mission to lead in open access rather than lea- allows users to search across the web publications of ving such innovations to the private sector. several hundred think tanks at once.

Despite these concerns about using Google CSE for The applications above work by explicitly including a project of this nature, the problem of OA scholarly a selected list of individual websites to search, rather monograph discovery urgently needs attention. A pro- than leveraging the custom features to search across posed alternative is to use currently available tools as a the entire web and as Ballard (2016) notes in a article starting strategy to discover OA and cost-free scholarly bemoaning the limited adoption of the product in libra- monographs, and to develop a clearer picture of current ries, some of these useful projects have already ceased eBook distribution patterns. to exist (33). The list above is almost certainly incom- plete. However, the use of the CSE product in libraries Although CSE has been available for nearly ten years, does not appear to be widespread or long-term. No a survey of the literature shows relatively limited use study or documented project could be identified that of the tool in libraries, and the number of articles do- considered the use of CSE for open access eBook disco- cumenting tips for utilizing the service outnumber very, or for federated discovery of web-based literature those articles documenting existing projects and their published in specific countries or regions. One possible development. The Unabashed Librarian (2007) was the reason for its low adoption rate as a library tool may be very first library journal to include a list of the poten- the maintenance required to ensure searches continue tial uses of the CSE product to enhance public service to deliver adequate results: results delivered through (“Impress patrons…,” p. 25). The following year, three any custom search engine will change slightly each very brief articles appeared in Computers in Libraries sug- time Google pushes an update to its ranking algorithm. gesting practical tips for creating a CSE (Notess, 2008; Pretlow, 2008a; Pretlow, 2008b). Hennesy and Bow- Additional scenarios in which a thoughtfully con- man (2008) documented the development of an arts figured CSE could prove helpful, but which are not research-related portal with CSE in a case study also yet mentioned in the literature, include the develop- published in Computers in Libraries in the same year. In ment of textual corpora by digital humanists, and the

2011, Do Pazo-Oubiña, Calvo Pita, Puigventós-Lato- identification of newly published books from certain [Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America] rre, Periañez-Párraga and Ventayol Boschc developed countries on a particular theme for the purpose of co- a pharmacological research personalized search engine llection development. which they described in Farmacia Hospitalaria, and the following year Schmick, Johnson, Scoville and Vaduva- Outside libraries, one area where custom search engi- thiriyan (2012) described their work creating a tailored nes have been developed with positive results is in search portal for foreign language information in file discovery. Numerous pdf search engines exist on the Journal of Consumer Health on the Internet. Throughout this web, and many of these utilize Google’s CSE product

Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 157 to good effect. However, these search engines include 5. Customizing a CSE for eBook Discovery all pdf files regardless of document type, audience, or content. They do not attempt to discriminate between What constitutes a scholarly eBook to a search engine? monographs published in pdf format and any other type What constitutes open access? How is Latin America defined in a digital environment? To give the CSE suffi- of content (articles, slides, technical reports, etc.). cient information about what types of results to deliver, machine-readable markers for these criteria were defi- The Google Custom Search guide (Google LLC, 2017) ned. There is no perfect way to accomplish this in the provides detailed information on customization along absence of a highly functional semantic search, howe- with selected examples of how the product has been ver the following parameters are suggested as a starting used, and points toward a way in which the service can point. Each of the identified parameters has significant be mobilized for open access eBook discovery. Custom drawbacks when used on its own. However, when used search parameters include structured metadata fields together they result in a custom search engine that dis- permitting filtering by format, language, region, and criminates with higher accuracy. date, among other criteria from schema.org. Searches 5.1. File Format can be limited to specific portions of a site by including one of 50 available URL pattern specifications, allowing eBook file formats are multiple, and can include PDF, for the deliberate inclusion of only the portion of a Epub, HTML and mobi, among others. Stating file for- university press website that contains its eBook collec- mats for inclusion creates at least one complication, tions. The engine can be customized to search across a however, as a search engine configured in this way is list of existing bookmarks using the Link Hub feature, incapable of identifying those files that are displayed on the publisher site, but hosted elsewhere. Of the list eliminating the work of adding websites individually, of file formats relevant to monographs, Google permits meaning that those librarians who already maintain a only the filtering of pdf and HTML files using the file list of OA eBook repositories can quickly create a fe- format parameter, limiting its utility to a search. Howe-

[Melissa Gasparotto] derated search of those collections. Keywords can be ver, initial tests using pdf as a file format filter along appended to all searches in a sophisticated manner, with “" as a keyword automatically added to the leveraging the specialized search techniques of which searches performed on the CSE, helped to expand mo- so few users are aware, including Boolean operators nograph discovery. File formats can also be specified and image search refinements, and keyword synonym for exclusion, for example to exclude non-book multi- search can be activated as well. These factors can each media content. be assigned a different weight in the results ranking, by 5.2. Keywords using custom XML annotation files. Any query already permitted by Google’s web search One of the more useful customizations for researchers may be automatically added to every search performed in any area of global studies is the ability to use wild- through a CSE. Adding the Spanish-language keywords cards in the initial CSE setup to specify a subset of the “editorial” (publisher) and “ediciones” (editions) to user open web at the top-level domain such as *.mx, *.edu queries can help restrict results to files consisting of published monographs, although this may exclude cul- or *.edu.mx. This particular feature does not appear tural heritage organization and government ministry to have been utilized in any of the projects documen- publications. Adding the keywords “eBook,” “e-libro” ted in the library literature. The use of this feature in or “libro electrónico” is an additional way to refine results combination with the other variables specified above from the open web, however this may exclude relevant enables more sophisticated searching for data gathe- results that do not use formal terminology to describe ring across a region. an eBook file hosted on the website.

158 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 Keyword exclusion is one method of eliminating cost-free items. Additionally, excluding .com elimina- eBooks available for sale from search results, for exam- tes all of the large commercial document repositories ple by excluding the words “precio” (price), “tienda” and publishing platforms that many academic presses (store), and their synonyms and translations into other and government ministries use to distribute their OA Latin American languages. Excluding journals can monographs: issuu.com is an important example. A partially be accomplished by excluding the keyword partial solution may be to exclude the .com domain on “issn” from all searches. Excluding words such as “re- a blanket basis and manually include individual .com vista” (magazine/journal) is not recommended, as this sites known to be important as exceptions. This is not will eliminate monographs whose bibliographies cite wholly thorough, but it may ensure higher quality re- articles published in journals with titles containing sults with fewer false positives. these words. Keyword exclusion techniques are extre- mely important in helping to remove journal content Individual websites may also require explicit exclusion. from searches. There is, unfortunately, no way to limit For example, the large number of Worldcat.org and results to pdf files over a certain page length, which Google Books records for non-OA eBook content, cou- would make this the best alternate option. pled with the sites’ high authority in Google’s ranking algorithm make them likely candidates for exclusion. 5.3. Language Wikipedia.org and Academia.edu are also good candi- Restrictions by language, or setting a preference for dates for exclusion given the volume of out-of-scope one language over the others, is possible in CSE. Howe- article content hosted on these platforms. ver, these language preferences can only be set one at a 5.5. Schema time from the database editing interface, meaning that the CSE cannot easily simultaneously limit to Spanish, Schema from schema.org, such as “Book” or “Crea- Portuguese, and multiple Latin American indigenous tive Work” may be included in the CSE search languages. This problem can be sidestepped if the cus- configurations. A major drawback to using this struc- tom XML annotations file is edited manually. However, tured metadata is that the convention is not widely coding in language restrictions may prevent discovery adopted by Latin American webmasters and therefore of English or other language monographs that meet all a CSE using filters based on this metadata may be ex- other criteria. cluding a high number of relevant websites providing 5.4. Website Domain access to content of interest. Initial testing yielded very few search results when stipulating this parameter. Country-level domain specifications are one way to li- mit to content hosted by regional websites. Top-level 5.6. Status domains such as .edu and .org include whole swathes of the web with potential content of interest. Howe- Google CSE permits filtering by Creative Commons ver, because setting these domains as the only sites to license type. Initial experimentation with this filter search could inadvertently exclude relevant content yielded very few search results, indicating limited im- hosted on non-regional domains, it is also possible that plementation of this metadata convention by Latin country, .org, .gov, .gob, and .edu domains simply be American publishers. given added weight in the CSE custom xml file rather [Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America] than defined as the only domains to be searched. 6. Configuring the CSE

Domains may also be excluded. Excluding the .com Using the above considerations as a starting point domain is one way to begin eliminating commercial for performing the initial CSE configurations, a CSE websites. However, that solution causes numerous was developed, tested, and assessed through a quality additional problems. For example, this strategy will analysis of results. The final custom search engine for exclude some commercial publishers who also offer OA and cost-free Latin American eBooks can be acces-

Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 159 sed at the following url: goo.gl/agah2k. The following Language was not specified in the configuration; rather parameters were specified: it is assumed by using the Spanish-language keyword “libro” appended automatically to each query. • File Format: pdf Query Addition: (pdf OR epub) AND libro -issn In addition to the above criteria, labels were created to -abstract permit the tabbed filtering of the full results list. The Search these sites: *.org *.edu *.gob *.ar *.bo *.br labels are Government, which prioritizes those results *.bz *.cl *.co *.cr *.cu *.do *.ec *.gt *.hm *.hn *.mx on .gob. and .gov websites, Academic and University, *.nl *.pe *.pr *.pt *.py *.sv *.uy *.ve which displays primarily .edu results, and Organiza- tions, which displays primarily .org results. • Domains and URL Patterns Excluded: *.org/*artic* 7. Assessing the Custom Search Engines *.edu/*artic* *.org/*revista* For the formal assessment, five searches were con- *.edu/*revista* ducted in the custom search engine in February 2017, *.gob/*artic* and the first 100 relevancy ranked results were evalua- *.gob/*revista* ted based on scope, format and holdings criteria. The Academia.edu analysis is limited to the first 100 results as Google CSE wikipedia.org does not display results beyond this number. Search keywords were chosen for broad relevance to scholar- All of the Latin American country domains were in- ly and non- scholarly materials, to help determine how dividually specified for inclusion through the use of a well the search engine configurations selected for scho- wildcard symbol, as well as .org, .edu, and .gob. See Fi- larly materials. gure 1. This strategy sidesteps the problem with default CSE parameter options which permit only the priori- 7.1. Search Strings tization of a single country domain at a time using a In Search 1 the keyword string arte feminista durante la dropdown menu. [Melissa Gasparotto] dictadura (feminist art during the dictatorship) was Sites selected for exclusion included large highly ran- chosen to help identify scholarly works produced not king sites such as Wikipedia.org and Academia.edu. only by university presses but also museums and cul- URL patterns including journal article-related keywords tural institutions, as well as popular feminist press were also selected for exclusion (see Figure 2). eBooks. In Search 2 the keyword string cocina indígena (indige- nous cooking), was chosen because it could match on cookbooks and other non-scholarly materials as well as scholarly studies of cooking as it relates to and . It was supposed that a search of this nature would help determine the accuracy of the search en- gine configuration in distinguishing between popular and scholarly monographs.

Figures 1 and 2: Including and Excluding Domains and URL In Search 3 the keyword string producción de quesos patterns. (cheese production) was chosen to help determine the CSE’s ability to provide access to technical mo- Additional words were specified as automatic addi- nographs. tions to user queries and these included words targeted for inclusion and exclusion to help identify monograph In Search 4 the keyword string patrimonio natural Mé- content, such as “libro”, “- issn” and “-abstract.” xico (natural patrimony Mexico) was used to help

160 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 discover eBook content that overlaps 8.1. Item Type thematically with governmental and non-governmen- Overall, OA or cost-free monographs comprised 50 % tal reports. of all results (247 out of the 500 results analyzed), In Search 5 the keyword string Rubén Darío crítica lite- however the percentage of OA and cost-free monogra- phs delivered for each search string varied quite widely. raria (Rubén Darío literary criticism) was chosen to Search 5 returned the smallest number of monographs help evaluate the CSE’s suitability for humanities-ba- at 35/100 or 29 % while Searches 2 and 4 each returned sed eBook discovery (see Table 1). over 60/100 monographs, 64 % and 62 % respectively (see Table 2). Generally, searches delivered a higher Table 1: Search Strings proportion of monograph to non-monograph results in Search 1 Arte feminista durante la dictadura the first few of results when compared to later results pages where more out-of-scope content was de- Search 2 Cocina indígena livered. For example, of the first 30 results (3 pages) of Search 3 Producción de quesos Search 1, a full 82 % of links directed to full text copies Search 4 Patrimonio natural México of in-scope monographs related to the search (n=25). This drops to 71 % of the first 50 (5 pages) of results Search 5 Rubén Darío crítica literaria (n=36), 59.5 % (n=42) of the first 70 results (7 pages) 8. Search Results and 49 % (n=49) out of all 100 results. Although the number of in-scope scholarly monographs was fewer A list of free and open access eBook titles identified towards the end of the results list, the titles remained through test searches conducted through this CSE in high quality and thematically relevant. February 2017 may be found at the following url: goo. Out of scope results for all searches included primarily gl/2h9zsi. Note that searches using the same keyword presentation slides, scholarly articles, newspaper arti- strings will not deliver the same eBook results, as cles, dissertations, and blog posts. Very few commercial newly available content coupled with multiple chan- publisher sites appeared in the results with eBooks for ges to Google’s algorithm since this date will have sale (1 % or 4 out of 500 results)(see Table 2). Nearly impacted the results. all out of scope items related to the theme of the search.

Table 2: Item Types

Other (legal statutes, Scholarly OA OA or Cost- OA or Cost- Dissertati ons Commer cial curricular or Cost- Free Free Book Free Scholarly Whole journal and Theses eBooks for Sale materials, Monogra ph Chapter Article presentatio ns, etc.)

Search 1 49 % (n=49) 2 % (n=2) 18 % (n=18) 2 % (n=2) 3 % (n=3) 2 % (n=2) 23 % (n=23) (n=100)

Search 2 64 % (n=64) 3 % (n=3) 8 % (n=8) 1 % (n=1) 1 % (n=1) 2 % (n=2) 22 % (n=22) (n=100) [Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America] Search 3 45 % (n=45) 6 % (n=6) 5 % (n=5) 0 % (n=0) 3 % (n=3) 0 % (n=0) 41 % (n=41) (n=100) Search 4 62 % (n=62) 3 % (n=3) 8 % (n=8) 0 % (n=0) 0 % (n=0) 0 % (n=0) (n=27) (n=100) Search 5 29 % (n=27) 8 % (n=7) 29 % (n=27) 2 % (n=2) 3 % (n=3) 0 % (n=0) 28 % (n=26) (n=92) All Searches 50 % (n=247) 4 % (n=21) 13 % (n=66) 1 % (n=5) 2 % (n=10) 4 (<1 %) 28 % (n=139) (n=247)

Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 161 8.2. Date Range 8.3. Country of Publication

The publication dates of all identified OA or cost-free While publishers located in 23 countries were represen- monographs were overwhelmingly within the last 10 ted among all identified OA and cost-free monograph results, the overall distribution mapped broadly to print years (66 %, 164 out of 247 results). 80 titles (32 %) publication trends: inevitably Mexico, , and Argen- were published within the last 5 years. There was very tina were among the most well-represented publisher little variation between searches in terms of the distri- locations. When searches included a country name, bution of publication dates. The results demonstrate the country distribution among those monographs de- livered for the search invariably skewed toward that that the age of OA and cost-free eBooks discoverable country. For example, in Search 4 (patrimonio natural through this CSE portal are well within the expected México) a full 48 % of monographs were published in usable life of a scholarly monograph (see Table 3). Mexico (see Table 4).

Table 3: Age Distribution of Monographs

Age of Search 1 (n=49) Search 2 (n=64) Search 3 (n=45) Search 4 (n=62) Search 5 ( n=27 ) All Searches (n=247) Monograph

0-5 years old 35 % (n=17) 36 % (n=23) 38 % (n=17) 29 % (n=18) 19 % (n=5) 32 % (n=80) (2012-2016)

5-10 years old 39 % (n=19) 28 % (n=18) 24 % (n=11) 52 % (n=32) 15 % (n=4) 34 % (n=84) (2007-2011)

10-20 years old 12 % (n=6) 17 % (n=11) 20 % (n=9) 6 % (n=4) 19 % (n=5) 14 % (n=35) Older than 20 8 % (n=4) 9 % (n=6) 4 % (n=2) 2 % (n=1) 33 % (n=9) 9 % (n=22) years Undated 6 % (n=3) 9 % (n=6) 20 % (n=5) 6 % (n=4) 0 % (n=0) 7 % (n=18) [Melissa Gasparotto] Table 4: Distribution of Country of Publication

Search 1 Search 2 Search 3 Search 4 Search 5 Search 1 Search 2 Search 3 Search 4 Search 5

United Chile 32.7 % Mexico 28 Mexico 22 Mexico 48 Nicaragua Dominican Bolivia 2 % Bolivia 2 % Honduras States 3 % (n=16) % (n=18) % (n=10) % (n=30) 19 % (n=5) Rep. 2 % (n=1) (n=1) (n=1) 4 % (n=1) (n=2) Chile 14 % Argentina Chile 13 % Argentina 11 El Salvador 2 England 1.5 2 % Brazil 2 % Mexico 4 % 30.6 % (n=9) 16 % (n=7) (n=8) % (n=3) % (n=1) % (n=1) (n=1) (n=1) (n=1) (n=15) El Salvador Guatemala 2 4 % Spain 12.2 Colombia Chile 13 % Argentina 8 11 1.5 % (n=1) 2 % (n=1) % (n=1) (n=1) % (n=6) 9.3 % (n=6) (n=6) % (n=5) % (n=3) Nicaragua Uruguay 2 Spain 2 % Spain 4 % Mexico 6.1 Ecuador 9.3 Peru 11 % Peru 5 % Chile 7 % 1.5 % (n=1) % (n=1) (n=1) (n=1) % (n=3) % (n=6) (n=5) (n=3) (n=2) United Panama 1.5 Venezuela States 2 % Uruguay 6.1 Peru 9.3 % Ecuador 9 France 3 % 7 % % (n=1) 2 % (n=1) 4 % (n=1) % (n=3) (n=6) % (n=4) (n=2) (n=2) (n=1) Peru 4.1 % Argentina Colombia 7 Guatemala Colombia 4 Spain 1.5 % Unknown (n=2) 4.6 % (n=3) % (n=3) 3 % (n=2) % (n=1) (n=1) 3 % (n=2) Bolivia 2 % Spain 7 % Switzerland Costa Rica Uruguay (n=1) 4.6 % (n=3) (n=3) 3 % (n=2) 4 % (n=1) 1.5 % (n=1) Venezuela United Dominican Costa Rica Bolivia 3 % Costa Rica 1.5 % (n=1) Kingdom Republic 4 2 % (n=1) (n=2) 4 % (n=2) 3 % (n=2) % (n=1) Unknown 3 % (n=2)

162 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 8.4. Presence in WorldCat, HathiTrust, Google (18 %) included links to any open access or free copy of Books, and Other Repositories the eBook edition. Occasionally the OA copy cataloged in WorldCat was hosted at a different URL than that Availability in WorldCat, HathiTrust and Google discovered through the search portal, and in some of Books varied widely between searches (see Table 5). those cases, the URL no longer functioned. Technical literature discovered through Search 3 (Pro- ducción de quesos) had the least representation in these When the link was broken, it was not counted as an databases (27 %) and Search 5 (Rubén Darío crítica literaria) OA link in WorldCat. had the most (70 %). This makes sense when considering typical library acquisition patterns, as literary criticism Thirty-five titles (14 %) were available on a “search is significantly more widely held than special interest inside this title” basis in Google Books, and 17 (7 %) agricultural industry resources. were available on a “search inside this title” basis inside Of the 247 total monograph results, 135 (55 %) were HathiTrust. Thirty-one (13 %) were available in Goo- found in OCLC WorldCat in the corresponding prin- gle Books on a full view basis. None were available full ted edition. Of these results, only 19 WorldCat records view in HathiTrust (see Table 5).

Table 5: Presence in WorldCat, HathiTrust and Google Books

Functional Corresponding OA digital Not in Google Books (Full Google Books (Search HathiTrust (Search print edition in copy linked WorldCat View) Inside View) Inside View) WorldCat in WorldCat Record

Search 1 (n=49) 63.3 % (n=31) 39 % (n=19) 6.1 % (n=3) 0 % (n=0) 18.4 % (n=6) 8.2 % (n=4)

Search 2 (n=64) 53 % (n=34) 47 % (n=30) 9 % (n=6) 5 % (n=3) 5 % (n=3) 6 % (n=4) Search 3 (n=45) 27 % (n=12) 73 % (n=33) 7 % (n=3) 18 % (n=8) 13 % (n=6) 0 % (n=0)

Search 4 (n=62) 62 % (n=39) 37 % (n=23) 1.1 % (n=7) 30.6 % (n=19) 19.3 % (n=12) 5 % (n=3)

Search 5 (n=27) 70 % (n=19) 30 % (n=8) 0 % (n=0) 4 % (n=1) 30 % (n=8) 26 % (n=7) All Searches 55 % (n=135) 45 % (n=113) 8 % (n=19) 13 % (n=31) 14 % (n=35) 7 % (n=18) (n=247)

9. Discussion identified were not discoverable in any edition, print or electronic, through WorldCat. Even where searches The results from the searches in this case study are no- had a low rate of return for monographs, those mono- thing more than a snapshot of the variety of open access graphs proved of interest from a discovery point of view and cost-free monographs published in Latin America. due to their sources. For example, although the search While it cannot be known with certainty what per- for Rubén Darío crítica literaria yielded few monograph centage of the OA and cost-free monograph world is results, the most well-represented country of publica- represented by this snapshot, results from searches tion was Nicaragua, giving high visibility to the open

conducted using the portal suggest that a CSE can be digital output of a country with a relatively small pu- [Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America] a promising starting point for the discovery of OA and blishing industry. Searches such as this emphasize the cost-free scholarly monographs. Configurations such usefulness of a web discovery tool to enhance access as those employed can help filter out commercial and to materials representing a diversity of quality sources non-monograph content, particularly among those originating in Latin America. However, the low num- items appearing early in results lists. Titles are gene- ber of titles hosted in preservation-worthy repositories rally current and thematically relevant to the keyword raises cause for concern about their long-term digital searches, and an astonishing 45 % of all monographs availability.

Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 163 Thematically, the searches with the highest rate of re- about the global south are made discoverable locally turn for eBooks were those academic topics of general via the internet to the communities from whom the public interest - for example, cocina indígena and patri- source materials come. The portal developed abo- monio natural México both did better than a search for ve was used to identify titles to feature in thematic producción de quesos. Science-related queries did better research guides for students. One such guide now than expected given the heavily article-driven nature includes an entire page dedicated to sources of freely of publications in those fields. The humanities search available books from Latin America, subdivided by for literary criticism fared less successfully, mirroring country, with a single search point for all sources. the overall lower eBook production numbers in the Other research guides have been enriched with links humanities when compared to the sciences and social to open eBooks throughout. sciences. 10.2. Collection Development One of the obvious drawbacks to searching the web for eBooks is that the accuracy of the results is determined The search portal can also be used for more traditional by the quality of the metadata. The full text of books collection building efforts. Titles discovered through scanned without OCR is unsearchable, and the likeli- thematic searching can be cross-referenced against hood that they will be returned for relevant searches library holdings. Additionally, titles selected as rele- is low. On the other hand, quality books whose text is vant for acquisition, if hosted in preservation-worthy searchable may be returned regardless of low-quality repositories with stable URLs, can simply be catalo- metadata associated with the files. For example, a pdf ged locally as OA eBooks. file of a book may be titled simply “Edición corregida” (Corrected edition) or “Libro pdf” (pdf book) with no re- Through searches performed in the portal, it beca- ference to the book title or topic, however as long as the me apparent that tourism secretariats throughout full text of these books is readable to the search engine the Americas are producing electronically what they can still be returned in the results. This may mean would in printed form be referred to as “coffee ta- that a results list displaying only file names appears at ble books.” These high production value works are

[Melissa Gasparotto] a glance to be lower quality content. And although the less frequently acquired by research libraries. Howe- quality of the titles is high and files were found to be ver, their composition reflects contemporary images hosted primarily on the publishing organization’s web- of national heritage and cultural patrimony as used site, additional questions remain about the appropriate by governments for the purpose of identity conso- use of a discovery tool that cannot by itself distinguish lidation, marketing and economic development. It between legally and illegally distributed online content. is an enticing prospect to provide access to these items cost-free without arranging for the internatio- 10. Applications nal purchase, cataloging, and storage of what would otherwise be considered low-use and large format Once it was established that the search portal could items. reliably return monographs in search results, applica- tions were explored. These included the preparation Some eBooks identified through the portal contai- of thematic research guides, generation of title lists ned copyright statements explicitly permitting the for collection development, and enrichment of exis- deposit in and distribution through a repository, and ting lists of OA eBook sources from Latin America. these items can be catalogued and preserved in an 10.1. Research Guides institutional repository without securing additional permissions. One such example is the book Operación Research guides heavy on cost- reflect a Cóndor: 40 años después (Garzón-Real, 2016), published commitment to broad distribution and access. They by the Centro Internacional para la Promoción de los Dere- can be useful for students and researchers around the chos Humanos, which includes the following notably world, and help ensure that materials produced in or permissive rights statement:

164 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 Todos los derechos reservados. Distribución gratuita. 11. Conclusion Prohibida su venta. Se permite la reproducción total o parcial de este libro, su almacenamiento en un siste- In this case study, a method is proposed for creating ma informá- tico, su transmisión en cualquier forma, o a web search portal to identify OA and cost-free La- por cualquier medio, electrónico, mecánico, fotocopia tin American monographs using Google’s Custom u otros métodos, con la previa autorización del Cen- Search Engine Product, and results show that this is tro Internacional para la Promoción de los Derechos a promising tool for discovery. Open eBook titles dis- Humanos. covered through the CSE were generally current and thematically relevant to the keyword searches, and an [All rights reserved. Free distribution. Sale is prohi- astonishing 45 % of all monographs identified were bited. The total or partial reproduction of this book, not discoverable in any edition, print or electronic, hosting on a computer system, transmission in any through WorldCat. The broad geographic representa- form through any media, electronic, mechanical, pho- tion of eBooks delivered through the portal emphasize tocopy or other methods, is permitted by previous the usefulness of a web discovery tool to enhance ac- authorization of the Centro Internacional para la Pro- cess to materials representing a diversity of quality moción de los Derechos Humanos.] sources originating in Latin America.

As awareness around open access continues to grow, it Documenting searches through the portal has given is to be hoped that more monographs will be published a sense of the breadth and depth of quality scholarly with permissive copyright statements such as this, Latin American OA and cost-free monographs availa- making those publications more readily available for ble on the web. Several uses for a portal customized acquisition, preservation, and use by libraries around for OA monograph discovery are suggested, including the world. user-friendly OA eBook discovery for patrons, re- search guide enrichment and collection development. Notably, the fact that the search portal continued to Further, in demonstrating that a significant number deliver some non-monograph content was helpful for of freely available eBooks from Latin America are the purposes of collection development. For example, unrepresented in world library holdings, the results many non-monograph pdf files delivered through the emphasize the urgent need to consider open access portal were still thematically relevant, sometimes con- scholarly monograph preservation and access. sisting of Latin American book fair programs or book reviews. Resources like these can help librarians aug- 12. Referencias ment lists of titles for acquisition. 1. Badia, G. (2015). Googling for answers: gray literature 10.3. OA eBook Repository Lists sources and metrics in the sciences and . In C. Smallwood (Ed.), The complete guide to using Google The portal and others like it can serve to further en- in libraries, Vol. 2 (pp. 61-68). New York: Rowman & rich existing lists of OA eBook sources. In searching the Littlefield. portal for collection development and research guide 2. Ballard, T. (2012). Google this!: Putting Google and other preparation, numerous repositories previously unk-

social media sites to work for your library. Oxford, England: [Using Google’s Custom Search Engine Product to Discover Scholarly Open Access and Cost-Free eBooks from Latin America] nown to the author were uncovered. These included Chandos Publishing. smaller scope online publishing efforts from individual cities, provincial/state and national agencies, and cul- 3. Ballard, T. (2016). Google's custom search. Online (6), 30-33. tural organizations. Compiling publication sources for Searcher, 40 these items could be important work for libraries en- 4. Crossick, G. (2016). Monographs and open access. suring access to these potentially at-risk born-digital Insights: the UKSG journal, 29(1), 14-19. doi:10.1629/ materials. uksg.280

Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866 165 5. Do Pazo-Oubina, F., Calvo Pitab, C., Puigventós- 15. Impress patrons with your own Google search engines Latorrec, F., Periañez-Párraga, L., & Ventayol- for them. (2007). Unabashed Librarian, 143. Boschc, P. (2011). Desarrollo de un buscador de información farmacoterapéutica no publicada en 16. Nolen, D. S. (2014). Publication and Language Trends of revistas biomédicas. Farmacia Hospitalaria, 35(5), 254. References in Spanish and Latin American Literature. e1- 254.e5. College & Research Libraries, 75(1), 34-50. 6. Domínguez, D., & Ovadia, S. (2011). Twitter: a 17. Notess, G. R. (2008). Custom search engines: Tools & collection Development discovery tool for and by tips. Computers in Libraries, 28(5), 16-17. the people. Collection Management, 36(3), 145-153. doi: 10.1080/01462679.2011.580427 18. Pretlow, C. (2008a). 10 web tools to create user-friendly 7. Garzón-Real, B. (2016). Operación Cóndor. 40 años sites. Computers in Libraries, 28(6), 14-17. después. Buenos Aires: Centro Internacional para la 19. Petlow, C. (2008b). Custom searching. Computers in Promoción de los Derechos Humanos (CIPDH). Recuperado de http://www.cipdh.gov.ar/wp-content/ Libraries, 28(6), 16. uploads/2015/11/Operacion_Condor.pdf 20. Santos-Concepción, L. (2016). Iconografía tének de origen 8. Gavali, R. (2015). Discovery service for engineering and ancestral. El significado de los bordados. Chihuahua, México: technology literature through google custom search: Comisión Nacional para el Desarrollo de los Pueblos A case study. DESIDOC Journal of Library & Information Indígenas. Recuperado de http://www.cdi.gob.mx/ Technology, 35(6), 417-421. iconografia-tenek/ 9. Google LLC. (2017). Google Custom Search. https:// developers.google.com/custom-search/docs/overview. 21. Schmick, D. D., Johnson, E. D., Scoville C. L., & Vaduvathiriyan, P. K. (2012). Building a Google™ 10. Gutiérrez-Palacios, L. (2012). Gestión de la colección de custom search engine (CSE) for foreign language libros electrónicos en las bibliotecas universitarias. Presentation delivered at Bibliotecas universitarias: nuevos tiempos, health information: One library's effort to create a new nuevas soluciones. Valladolid, Spain, September 20-21. tool for health professionals. Journal of Consumer Health on [Melissa Gasparotto] 11. Hagner, K. (2006, October 24). Like Yahoo, Google the Internet, 16(1), 27-36. doi:10.1080/15398285.2011.6465 adds customized search engine. New York Times, C3. 90 12. Hennesy, C., & Bowman, J. (2008). Curating the web: 22. Scott, M. (2016). The Newest novedades: Using social media for Building a Google custom search engine for the arts. collection development. Presentation delivered at the 61st Computers in Libraries, 28(5), 14-15. Seminar on the Acquisition of Latin American Library 13. Hodges, D. (2015). Developing a global e-book Materials, University of Virginia, Charlottesville. collection: An exploratory study. In S. M. Ward, R. S. Freeman, J. M. Nixon (Eds.), E-books in academic libraries: 23. Ward, S. M., Freeman, R. S., & Nixon, J. M. (2015). Stepping up to the challenge (pp. 171-191). West Lafayette: Introduction to academic e-books. In S. M. Ward, Purdue University Press. R. S. Freeman, J. M. Nixon (Eds.), E-Books in Academic 14. Huwe, T. K. (2017). The long and winding road of Libraries: Stepping up to the Challenge (pp. 1-16). West ebooks. Computers in Libraries, 37(5), 9-11. Lafayette: Purdue University Press.

166 Rev. Interam. Bibliot. Medellín (Colombia) Vol. 41, número 2/mayo-agosto 2018 pp. 153-166 ISSN 0120-0976 / ISSN (en línea) 2538-9866