Geoweb Crawler: an Extensible and Scalable Web Crawling Framework for Discovering Geospatial Web Resources
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
The Uch Enmek Example(Altai Republic,Siberia)
Faculty of Environmental Sciences Institute for Cartography Master Thesis Concept and Implementation of a Contextualized Navigable 3D Landscape Model: The Uch Enmek Example(Altai Republic,Siberia). Mussab Mohamed Abuelhassan Abdalla Born on: 7th December 1983 in Khartoum Matriculation number: 4118733 Matriculation year: 2014 to achieve the academic degree Master of Science (M.Sc.) Supervisors Dr.Nikolas Prechtel Dr.Sander Münster Submitted on: 18th September 2017 Faculty of Environmental Sciences Institute for Cartography Task for the preparation of a Master Thesis Name: Mussab Mohamed Abuelhassan Abdalla Matriculation number: 4118733 Matriculation year: 2014 Title: Concept and Implementation of a Contextualized Navigable 3D Landscape Model: The Uch Enmek Example(Altai Republic,Siberia). Objectives of work Scope/Previous Results:Virtual Globes can attract and inform websites visitors on natural and cultural objects and sceneries.Geo-centered information transfer is suitable for majority of sites and artifacts. Virtual Globes have been tested with an involvement of TUD institutes: e.g. the GEPAM project (Weller,2013), and an archaeological excavation site in the Altai Mountains ("Uch enmek", c.f. Schmid 2012, Schubert 2014).Virtual Globes technology should be flexible in terms of the desired geo-data configuration. Research data should be controlled by the authors. Modes of linking geo-objects to different types of meta-information seems evenly important for a successful deployment. Motivation: For an archaeological conservation site ("Uch Enmek") effort has already been directed into data collection, model development and an initial web-based presentation.The present "Open Web Globe" technology is not developed any further, what calls for a migra- tion into a different web environment. -
Mashing-Up Maps Google Geo Services and the Geography Of
Mashing-up Maps Google Geo Services and the Geography of Ubiquity Craig M. Dalton A dissertation submitted to the faculty of the University of North Carolina at Chapel Hill in partial fulfillment of the requirements for the degree of Doctor in Philosophy in the Department of Geography. Chapel Hill 2012 Approved by: Dr. Scott Kirsch Dr. Banu Gokariksel Dr. Kenneth Hillis Dr. John Pickles Dr. Sarah Sharma © 2012 Craig M. Dalton ALL RIGHTS RESERVED ii Abstract CRAIG DALTON: Mashing-up Maps: Google Geo Services and the Geography of Ubiquity (Under the direction of Scott Kirsch) How are Google geo services such as Google Maps and Google Earth shaping ways of seeing the world? These geographic ways of seeing are part of an influential and problematic geographic discourse. This discourse reaches hundreds of millions of people, though not all have equal standing. It empowers many people to make maps on the geoweb, but within the limits of Google’s business strategy. These qualities, set against the state-centeredness of mapmaking over the last six hundred years, mark the Google geo discourse as something noteworthy, a consumer-centered mapping in a popular geographic discourse. This dissertation examines the Google geo discourse through its social and technological history, Google’s role in producing and limiting the discourse, and the subjects who make and use these maps. iii Acknowledgements This dissertation was only possible with the help of a large number of people. I owe each a debt of gratitude. Chief among them is a fantastic advisor, Scott Kirsch. His patience, grace, and good criticism saw me through the trials of graduate school. -
Review of Web Mapping: Eras, Trends and Directions
International Journal of Geo-Information Review Review of Web Mapping: Eras, Trends and Directions Bert Veenendaal 1,*, Maria Antonia Brovelli 2 ID and Songnian Li 3 ID 1 Department of Spatial Sciences, Curtin University, GPO Box U1987, Perth 6845, Australia 2 Department of Civil and Environmental Engineering (DICA), Politecnico di Milano, P.zza Leonardo da Vinci 32, 20133 Milan, Italy; [email protected] 3 Department of Civil Engineering, Ryerson University, 350 Victoria Street, Toronto, ON M5B 2K3, Canada; [email protected] * Correspondence: [email protected]; Tel.: +618-9266-7701 Received: 28 July 2017; Accepted: 16 October 2017; Published: 21 October 2017 Abstract: Web mapping and the use of geospatial information online have evolved rapidly over the past few decades. Almost everyone in the world uses mapping information, whether or not one realizes it. Almost every mobile phone now has location services and every event and object on the earth has a location. The use of this geospatial location data has expanded rapidly, thanks to the development of the Internet. Huge volumes of geospatial data are available and daily being captured online, and are used in web applications and maps for viewing, analysis, modeling and simulation. This paper reviews the developments of web mapping from the first static online map images to the current highly interactive, multi-sourced web mapping services that have been increasingly moved to cloud computing platforms. The whole environment of web mapping captures the integration and interaction between three components found online, namely, geospatial information, people and functionality. In this paper, the trends and interactions among these components are identified and reviewed in relation to the technology developments. -
A Geoweb-Based Tagging System for Borderlands Data Acquisition
ISPRS Int. J. Geo-Inf. 2015, 4, 1530-1548; doi:10.3390/ijgi4031530 OPEN ACCESS ISPRS International Journal of Geo-Information ISSN 2220-9964 www.mdpi.com/journal/ijgi/ Article A Geoweb-Based Tagging System for Borderlands Data Acquisition Hanfa Xing 1,*, Jun Chen 2 and Xiaoguang Zhou 3 1 College of Geography and Environment, Shandong Normal University, Jinan 250014, China 2 National Geomatics Center of China, Beijing 100830, China; E-Mail: [email protected] 3 School of Geosciences and Info-Physics, Central South University, Changsha 410083, China; E-Mail: [email protected] * Author to whom correspondence should be addressed; E-Mail: [email protected]; Tel.: +86-531-8961-0938. Academic Editor: Wolfgang Kainz Received: 29 May 2015 / Accepted: 12 August 2015 / Published: 21 August 2015 Abstract: Borderlands modeling and understanding depend on both spatial and non-spatial data, which were difficult to obtain in the past. This has limited the progress of borderland-related research. In recent years, data collection technologies have developed greatly, especially geospatial Web 2.0 technologies including blogs, publish/subscribe, mashups, and GeoRSS, which provide opportunities for data acquisition in borderland areas. This paper introduces the design and development of a Geoweb-based tagging system that enables users to tag and edit geographical information. We first establish the GeoBlog model, which consists of a set of geospatial components, posts, indicators, and comments, as the foundation of the tagging system. GeoBlog is implemented such that blogs are mashed up with OpenStreetMap. Moreover, we present an improvement to existing publish/subscribe systems with support for spatio-temporal events and subscriptions, called Spatial Publish/Subscribe, as well as the event agency network for routing messages from the publishers to the subscribers. -
An Algorithm Based Methodology for the Creation of a Regularly Updated Global Online Map Derived from Volunteered Geographic Information
GEOProcessing 2012 : The Fourth International Conference on Advanced Geographic Information Systems, Applications, and Services An Algorithm Based Methodology for the Creation of a Regularly Updated Global Online Map Derived From Volunteered Geographic Information Marcus Goetz, Johannes Lauer, Michael Auer Chair of GIScience, Institute of Geography University of Heidelberg Heidelberg, Germany {m.goetz, jlauer, auer}@uni-heidelberg.de Abstract— Global online maps are an important tool and data different levels of skills create spatial data by either sets such for such maps are normally provided by commercial performing personal measurements via GPS etc. or by providers or public authorities. Nevertheless, the ever tracing publicly available aerial images such as those expanding trend of collaboratively collected geodata by provided by Bing. Afterwards, this data is uploaded to a Web hobbyists, namely Volunteered Geographic Information (VGI), 2.0 community and shared with other users, which are also increases regarding both data quantity and quality. Therefore, allowed to reedit existing data or to use existing data at no VGI can be considered as a real alternative data source for the charge. Additionally, also other geo-referenced information provision of a global online map service, similar to those such as geo-referenced pictures or place locations can be provided by Google Maps or Bing Maps. Therefore, an online considered as VGI. There are many different communities map service needs to be created, whereby relevant data comes and portals sharing and collecting VGI, and there is an from a regularly updated database containing VGI. Due to the dynamic and fast changing nature of VGI sources, the enormous potential arising from six billion humans acting as workflow for processing VGI data needs to be automated on a remote sensors [2]. -
GEOG 407 Course Description 2016
GEOG 407: Principles of the Geospatial Web Room Burnside 511, 11:35-12:55, WF Prof Sieber, Instructor Office Hours: Burnside 411, Fridays, 13:00-15:00, or by appointment (x 4941, better to email [email protected]) Mr Dipto Sakar, Teaching Assistant Introduction The paradigm has shifted. No longer is desktop-bound, single software geographic information systems (GIS) considered the state of the art in technologies for geographic data handling, analysis and data visualization. Now advances in geographic information occur on cloud and mobile platforms and data representations are “mashed up” in web 2.0 applications. The nature of geographic data has changed as well. We now have very large and streaming datasets, called “big data”, which contains geo-locations, for example from mobile sensors. Much of the new data comes from user generated content, which is generally available on social media and is far more heterogeneous in its characterization of geographic locations. In contrast to traditional geospatial data, which originates from authoritative sources, new possibilities emerge with crowdsourced asserted data, which is location-based sentiments and observations from non-experts (called volunteered geographic information {VGI}). In this course we will cover the principles of this paradigm, called the Geospatial Web 2.0 or Geoweb. Like GIS, the Geoweb has broad applicability that extends well beyond the disciplines of geography and computer science. Numerous examples can be seen in health provision and epidemiology, wildlife and natural resources, criminology, and transportation planning. The Geoweb can be used in retail marketing, political mobilization, tourism development, journalism and the humanities. The Geoweb also can be fully linked to social networking platforms. -
An Analysis of Spatial Tactics and Volunteered Geographic Information
University of Pennsylvania ScholarlyCommons Departmental Papers (ASC) Annenberg School for Communication 7-7-2014 The Geoweb and Everyday Life: An Analysis of Spatial Tactics and Volunteered Geographic Information Jessa Lingel University of Pennsylvania, [email protected] Bradley W. Bishop Follow this and additional works at: https://repository.upenn.edu/asc_papers Part of the Communication Commons Recommended Citation Lingel, J., & Bishop, B. W. (2014). The Geoweb and Everyday Life: An Analysis of Spatial Tactics and Volunteered Geographic Information. First Monday, 19 (7), https://doi.org/10.5210/fm.v19i7.5316 This paper is posted at ScholarlyCommons. https://repository.upenn.edu/asc_papers/596 For more information, please contact [email protected]. The Geoweb and Everyday Life: An Analysis of Spatial Tactics and Volunteered Geographic Information Abstract In this paper, we discuss GeoWeb technologies, specifically those created via volunteered geographic information (VGI) as a means of analyzing the political contours of mapmaking. Our paper is structured around two case studies of VGI projects that allow for consideration for the political efficacy (and potential drawbacks) of these geospatial technologies. We use de Certeau’s constructs of strategies and tactics as a conceptual framing, which allows for a political reading of geographic data couched in the context of everyday life, as well as opening up inquiry into the politics of making, accessing and interpreting spatial data. We conclude by suggesting provocations for future research on the GeoWeb and VGI at the intersection of geography and information science. Keywords Geoweb, Volunteered Geographic Information, Critical Information Studies Disciplines Communication | Social and Behavioral Sciences This journal article is available at ScholarlyCommons: https://repository.upenn.edu/asc_papers/596 In this paper, we discuss GeoWeb technologies, specifically those created via volunteered geographic information (VGI) as a means of analyzing the political contours of mapmaking. -
A Systems Perspective on Volunteered Geographic Information
ISPRS Int. J. Geo-Inf. 2014, 3, 1278-1292; doi:10.3390/ijgi3041278 OPEN ACCESS ISPRS International Journal of Geo-Information ISSN 2220-9964 www.mdpi.com/journal/ijgi/ Article A Systems Perspective on Volunteered Geographic Information Victoria Fast 1,* and Claus Rinner 2 1. Environmental Applied Science and Management, Ryerson University, 350 Victoria St., Toronto, ON M5B 2K3, Canada 2. Department of Geography, Ryerson University, 350 Victoria St., Toronto, ON M5B 2K3, Canada; E-Mail: [email protected] * Author to whom correspondence should be addressed; E-Mail: [email protected]; Tel.: +1-416-979-5000 (ext. 2686); Fax: +1-416-979-5362. External Editors: Alexander Zipf and Wolfgang Kainz Received: 14 July 2014; in revised form: 20 October 2014 / Accepted: 14 November 2014 / Published: 4 December 2014 Abstract: Volunteered geographic information (VGI) is geographic information collected by way of crowdsourcing. However, the distinction between VGI as an information product and the processes that create VGI is blurred. Clearly, the environment that influences the creation of VGI is different than the information product itself, yet most literature treats them as one and the same. Thus, this research is motivated by the need to formalize and standardize the systems that support the creation of VGI. To this end, we propose a conceptual framework for VGI systems, the main components of which—project, participants, and technical infrastructure—form an environment conducive to the creation of VGI. Drawing on examples from OpenStreetMap, Ushahidi, and RinkWatch, we illustrate the pragmatic relevance of these components. Applying a system perspective to VGI allows us to better understand the components and functionality needed to effectively create VGI. -
Thinking the Geoweb: Political Economies, 'Neo'geographies, And
Thinking the Geoweb: Political economies, ‘neo’geographies, and spatial media Agnieszka Leszczynski A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Washington 2012 Reading Committee: Sarah Elwood, Chair Katharyne Mitchell Matthew Sparke Nadine Schuurman Program Authorized to Offer Degree: Geography ©Copyright 2012 Agnieszka Leszczynski University of Washington Abstract Thinking the Geoweb: Political economies, ‘neo’geographies, and spatial media Agnieszka Leszczynski Chair of Supervisory Committee: Professor Sarah Elwood Geography Critical GIS and GIScience face tremendous methodological and conceptual challenges at present as they grapple with the emergence and proliferation of a diverse range of new, Web- based geographical information technologies that cannot be defined or engaged in terms of conventional geographic information systems (GIS). Together, these new hardware/software objects, the new content forms that spatial data are assuming, and practices around these technologies and information artifacts are referred to by geographers as ‘the geoweb.’ The emergence of the geoweb is fundamentally transforming the ways in which society, space, and technology intersect and are co-articulated. Against this backdrop, this research takes the material and digital presences of geoweb phenomena as primary evidence of a transformative moment in the production, distribution, commercialization, circulation, and public awareness of geographic information technologies. On the basis of a content and discourse analysis of textual material thematically about the geoweb that I archived and coded over a period of three years (June 2009 – June 2012), I advance propositions that address the intellectual challenge of thinking – apprehending, conceptualizing, and engaging – the geoweb as a multi-faceted socio- spatio-technical phenomenon. -
Neogeography Invited Submission for Oxford Bibliographies in Geography
PLEASE CONTACT PRIOR TO CITING Wilson 1 wilson_neogeo_distrib.docx Neogeography Invited submission for Oxford Bibliographies in Geography Wilson, Matthew W. In press. Neogeographies. In Oxford Bibliographies in Geography. Barney Warf, ed. Oxford University Press. Matthew W. Wilson Department of Geography, University of Kentucky Center for Geographic Analysis, Harvard University Introduction The use of the term neogeography serves as a shorthand for a range of technical practices and attitudes that embrace ludic and everyday uses of geospatial technologies, amid their general proliferation. While the origins of the recent use of the term is often attributed to a post on the website Platial by Di-Ann Eisnor in 2006, neogeography has a more extended, if punctuated, provenance. This entry will take up this more recent emergence, to overview the conditions through which neogeography becomes a response to variants of academic and industrial mapmaking. Neogeography, as a more recent attitude or response, operates at a different rhythm than that of academic publication and, as such, an overview of the efforts nominally considered neogeographic requires a broader understanding of the modes of production -- academic and industrial -- as these ideas proliferate. As part of this broadened understanding, this entry places neogeography within a continuity of discussions that gained traction in the mid-1990s, under the umbrella subfield of GIS & Society. This includes specific debates around participation and democracy, privacy and pervasiveness, and commodification and connectivity. Those promoting the idea of neogeography tend to do so in absence of the history of the industries and academic fields that lead to its recent provenance. This overview is meant to establish some foundations for such departures. -
Social and Political Dimensions of the Openstreetmap Project: Towards a Critical Geographical Research Agenda
Social and Political Dimensions of the OpenStreetMap Project: Towards a Critical Geographical Research Agenda Georg Glasze and Chris Perkins Abstract Critical cartographic scholarship has demonstrated that maps (and geoinformation in general) can never be neutral or objective: maps are always embedded in specific social contexts of production and use and thus unavoidably reproduce social conventions and hierarchies. Furthermore, it has been argued that maps also (re)produce certain geographies and thus social realities. This argument shifts attention to the constitutive effects of maps and the ways in which they make the world. Within the discussion on neogeography and volunteered geographic information, it has been argued that crowd sourcing offers a radical alternative to conventional ways of map making, challenging the hegemony of official and commercial cartographies. In this view, crowd-sourced Web 2.0-mapping projects such as OpenStreetMap (OSM) might begin to offer a forum for different voices, mapping new things, enabling new ways of living. In our contribution, we frame a research agenda that draws upon critical cartography but widens the scope of analysis to the assemblages of practices, actors, technologies, and norms at work: an agenda which is inspired by the “critical GIS”-literature, to take the specific social contexts and effects of technologies into account, but which deploys a processual view of mapping. We recognize that a fundamental transition in mapping is taking Part of this paper has been written while Georg Glasze was a visiting researcher at the Oxford Internet Institute (OII) in 2014. We want to thank Steve Chilton (London), Christian Bittner, Tim Elrick (both Erlangen), various colleagues from the OII and the three anonymous referees for their advices on aspects of this paper. -
Guest Editorial: Theorizing the Geoweb
GeoJournal DOI 10.1007/s10708-013-9489-7 Guest editorial: theorizing the geoweb Agnieszka Leszczynski • Matthew W. Wilson Ó Springer Science+Business Media Dordrecht 2013 The general convergence of location with digital of the geoweb have been informed by the GIScience information communication technologies (ICTs) has and Critical GIS traditions, which are ontologically brought about profound shifts in the content, forms, and epistemologically committed to data regimes, and practices that surround spatial media. In geogra- practices, and technics associated with geographic phy, these phenomena have been variously and information systems (GIS) as a singular or unique alternately referred to as ‘volunteered geographic technological assemblage (for examples see Farman information’ (VGI) (Elwood et al. 2011; Goodchild 2010; Guptill 2007; Miller 2006; Sui and Goodchild 2007), ‘neogeography’ (Graham 2010; Turner 2006; 2011; Sui 2008; Wilson 2009). Warf and Sui 2010; Wilson and Graham 2013a, More recently, however, geographers have 2013b), ‘(new) spatial media’ (Crampton 2009; acknowledged that the rapid proliferation and diver- Elwood and Leszczynski 2012), and ‘the geoweb,’ sification of spatial media, content forms, and praxes (Elwood and Leszczynski 2011; Haklay et al. require new empirical, conceptual, and theoretical 2008; Scharl and Tochtermann 2007). Here, we approaches to apprehend both the nature and implica- prefigure ‘the geoweb’ as we consider it to account tions of these transitions and materialities. This need for both new materialities and new practices. Regard- for new approaches has been most saliently articulated less of the neologism used to refer to these phenom- in a 2008 special issue of GeoJournal devoted to VGI ena, they nevertheless present significant challenges to edited by Sarah Elwood (volume 72 issues 3–4) our disciplinary thinking about geographic informa- (Elwood 2008b).