The Semantic Grid: Enabling E-Science
Total Page:16
File Type:pdf, Size:1020Kb
The Semantic Grid: Enabling e-Science David De Roure University of Southampton www.semanticgrid.org PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Outline 1. The ambition 2. Enabling Technologies n Grid n Semantic Web 3. Semantic Grid 4. Are we there yet? 5. The Future May 2006 ISGC 2 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Outline 1. The ambition 2. Enabling Technologies n Grid n Semantic Web 3. Semantic Grid 4. Are we there yet? 5. The Future May 2006 ISGC 3 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Vision: e-Science e-Science is about global collaboration in key areas of science and the next generation of [computing] infrastructure that will enable it. e-Science will change the dynamic of the way science is undertaken. John Taylor, Director General of UK Research Councils in 2001 May 2006 ISGC 4 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Vision: Grid Grid computing has emerged as an important new field, distinguished from conventional distributed computing by its focus on large-scale resource sharing, innovative applications, and, in some cases, high- performance orientation...we [define] the "Grid problem”…as flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions, and resources -what we refer to as virtual organizations From "The Anatomy of the Grid: Enabling Scalable Virtual Organizations" by Foster, Kesselmanand Tuecke May 2006 ISGC 5 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Requirements These visions require an infrastructure for flexible, coordinated resource sharing – they are fundamentally about joining resources up, automatically, in order to do things that weren’t possible before Instruments Computation Services Data People Devices May 2006 ISGC 6 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Challenges: virtual orgs n Resource configurations are n Scale of data and compute transient, dynamic and resources is large volatile as services (databases, n Quality of Service and sensors, compute servers) performance criteria are switched in and out severe n They are ad-hoc as service n Platform must be scalable, consortia have no central able to evolve, fault-tolerant, location or control, and no robust, persistent and existing trust relationships reliable n They may be large, with n It should work seamlessly, hundreds of services and transparently – the user orchestrated at any time might not know or care n They may be long-lived, for where their calculation is example a protein folding done using how many simulation could take weeks machines, or where data is actually held May 2006 ISGC 7 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Challenges: integration May 2006 ISGC 8 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com myGrid n Wish to reuse n Data n Services n Knowledge n SofCtowmbaerechem n Practice n Anticipated use n Unanticipated use May 2006 ISGC 9 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Outline 1. The ambition 2. Enabling Technologies n Grid n Semantic Web 3. Semantic Grid 4. Are we there yet? 5. The Future May 2006 ISGC 10 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com n An automatically processable, n On demand transparently machine understandable web constructed multi- organisational federations n Distributed knowledge and of distributed services information management n Distributed computing n Information integration middleware n Computational Integration Carole Goble May 2006 ISGC 11 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com May 2006 ISGC 12 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Origins of the Semantic Web The Semantic Web is an extension of the current Web in which information is given a well-defined meaning, better enabling computers and people to work in cooperation. It is the idea of having data on the Web defined and linked in a way that it can be used for more effective discovery, automation, integration and reuse across various applications. The Web can reach its full potential if it becomes a place where data can be processed by automated tools as well as people. W3C Activity Statement May 2006 ISGC 13 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Layers of Languages You are here May 2006 ISGC 14 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Web vsSemantic Web Web page Any Web Resource <a href= URI> HTML <a href=“http://…”> URI URI URI RDF is like the web! RDF Hendler May 2006 ISGC 15 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Making Knowledge Explicit All influenced by RDF OWL Lite(thesaurus) OWL DL (reason-able) OWL Full (anything goes) RDF Resource Description OWL Web Ontology Framework Language May 2006 ISGC 16 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Applications connected by concepts May 2006 ISGC 17 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Outline 1. The ambition 2. Enabling Technologies n Grid n Semantic Web 3. Semantic Grid 4. Are we there yet? 5. The Future May 2006 ISGC 18 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com So what is the Semantic Grid? n The Grid vision is about coordinated resource sharing – virtual organisations n Fundamentally, this means that information and knowledge in and about the system must be ‘machine processable’ n The full richness of the Grid ambition depends upon realisingthe Semantic Grid May 2006 ISGC 19 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com The Semantic Grid Report 2001 n At this time, there are a number of grid applications being developed and there is a whole raft of computer technologies that provide fragments of the necessary functionality. n However there is currently a major gap between these endeavours and the vision of e-Science in which there is a high degree of easy-to-use and seamless automation and in which there are flexible collaborations and computations on a global scale. www.semanticgrid.org NB Report updated – March 2005 issue of Proceedings of the IEEE May 2006 ISGC 20 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Building bridges May 2006 ISGC 21 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Semantic Grid Semantic Semantic Web Grid Classical Classical Web Grid May 2006 ISGC 22 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Semantics in and on the Grid The Semantic Grid is an extension of the current Grid in which information and services are given well-defined meaning, better enabling computers and people to work in cooperation May 2006 ISGC 23 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Semantics in and on the Grid The Semantic Grid May 2006 ISGC 24 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Grid is metadata based middleware 1. Portals and Workbenches Astronomy Sky Survey Data Grid 2.Knowledge & Resource 3. Metadata Data Catalog Bulk Data Management View View Analysis Analysis Concept space Standard APIs and Protocols 4.Grid Information Metadata Data Data Security 5. Discovery delivery Discovery Delivery Caching Replication Standard Metadata format, Data model, Wire format Backup Scheduling 6. Catalog Mediator Data mediator Catalog/Image Specific Access 7. Compute Resources Derived Collections Catalogs Data Archives May 2006 ISGC 25 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com For example… Annotations Personal notes results provenance May 2006 ISGC 26 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Semantics in e-Science n RDF-based service and data registries n RDF-based metadata for experimental components n RDF-based provenance graphs n OWL based controlled vocabularies for database content n OWL based integration May 2006 ISGC 27 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Engineering Design Reliability Security QoS GEODISE PORTAL Traceability OPTIMISATION APPLICATION SERVICE COMPUTATION PROVIDER Licenses and code May 2006 ISGC 28 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com Combe Chempilot project e e May 2006 ISGC 29 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com FloodNet subscribers users GPRS May 2006 ISGC 30 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com GGF9 Semantic Grid Workshop n The Role of Concepts in myGrid Carole Goble n Planning and Metadata on the Computational Grid Jim Blythe n Semantic support for Grid-Enabled Design Search in Engineering Simon Cox n Knowledge Discovery and Ontology-based services on the Grid Mario Cannataro n Attaching semantic annotations to service descriptions Luc Moreau n Semantic Matching of Grid Resource Description Frameworks John Brooke n Interoperability challenges in Grid for Industrial Applications Mike Surridge n Semantic Grid and Pervasive Computing David De Roure May 2006 ISGC 31 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com E-Science Special Issue n IEEE Intelligent Issue Special Issue on E-Science, Jan-Feb 2004 n De Roure, Gil, Hendler n Challenges: n Realisingthe network effect n Moving beyond centralisedstores n Automated assembly n Collaboration tools May 2006 ISGC 32 PDF 檔案以 "pdfFactory Pro" 試用版建立 www.pdffactory.com GGF11 Semantic Grid Workshop n Engineering semantics: Costs and n Using the Semantic Grid to Build Benefits Cox Bridges between Museums and Indigenous Communities Schroeter n Designing Ontologies and Distributed Resource Discovery n Collaborative Tools in the Semantic Grid De Roure Services for an Earthquake Simulation Grid Pierce n The Integration of Peer-to-peer and the Grid to Support Scientific n Exploring Williams-Beuren Collaboration Syndrome Using myGrid Goble n OWL-Based Resource Discovery n Distributed Data Management and for Inter-Cluster Resource Integration Framework: The Borrowing Yoshida MobiusProject Hastings n Semantic