Web Services Based Architecture in Computational Web Portals

Total Page:16

File Type:pdf, Size:1020Kb

Web Services Based Architecture in Computational Web Portals Web Services Based Architecture in Computational Web Portals By Choonhan Youn B.S. The University of Ulsan, 1991 M.S. Syracuse University, 1998 DISSERTATION Submitted in partial fulfillment of the requirements for the degree of Doctoral of Philosophy in Computer Science in the Graduate School of Syracuse University December 2003 Approved_______________________________ Professor Geoffrey C. Fox Date___________________________________ Abstract Computational web portals provide user environments that simplify access and integrate various distributed computational services for scientists working on particular classes of problems. The computational web portal, Gateway, consists of a dynamically generated and browser-based user interface that adds the client applications and a distributed component-based middle tier, WebFlow. The WebFlow middle tier provides a coarse-grained approach to accessing both stand-alone and grid-enabled back end computing resources. Like most computational web portals, Gateway was originally implemented in a three-tiered structure. This has inherent limitations for building portals that can easily interoperate and share services. Specific application portals are typically built on common sets of core services, so reusability of these services is a key problem in Problem Solving Environment development. In this dissertation we address the reusability problem by presenting a comprehensive view of an interoperable portal architecture, beginning with a set of core services built using the Web services model and application metadata services that can be used to build science application front ends out of these core services, which in turn may be aggregated and managed through portlet containers. Managing multiple versions of services is an important consequence of this issue, and we close with a description of our work on negotiation for version control. These portal services may be implemented in a programming-language and platform independent way using a Web services approach. However, security in Web services for distributed computing systems is an open issue involving multiple security mechanisms and competing standards. In this dissertation we present an implementation of a flexible, message-based security system that can be bound to multiple mechanism and multiple message formats. We have developed QuakeSim portal for the earthquake science by presenting XML schemas and our design for related data services for describing faults, surface displacements, and specific simulation codes. These data services are implemented using a Web services approach and are incorporated in a portal architecture with other, general purpose services for application and file management. We then illustrate how these data models and services may be used to build distributed, interacting applications through data flow. © Copyright 2003 Choonhan Youn All rights Reserved Table of Contents 1 Introduction 1 1.1 Problem Statement and Contributions . 1 1.2 Organization of the Dissertation . 5 2 Survey of Technologies 8 2.1 Web Portal Stacks . 8 2.2 Grids . 10 2.3 Services . 14 2.4 Portlets . 16 2.5 Portals . 17 3 Gateway System 21 3.1 Classic Three-tiered Architecture . 22 3.1.1 Gateway User Interface . 23 3.1.2 Distributed Component-Based Middleware . 25 v 3.2 Gateway Portal Metadata . 27 3.3 Portal services . 28 3.3.1 Job submission . 28 3.3.2 File transfer manipulation . 29 3.3.3 Context (state) creation and management . 29 3.3.4 Batch script generation . 30 3.3.5 Job monitoring . 31 3.3.6 Shared Remote Visualization . 31 3.4 Security requirements . 35 3.4.1 Security in multi-layered architectures . 35 3.4.2 Kerberos security for web application . 38 3.5 Conclusion . 39 4 Web services based Architecture and Core services 41 4.1 Overview of problem . 41 4.2 CORBA and Web Services . 44 4.2.1 The CORBA versus Web Services approach . 44 4.2.2 The performance test . 45 4.2.3 Shortcomings of Web Services . 49 4.3 Web Service-Based Computing Portal Architecture . 50 4.4 Core Web services for Computing Portals . 55 4.4.1 Job submission . 56 4.4.2 File Manipulation . 56 vi 4.4.3 Context Management . 57 4.4.4 Script Generation . 60 4.4.5 Job Monitoring . 61 4.5 Summary . 62 5 Application Web Services (AWS) 63 5.1 Introduction . 63 5.2 AWS proxy component architecture . 65 5.3 AWS Lifecycles . 66 5.4 AWS XML Descriptors . 67 5.5 The AWS deployment and use . 71 6 Web service Security and Negotiation 76 6.1 Introduction . 76 6.2 Secure Web services . 78 6.2.1 Web services security languages . 79 6.2.2 Secure SOAP message format . 81 6.2.3 Message-level security infrastructure . 82 6.2.4 Multiple accesses in a distributed system . 86 6.3 Web service negotiation . 88 6.3.1 Overview . 88 6.3.2 Motivating examples . 90 6.3.3 Offer/Answer model . 92 vii 6.3.4 Implementation . 93 6.4 Summary . 96 7 Application: Distributed Earthquake Modeling Web Portal 97 7.1 Code and project descriptions . 98 7.2 QuakeSim Portal Architecture . 101 7.3 XML Descriptors for Code Input/Outputs . 103 7.4 Implementation of services for the Data Model . 105 7.5 Data Service Architecture . 108 7.6 QuakeSim Portal Toolkits . 112 7.6.1 The user interface for the code submission . 113 7.6.2 The user interface for the File Management and Job Monitoring . 117 7.7 Summary . 118 8 Conclusion and Future Work 120 8.1 Conclusion . 120 8.2 Future Work . 124 8.2.1 The Use of service architecture with proxy-style portal frontended by aggregation portal . 124 8.2.2 Particular services needed . 126 8.2.3 Issues connected to security with different needs in different cases . 127 A WSDL (Web Services Description Language) 129 viii B XML schema 184 Bibliography 199 ix List of Figures 2.1 Web Portal Stacks . 9 3.1 Gateway Portal Architecture . 23 3.2 A container hierarchy of WebFlow Servers . 26 3.3 The architecture of the shared visualization showing the publisher and two collaborating viewers A and B . 33 3.4 The Charon module is used to tunnel HTTP requests over a secure CORBA wire protocol . 39 4.1 Each portal has its own code base for the middleware that can’t be easily integrated with other groups’ middleware . 43 4.2 The measured transfer time for the message.
Recommended publications
  • Microsoft's Internet Exploration: Predatory Or Competitive?
    Cornell Journal of Law and Public Policy Volume 9 Article 3 Issue 1 Fall 1999 Microsoft’s Internet Exploration: Predatory or Competitive Thomas W. Hazlett Follow this and additional works at: http://scholarship.law.cornell.edu/cjlpp Part of the Law Commons Recommended Citation Hazlett, Thomas W. (1999) "Microsoft’s Internet Exploration: Predatory or Competitive," Cornell Journal of Law and Public Policy: Vol. 9: Iss. 1, Article 3. Available at: http://scholarship.law.cornell.edu/cjlpp/vol9/iss1/3 This Article is brought to you for free and open access by the Journals at Scholarship@Cornell Law: A Digital Repository. It has been accepted for inclusion in Cornell Journal of Law and Public Policy by an authorized administrator of Scholarship@Cornell Law: A Digital Repository. For more information, please contact [email protected]. MICROSOFT'S INTERNET EXPLORATION: PREDATORY OR COMPETITIVE? Thomas W. Hazlettt In May 1998 the U.S. Department of Justice ("DOJ") accused Microsoft of violatirig the Sherman Antitrust Act by vigorously compet- ing against Netscape's Navigator software with Microsoft's rival browser, Internet Explorer. The substance of the allegation revolves around defensive actions taken by Microsoft to protect the dominant po- sition enjoyed by Microsoft's Windows operating system. The DOJ's theory is that, were it not for Microsoft's overly aggressive reaction to Netscape, Navigator software would have been more broadly distributed, thus enabling competition to Windows. This competition would have come directly from Java, a computer language developed by Sun Microsystems and embedded in Netscape software, allowing applications to run on any underlying operating system.
    [Show full text]
  • Mindbill® Billing and Customer Care Solution
    ® MINDBill Billing and Customer Care Solution End-to-End Billing and Customer Care Gain Competitive Advantage with a Truly Convergent Billing & Customer Care Solution ©2018 MIND CTI LTD CONTENTS EXECUTIVE OVERVIEW ...................................................................... 1 ARCHITECTURE HIGHLIGHTS .............................................................. 2 LOGICAL ARCHITECTURE ........................................................................... 2 The Access Layer ............................................................................ 2 The Business Layer ......................................................................... 3 The Data Layer ............................................................................... 4 The Management Layer ................................................................. 4 CUSTOMER RELATIONSHIP MANAGEMENT ........................................ 5 ACCOUNTS ............................................................................................. 5 Unlimited Hierarchy of Accounts ................................................... 5 Customer care ................................................................................ 6 Account Home Page ....................................................................... 6 Order Management ....................................................................... 7 Account Journal .............................................................................. 9 Trouble Ticketing ...........................................................................
    [Show full text]
  • W Web Portal Application Development Technologies
    1131 Web Portal Application Development W Technologies Américo Sampaio Lancaster University, UK Awais Rashid Lancaster University, UK INTRODUCTION The evolution of capabilities provided by Web portals, such as content management, personalization for different The growth of the Internet and the World Wide Web has users and groups of users, collaboration, and security, imposed contributed to significant changes in many areas of our so- difficulties for Web portal developers. The main challenges ciety. The Web has provided new ways of doing business, faced by the developers were: and many companies have been offering new services as well as migrating their systems to the Web. • How to integrate different applications inside the The main goal of the first Web sites was to facilitate the intranet and also over the Internet sharing of information between computers around the world. • How to provide specific content to different kinds These Web sites were mainly composed of simple hypertext of users and how to categorize users in groups and documents containing information in text format and links to provide the necessary information other documents that could be spread all over the world. The • How to obtain the information from other partners, or first users of thisnew technology were university researchers service providers, over the Web interested in some easier form of publishing their work, and • How to gather and tailor the information to the specific also searching for other interesting research sources from target users other universities. • How to secure the access of different kinds of users After a few years the popularity of the Web increased significantly, especially after the creation of user-friendly In order to address some of these issues, specific tools Web browsers and Internet services providers.
    [Show full text]
  • Neuro Informatics 2020
    Neuro Informatics 2019 September 1-2 Warsaw, Poland PROGRAM BOOK What is INCF? About INCF INCF is an international organization launched in 2005, following a proposal from the Global Science Forum of the OECD to establish international coordination and collaborative informatics infrastructure for neuroscience. INCF is hosted by Karolinska Institutet and the Royal Institute of Technology in Stockholm, Sweden. INCF currently has Governing and Associate Nodes spanning 4 continents, with an extended network comprising organizations, individual researchers, industry, and publishers. INCF promotes the implementation of neuroinformatics and aims to advance data reuse and reproducibility in global brain research by: • developing and endorsing community standards and best practices • leading the development and provision of training and educational resources in neuroinformatics • promoting open science and the sharing of data and other resources • partnering with international stakeholders to promote neuroinformatics at global, national and local levels • engaging scientific, clinical, technical, industry, and funding partners in colla- borative, community-driven projects INCF supports the FAIR (Findable Accessible Interoperable Reusable) principles, and strives to implement them across all deliverables and activities. Learn more: incf.org neuroinformatics2019.org 2 Welcome Welcome to the 12th INCF Congress in Warsaw! It makes me very happy that a decade after the 2nd INCF Congress in Plzen, Czech Republic took place, for the second time in Central Europe, the meeting comes to Warsaw. The global neuroinformatics scenery has changed dramatically over these years. With the European Human Brain Project, the US BRAIN Initiative, Japanese Brain/ MINDS initiative, and many others world-wide, neuroinformatics is alive more than ever, responding to the demands set forth by the modern brain studies.
    [Show full text]
  • PROJECT WEB PORTAL Version 1
    Grant Agreement No.: 871573 Call: H2020-ICT-2019-2 Topic: ICT-30-2019-2020 Type of action: CSA D2.1 PROJECT WEB PORTAL Version 1 Revision: v0.4 Work package WP 2 Task Task 2.1 Due date 29/02/2020 Submission date 09/02/2020 Deliverable lead Martel Version 0.5 Authors Lamprini Kolovou, Margherita Facca (Martel) Reviewers ALL Abstract This consists of a first version of the DEL4ALL web portal, which will be regularly enriched and updated to reflect the planned work and ongoing DEL4ALL activities and other projects’ and initiatives work. Keywords Web portal, website, dissemination, communication, promotion DEL4ALL | D2.1: Project web portal Document Revision History Version Date Description of change List of contributor(s) v0.1 20/02/2020 ToC and main structure Lamprini Kolovou (Martel) v0.2 28/02/2020 First full working document Lamprini Kolovou (Martel) v0.3 03/02/2020 Update based on improvements in the Lamprini Kolovou (Martel) web portal v0.4 05/02/2020 Internal Review Margherita Trestini (Martel) v0.5 08/02/2020 Content improvement Margherita Facca (Martel) v0.5 09/02/2020 Final review Lamprini Kolovou (Martel) DISCLAIMER The information, documentation and figures available in this deliverable are written by the "Digital Enhanced Learning for ALL" (DEL4ALL) project’s consortium under EC grant agreement 871573 and do not necessarily reflect the views of the European Commission. The European Commission is not liable for any use that may be made of the information contained herein. COPYRIGHT NOTICE © 2020 - 2022 DEL4ALL Consortium Project co-funded by the European Commission in the H2020 Programme Nature of the deliverable: DEC Dissemination Level PU Public, fully open, e.g.
    [Show full text]
  • Visual3d Conference 2019
    Visual3D conference 2019 Visualization of 3D/4D models in geosciences, exploration and mining Dept of Earth Sciences, Uppsala University Uppsala, Sweden 1–2 October 2019 Proceedings 18 October 2019 Editor: Tobias C. Kampmann, Luleå University of Technology, Sweden Luleå University of Technology 2019 ISBN (electronic): 978-91-7790-474-8 Content Preface ................................................................................................................................................. 3 Organization ................................................................................................................................................. 4 Organizing committee ..................................................................................................................................... 4 Session chairs ................................................................................................................................................. 4 Session “Education” ............................................................................................................................................. 5 Keynote: Over 10 years of applying VR to mining education, lessons learnt and where to from here.. 6 J. Tibbett AusGeol – The Virtual Library of Australia’s Geology ................................................................................ 7 M. Roach Building digital 3D learning environments to support the teaching in geosciences ............................... 8 T. Junna, S. Silvennoinen, A. Karme, A. Åberg,
    [Show full text]
  • Educational Web Portals
    Educational Web Portals: Guidelines for Selection and Use A guide to help school district administrators assess the quality, usefulness and reliability of commercially provided educational Web portals designed for schools Jennifer Burke What is an educational Web portal? A Web portal is a Web site that allows access to many resources and services, such as instruc- tional materials, lesson plans, news about current events, instant messaging and e-mail, and the ability to conduct controlled searches. Why should school administrators be concerned? Every day companies claim to be “the new center of the classroom community” or “every- thing for K-12 education.” School administrators need to ask key questions before they select commercial Web portals. Each commercial Web portal provides different resources and services, which may include lesson plans, instructional materials, e-mail services, discussion forums, filter- ing services, current news and classroom activities. Administrators need to assess their schools’ needs for a portal and what features will be most useful for teachers, students and parents, and then determine whether resources and services offered by the vendor are appropriate to the schools’ instructional needs and goals. Administrators need to assess the quality and appropriate- ness both of the portal as a whole and of each part of it. Some commercial portal companies claim that what they offer is “free” to schools. Companies that offer “free” portals usually do not charge schools for access to the resources but may have advertisements on the sites or seek information about users. If it is a “pay-for-use” portal, the school needs to determine whether it is worth the cost.
    [Show full text]
  • National Geoportal User Guide
    NATIONAL GEOPORTAL USER GUIDE National Spatial Data Management Division January 2016 TABLE OF CONTENTS GENERAL OVERVIEW ..................................................... 1 ABOUT THIS MANUAL ................................................... 2 ACCESSING THE GEOPORTAL ...................................... 3 ADDING DATA TO THE GEOPORTAL ........................... 5 MANAGING METADATA RECORDS .............................. 10 LAUNCHING THE MAP VIEWER .................................. 12 TERMS AND CONDITIONS OF USE .............................. 13 GENERAL OVERVIEW The National Geoportal enables discovery and use of metadata for geospatial resources and web services. The Geoportal server allows users to catalogue the locations and descriptions of an organization’s metadata resources in a central online web-portal, which is published to the Internet and is also available for users to set up their own local access via Intranet connections. The features of the metadata web portal include: 1. Search 2. Publish 3. Managing standards based resources The National Geoportal1 has been upgraded in order to enhance usability, allow intuitive labelling of datasets for sharing, linking and publishing datasets. The objective is to generate and publish metadata records, allowing for greater access to these records for Government organizations. Spatial information is being used in almost all sectors of the economy including agriculture, forestry, construction as well as public administration, therefore the portal will raise the 1 - All major web browsers are supported, including Google Chrome, Firefox, Safari, and Internet Explorer versions 7 and higher. - Available for use on PCs running Mac or Windows, and mobile devices like iPads, iPhones, and Android pads and phones. 1 GENERAL OVERVIEW | awareness of users and the general public about available geospatial resources. ABOUT THIS MANUAL The purpose of this manual is to assist organizations to manage and publish metadata for geospatial resources so users can discover and connect to those resources online.
    [Show full text]
  • Artificial Intelligence Can Boost Reliability and Speed of Medical
    WHITEPAPER 2021 Artificial Intelligence Can Boost Reliability and Speed of Medical Imaging Analysis in Clinical Trials Artificial Intelligence Can Boost Reliability and Speed of Medical Imaging Analysis in Clinical Trials Pharmaceutical firms face many challenges in bringing their products through clinical trials — from enrollment delays to data quality issues — and every advantage can make a difference. In image analysis, sponsors can gain a critical advantage by leveraging artificial intelligence (AI) or machine learning (ML) — computer solutions that mimic human intelligence and are continually enhanced and updated to become more accurate as they take in more data. One subset of machine learning, known as deep learning or convoluted neural networks, These benefits are offers high accuracy in image recognition and has applications for medical particularly pronounced 1,2 image analysis and interpretation. For example, in liver and spleen for medical imaging volume measurement, AI and ML allow rapid and efficient assessment of every slice of an image series.3 They also can aid in more accurate in clinical trials, identification, classification and measurement of tumors.4 where eligibility decisions and efficacy evaluations These benefits are particularly pronounced for medical imaging in clinical can be accelerated, trials, where eligibility decisions and efficacy evaluations can be accelerated, and data accuracy and quality improved. AI can reduce and data accuracy and variability in imaging endpoints, enhance the reliability of those endpoints quality improved. for use in statistical models of efficacy and safety, and reduce the cost of providing quantitative endpoints for a trial.5 In the fast-paced clinical trial arena, time is crucial as sponsors aim to get their product candidates in front of regulators before the competition.
    [Show full text]
  • D5.8.2 (D35.2, D41)
    CD191220 SP5 Neuroinformatics Platform - Results for SGA2 Year 2: (D5.8.2 – SGA2) Figure 1: Neuroinformatics Platform services available through the new EBRAINS web portal The Neuroinformatics Platform provides an infrastructure for neuroscientists who wish to collaboratively curate, analyse, share, and re-use large-scale neuroscience data, ultimately contributing to making research data more Findable, Accessible, Interoperable and Reusable (FAIR). Go to https://ebrains.eu/ to see more about data sharing, brain atlases, and services from other HBP platforms. D5.8.2 (D35.2 D41) SGA2 M24 ACCEPTED 201005.docx PU = Public 15-Oct-2020 Page 1 / 48 Project Number: 785907 Project Title: Human Brain Project SGA2 Document Title: SP5 Neuroinformatics Platform - Results for SGA2 Year 2 Document Filename: D5.8.2 (D35.2 D41) SGA2 M24 ACCEPTED 201005.docx Deliverable Number: SGA2 D5.8.2 (D35.2, D41) Deliverable Type: Report Work Packages: WP5.1, WP5.2, WP5.3, WP5.4, WP5.5, WP5.6, WP5.7, WP5.8, WP5.9, WP5.10 Key Result(s): KR5.1, KR5.3, KR5.4, KR5.6, KR5.7, KR5.8, KR5.9, KR5.11, KR5.12, KR5.14 Dissemination Level: PU = Public Planned Delivery Date: SGA2 M24 / 31 Mar 2020 Actual Delivery Date: SGA2 M26 / 06 May 2020; resubmitted 31 Aug 2020; accepted 5 Oct 2020 Author(s): Jan BJAALIE, UIO (P81) Roman VOLCHENKOV, Martha Elisabeth BRIGG and Sofia ANDERHOLM STRAND, UIO Compiled by: (P81) Ida AASEBØ, UIO (P81), KR5.1 Mathew ABRAMS, KI (P37), KR5.1 & KR5.14 Trygve LEERGAARD, UIO (P81), KR5.1, KR5.4 & KR5.14 Maja PUCHADES, UIO (P81), KR5.3, KR5.4 Lyuba ZEHL,
    [Show full text]
  • Microsoft's Internet Exploration: Predatory Or Competitive?
    MICROSOFT'S INTERNET EXPLORATION: PREDATORY OR COMPETITNE? Thomas W Hazlettt In May 1998 the U.S. Department of Justice ("DOJ") accused Microsoft of violatirtg the Sherman Antitrust Act by vigorously compet­ ing against Netscape's Navigator software with Microsoft's rival browser, Internet Explorer. The substance of the allegation revolves around defensive actions taken by Microsoft to protect the dominant po­ sition enjoyed by Microsoft's Windows operating system. The DOJ' s theory is that, were it not for Microsoft's overly aggressive reaction to Netscape, Navigator software would have been more broadly distributed, thus enabling competition to Windows. This competition would have come directly from Java, a computer language developed by Sun Microsystems and embedded in Netscape software, allowing applications to run on any underlying operating system. Fearing the spread of Java would render a Windows monopoly moot, the DOJ argues, Microsoft engaged in predatory behavior to pre-empt Netscape and, therefore, Java. This set of allegations can most usefully be analyzed under a four-part test for predation examining opportunity, intent, conduct, and effect. The analysis hereunder shows that while Microsoft's aggressive actions have likely injured specific competitors, the "browser jihad" featured as Ex­ hibit A in the DOJ' s antitrust case is a dramatic illustration of the pro­ consumer consequences of robust market rivalry. I. THE GOVERNMENT'S CASE: PREDATION "To protect its valuable Windows monopoly against such potential competitive threats [from Netscape and other new software products], and to extend its operating system monopoly into other software markets, Microsoft has engaged in a series of anticompetitive activities.
    [Show full text]
  • The Role of Web Services in Portal Design: Approaches for an Algerian University Library
    Brigham Young University BYU ScholarsArchive Faculty Publications 2009-09-15 The Role of Web Services in Portal Design: Approaches for an Algerian University Library Mohamed Ridda Laouar University of Tébessa, Algeria, [email protected] Richard Hacken [email protected] Mathew Miles Brigham Young University - Idaho, [email protected] Follow this and additional works at: https://scholarsarchive.byu.edu/facpub Part of the Library and Information Science Commons BYU ScholarsArchive Citation Laouar, Mohamed Ridda; Hacken, Richard; and Miles, Mathew, "The Role of Web Services in Portal Design: Approaches for an Algerian University Library" (2009). Faculty Publications. 1577. https://scholarsarchive.byu.edu/facpub/1577 This Peer-Reviewed Article is brought to you for free and open access by BYU ScholarsArchive. It has been accepted for inclusion in Faculty Publications by an authorized administrator of BYU ScholarsArchive. For more information, please contact [email protected], [email protected]. The Role of Web Services in Portal Design: Approaches for an Algerian University Library Whoever first thought of using a networked computer as a scholarly workstation to which (and from which) information might flow freely may well have been a librarian, at least in the honorary sense. But the dream of such a data nexus – along with all the tools of connectivity, discovery and documentation a scholar is likely to need – has been developing in steps, piecemeal, and is still not yet fully realized. The need to establish an academic information portal for our university library led us to study the literature of documentation and design principles for existing portals as a means of choosing best practices that would fit our situation.
    [Show full text]