A Citizen-Centric and Multi-Curator Document Automation Platform: the Qbox and Further Interoperability Aspects

Total Page:16

File Type:pdf, Size:1020Kb

A Citizen-Centric and Multi-Curator Document Automation Platform: the Qbox and Further Interoperability Aspects A Citizen-Centric and Multi-Curator Document Automation Platform: The qBox and Further Interoperability Aspects Daniel Jose´ Matias Caramujo Thesis to obtain the Master of Science Degree in Information Systems and Computer Engineering Supervisors: Prof. Doutor Alberto Manuel Rodrigues da Silva Prof. Doutor Joao˜ Paulo Pedro Mendes de Sousa Saraiva Examination Committee Chairperson: Prof. Doutor Francisco Joao˜ Duarte Cordeiro Correia dos Santos Supervisor: Prof. Doutor Alberto Manuel Rodrigues da Silva Member of the Committee: Prof. Doutor Andre´ Ferreira Ferrao˜ Couto e Vasconcelos October 2019 Acknowledgments I would like to thank my parents and family for their support and encouragement over all these years, without whom this this project would not be possible. I would also like to acknowledge my dissertation supervisors Prof. Doutor Alberto Silva and Prof. Doutor Joao˜ Saraiva for their insight, support and sharing of knowledge that has made this Thesis possible. Last but not least, to all my friends and colleagues that helped me grow as a person and were always there for me. To each and every one of you, thank you. Abstract Interoperability is an important aspect of complex information systems that have to interact and integrate with a multitude of other systems and services. New interoperability norms and frameworks are being promoted, and in this thesis we discuss some of them in the scope of eGovernment and document automation systems. This thesis explores integration aspects of qDocs, a citizen-centric document automation platform. qDocs aims to make bureaucratic documents (e.g., ID cards, forms, certificates) easily curated by multiple organizations and easily available to citizens. A key challenge of the proposal that is the foundation of this thesis is the correct integration of these organizations’ systems with the qDocs because they have to collect/provide data from/to the documents. The solution presented in this thesis is named as qBox, which is a software component to be deployed at each organization’s environment that supports both interoperability and security requirements. It was designed with a strong focus on document datasets and their specifications, to be developed as an independent module called qBox and integrated with the qDocs platform. The integration evaluation based itself on three tests to analyse its capabilities, namely the qBox module connection to the qDocs platform, the document request and approval process and the ability to change dataset configurations. The evaluation yield positive results that allow to conclude that the qBox works as a proof of concept and the qDocs is ready for basic curator integration via the qBox. Keywords E-Government; Interoperability; Public Administration; Document Automation. iii Resumo A interoperabilidade e´ um aspecto importante dos sistemas de informac¸ao˜ complexos que precisam de interagir e ser integrados com uma infinidade de outros sistemas e servic¸os. Novas normas de interop- erabilidade e estruturas estao˜ a ser promovidas, e nesta tese discutimos algumas delas no ambitoˆ dos sistemas de eGovernment e de automac¸ao˜ de documentos. Esta tese explora aspectos de integrac¸ao˜ do qDocs, uma plataforma de automac¸ao˜ de documentos centrada no cidadao.˜ qDocs tem como obje- tivo disponibilizar uma facil´ gestao˜ de documentos burocraticos´ (por exemplo, cartoes˜ de identificac¸ao,˜ formularios,´ certificados) por varias´ organizac¸oes˜ e facilmente dispon´ıvel para os cidadaos.˜ Um dos principais desafios da proposta que e´ a base desta tese e´ a correta integrac¸ao˜ dos sistemas dessas organizac¸oes˜ com o qDocs porque eles precisam recolher/fornecer dados de/para os documentos. A soluc¸ao˜ apresentada, desenvolvida e avaliada nesta tese e´ denominada qBox, que e´ uma componente de software a ser integrado no ambiente de cada organizac¸ao,˜ que suporta tanto os requisitos de inter- operabilidade como de seguranc¸a. A qBox foi projetada com um forte foco em conjuntos de dados de documentos e as suas especificac¸oes,˜ para ser desenvolvido como um modulo´ independente chamado qBox e integrado com a plataforma qDocs. A avaliac¸ao˜ da integrac¸ao˜ baseou-se em tresˆ testes para analisar as suas capacidades, nomeadamente a conexao˜ do modulo´ qBox a` plataforma qDocs, o pro- cesso de pedido e aprovac¸ao˜ de documentos e a capacidade de alterar as configurac¸oes˜ do conjunto de dados. A avaliac¸ao˜ obteve resultados positivos que permitem concluir que o qBox funciona como uma prova de conceito e o qDocs esta´ pronto para uma integrac¸ao˜ basica´ do curador atraves´ do qBox. Palavras Chave E-Government; Interoperabilidade; Administrac¸ao˜ Publica;´ Automac¸ao˜ de Documentos. v Contents 1 Introduction 1 1.1 Motivation.............................................3 1.2 qDocs...............................................4 1.3 Problem..............................................4 1.4 Proposal..............................................4 1.5 Research Methodology.....................................5 1.6 Dissertation Structure......................................5 2 Related Work 7 2.1 E-Government..........................................9 2.2 ISA2 ................................................ 10 2.3 Document Automation...................................... 11 3 Development Tools and Environment 15 3.1 Development Environment.................................... 17 3.2 Development Technologies................................... 18 3.2.1 IdentityServer4...................................... 18 3.2.2 SPA............................................ 19 3.2.3 Web API......................................... 19 3.2.4 ASP.NET Core...................................... 19 3.2.5 Angular.......................................... 20 4 qDocs Overview 21 4.1 General Architecture....................................... 23 4.2 Security.............................................. 24 4.2.1 Privacy.......................................... 24 4.2.2 Confidentiality...................................... 25 4.2.3 Authentication and Authorization............................ 26 4.3 Document Evaluation Process................................. 26 4.3.1 Document Request.................................... 26 vii 4.3.2 Document Request Approval.............................. 27 4.3.3 Document Consultation................................. 28 5 qBox Design and Development 31 5.1 qBox Architecture......................................... 33 5.2 qBox Domain Model....................................... 34 5.3 Development Process...................................... 35 5.4 qBox Solution Implementation.................................. 37 5.4.1 qBox Development.................................... 37 5.4.1.A qBox/Citizen.................................. 38 5.4.1.B qBox/Curator.................................. 39 5.4.1.C qBox/Curator Data Manager......................... 40 5.4.1.D qBox/qBox................................... 40 5.4.2 qDocs - qBox Integration................................ 40 6 Evaluation 43 6.1 qBox Connection......................................... 45 6.1.1 Services Configuration (Curator Data Manager).................... 45 6.1.2 Templates Configuration (Curator Templates Editor)................. 47 6.2 Document Request and Approval................................ 48 6.2.1 Document Request (Citizen).............................. 48 6.2.2 Document Approval (Curator Templates Manager).................. 49 6.2.3 Document Consult (Citizen)............................... 50 6.3 Changing Dataset Configurations................................ 52 6.3.1 Creating new Document Specification......................... 53 6.3.2 Adding Attributes to Existing Document Specification................. 53 7 Conclusion and Future Work 55 7.1 Conclusion............................................ 57 7.2 Future Work............................................ 58 A qBox API Documentation 63 viii List of Figures 4.1 qDocs general architecture model (archimate diagram) - adapted from [1].......... 24 4.2 Example of the multiple roles a citizen entity can have - adapted from [1].......... 25 4.3 qDocs BPMN model demonstrating the alignment of the processes............. 26 4.4 qDocs and qBox interactions on for the task “Request/Create New Document” (repre- sented in BPMN).......................................... 27 4.5 Example of qDocs and qBox interaction on for a Curator Document Approval, represented in BPMN.............................................. 28 4.6 Example of qDocs and qBox interaction on for a Citizen Document Access, represented in BPMN.............................................. 29 5.1 qBox ArchiMate design of interaction.............................. 33 5.2 qBox base Domain Model..................................... 34 5.3 qBox Document State Diagram.................................. 35 5.4 Cumulative Flow Chart from Azure DevOps........................... 36 6.1 Create Service Interface..................................... 46 6.2 View Methods Interface...................................... 46 6.3 Edit Method Interface....................................... 46 6.4 Form Objects Interface...................................... 46 6.5 Edit Form Object Interface.................................... 47 6.6 Form Object Default Value Interface............................... 47 6.7 Edit Template Content Interface................................. 47 6.8 Edit Template Metadata with Associated Output Template Interface............. 47 6.9 Create New Document Save and Submit Interface......................
Recommended publications
  • ΔΙΠΛΩΜΑΤΙΚΗ ΕΡΓΑΣΙΑ Backbone, Angularjs
    ΕΘΝΙΚΟ ΜΕΤΣΟΒΙΟ ΠΟΛΥΤΕΧΝΕΙΟ ΣΧΟΛΗ ΗΛΕΚΤΡΟΛΟΓΩΝ ΜΗΧΑΝΙΚΩΝ ΚΑΙ ΜΗΧΑΝΙΚΩΝ ΥΠΟΛΟΓΙΣΤΩΝ ΤΟΜΕΑΣ ΕΠΙΚΟΙΝΩΝΙΩΝ, ΗΛΕΚΤΡΟΝΙΚΗΣ ΚΑΙ ΣΥΣΤΗΜΑΤΩΝ ΠΛΗΡΟΦΟΡΙΚΗΣ Backbone, AngularJS, Ember: Συγκριτική ανάλυση και σενάρια χρήσης JavaScript frameworks ΔΙΠΛΩΜΑΤΙΚΗ ΕΡΓΑΣΙΑ Χρήστος Παπουτσάκης Επιβλέπων : Θεοδώρα Βαρβαρίγου Καθηγήτρια ΕΜΠ Αθήνα, Οκτώβριος 2017 ΕΘΝΙΚΟ ΜΕΤΣΟΒΙΟ ΠΟΛΥΤΕΧΝΕΙΟ ΣΧΟΛΗ ΗΛΕΚΤΡΟΛΟΓΩΝ ΜΗΧΑΝΙΚΩΝ ΚΑΙ ΜΗΧΑΝΙΚΩΝ ΥΠΟΛΟΓΙΣΤΩΝ ΤΟΜΕΑΣ ΕΠΙΚΟΙΝΩΝΙΩΝ, ΗΛΕΚΤΡΟΝΙΚΗΣ ΚΑΙ ΣΥΣΤΗΜΑΤΩΝ ΠΛΗΡΟΦΟΡΙΚΗΣ Backbone, AngularJS, Ember: Συγκριτική ανάλυση και σενάρια χρήσης JavaScript frameworks ΔΙΠΛΩΜΑΤΙΚΗ ΕΡΓΑΣΙΑ Χρήστος Παπουτσάκης Επιβλέπων : Θεοδώρα Βαρβαρίγου Καθηγήτρια ΕΜΠ Εγκρίθηκε από την τριμελή εξεταστική επιτροπή την 16η Οκτωβρίου 2017. ............................ ............................ ............................ Θεοδώρα Βαρβαρίγου Εμμανουήλ Βαρβαρίγος Δημήτριος Ασκούνης Καθηγήτρια ΕΜΠ Καθηγητής ΕΜΠ Καθηγητής ΕΜΠ Αθήνα, Οκτώβριος 2017 ................................... Χρήστος Παπουτσάκης Διπλωματούχος Ηλεκτρολόγος Μηχανικός και Μηχανικός Υπολογιστών Ε.Μ.Π. Copyright © Χρήστος Παπουτσάκης, 2017 Με επιφύλαξη παντός δικαιώματος. All rights reserved. Απαγορεύεται η αντιγραφή, αποθήκευση και διανομή της παρούσας εργασίας, εξ ολοκλήρου ή τμήματος αυτής, για εμπορικό σκοπό. Επιτρέπεται η ανατύπωση, αποθήκευση και διανομή για σκοπό μη κερδοσκοπικό, εκπαιδευτικής ή ερευνητικής φύσης, υπό την προϋπόθεση να αναφέρεται η πηγή προέλευσης και να διατηρείται το παρόν μήνυμα. Ερωτήματα που αφορούν τη χρήση της εργασίας για κερδοσκοπικό σκοπό πρέπει να απευθύνονται
    [Show full text]
  • Web-Based Wireless Sensor Network Platform
    WEB-BASED WIRELESS SENSOR NETWORK PLATFORM Pérez Cano, José Antonio Academic course 2014-2015 Supervisor: Gabriel Martins BACHELOR’S DEGREE IN AUDIOVISUAL SYSTEMS ENGINEERING Final Degree Project GRAU EN ENGINYERIA EN xxxxxxxxxxxx WEB-BASED WIRELESS SENSOR NETWORK PLATFORM José Antonio Pérez Cano FINAL DEGREE PROJECT Bachelor’s degree in Audiovisual Systems Engineering Polytechnic School – Pompeu Fabra University 2015 Supervisor Gabriel Martins Dias Dedicado a mi familia y amigos. iii Acknowledgement I would like to specially thank my family and friends for supporting me during these recent years of my life, and my supervisors, Toni Adame and Gabriel Martins, for helping me in the development of this project. v Abstract The aim of this project is to design and implement a web-based platform for storing and visualizing the data retrieved by Wireless Sensor Networks (WSNs). This approach is part of the Entomatic project, an European Union (EU) funded plan for addressing a major problem faced by EU Associations of Olive growing Small and Medium-sized Enterprises (SMEs): the Olive fruit fly (Bactrocera oleae). Olive oil trees will feature a series of sensors, mainly consisting of olive fly traps as a way to track its population. Such sensors will output data through a gateway to be finally gathered by the platform proposed in this document. The system presented in this project consists of two parts: (1) a web-server that receives the sensed data and stores them in a database; and (2) a web-application for visualizing the obtained measurements including, among others, map node location, statistics, and charts. Cutting edge web technologies have been used in order to create a modern, yet maintainable and scalable platform.
    [Show full text]
  • Angularjs by Example.Pdf
    www.it-ebooks.info AngularJS by Example Learn AngularJS by creating your own apps, using practical examples which you can use and adapt Chandermani BIRMINGHAM - MUMBAI www.it-ebooks.info AngularJS by Example Copyright © 2015 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First published: March 2015 Production reference: 2030315 Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK. ISBN 978-1-78355-381-5 www.packtpub.com www.it-ebooks.info Credits Author Project Coordinator Chandermani Aboli Ambardekar Reviewers Proofreaders Idan Cohen Ting Baker Ashutosh Das Simran Bhogal Prasanna Gautam Stephen Copestake Ruoyu Sun Jurgen Van de Moere Indexer Priya Sane Commissioning Editor Ed Gordon Graphics Disha Haria Acquisition Editor Rebecca Youé Production Coordinator Conidon Miranda Content Development Editor Sriram Neelakantan Cover Work Conidon Miranda Technical Editors Edwin Moses Shruti Rawool Copy Editors Roshni Banerjee Neha Karnani Merilyn Pereira www.it-ebooks.info About the Author Chandermani is a software craftsman with a passion for technology and is an expert on the web stack.
    [Show full text]
  • Javascript Web Applications
    DIVTAG DEVELOPER MEETUP @ NOV. 12, 2015 JavaScript Web Applications Hiun Kim Computer Science Department, Sejong University Seoul, South Korea <divtag> Computer Research Group We are old, the web as we know.. <divtag> Computer Research Group New Waves of Modern Web <divtag> Computer Research Group <divtag> Computer Research Group Single Page Application Web site that fits on a single web page with the goal of providing a more fuild UX akin to desktop apps - via Wikipedia <divtag> Computer Research Group Single Page Application (cont.) Concepts established circa 2002 (not sure) US Patents 8136109 ( Delivery of data and formatting information to allow client-side manipulation ) <divtag> Computer Research Group Single Page Application (cont.) Provides layout and partial view Every event is related to JavaScript They against the web we know! <divtag> Computer Research Group Enhancing User Experience Proviedes seamless experience through, Reducing round tripping of submission Reducing process of CSS & JavaScript <divtag> Computer Research Group Continuity Page does not reload completely, browser can store state with JavaScript <divtag> Computer Research Group Continuity (cont) Web is not only a document viewer, but data manipulator (Google Spread Sheets) or interactive viewer (Facebook.com ) <divtag> Computer Research Group https://upload.wikimedia.org/wikipedia/commons/c/ce/Bonsack_machine.png Pros Does not require to load whole page, Saving time Seamless user experience <divtag> Computer Research Group http://grannymar.com/wp-content/uploads/2010/03/dscf5587.jpg Cons Not simple, not pure (as definition of today) Often slow for processing Fallback exist but incomplete Sometime impossible <divtag> Computer Research Group Core Mechanism Browser is sandbox JavaScript can manipulate URL and History pushState for creating history <divtag> Computer Research Group Libraries and Frameworks jquery-pjax (pushState + ajax) angularjs ember.js etc.
    [Show full text]