DOCSLIB.ORG

Database Management As a Cloud-Based Service for Small and Medium Organizations

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Database Management As a Cloud-Based Service for Small and Medium Organizations Masaryk University Faculty of Informatics Master Thesis Database management as a cloud-based service for small and medium organizations Student: Dime Dimovski Brno, 2013 Statement I declare that I have worked on this thesis independently using only the sources listed in the bibliography. All resources, sources, and literature, which I used in preparing or I drew on them, I quote in the thesis properly with stating the full reference to the source. Dime Dimovski 2 Resume The goal of this thesis is to explore the cloud computing, manly focusing on database management systems as a cloud service. It will give review of some of current available solutions of SQL and NOSQL based database management systems as a cloud service; advantages and disadvantages of the cloud computing in general and the common considerations. Keywords Cloud computing, SaaS, PaaS, Database management, SQL, NOSQL, DBaaS, Database.com, SQL Azure, Amazon Web Services, SimpleDB, DynamoDB, Google SQL, MongoDB, CouchDB, Google Datastore. 3 Contents 1. Introduction .................................................................................................................................... 8 2. Introduction to Cloud Computing ................................................................................................... 9 2.1 Cloud computing – definition ........................................................................................................ 9 2.2 Cloud Types .................................................................................................................................. 10 2.2.1 NIST model ............................................................................................................................... 10 2.3 Cloud computing architecture ..................................................................................................... 12 2.3.1 Infrastructure ....................................................................................................................... 13 2.3.2 Platform ............................................................................................................................... 14 2.3.3 Application Platform as a Service (APaaS ) or Virtual appliances ........................................ 15 2.3.4 Application ........................................................................................................................... 16 3. Scalability ...................................................................................................................................... 17 4. Elasticity ........................................................................................................................................ 18 5. Database Management Systems in the cloud (Database as a service) ......................................... 19 6. Database.com ............................................................................................................................... 21 6.1 Database.com Architecture ......................................................................................................... 21 6.2 Multitenant data model ............................................................................................................... 22 6.3 Multitenant indexes ..................................................................................................................... 23 6.4 Multitenant relationships ............................................................................................................ 23 6.5 Multitenant field history .............................................................................................................. 23 6.6 Partitioning of metadata, data, and index data ........................................................................... 23 6.7 Application development ............................................................................................................ 24 6.8 Data Access .................................................................................................................................. 24 6.9 Query languages .......................................................................................................................... 25 6.10 Multitenant search processing .................................................................................................... 25 4 6.11 Multitenant isolation and protection .......................................................................................... 26 6.12 Deletes, undeletes ....................................................................................................................... 27 6.13 Backup.......................................................................................................................................... 27 6.14 Pricing .......................................................................................................................................... 27 7. Microsoft’s SQL AZURE ................................................................................................................. 28 7.1 Subscriptions ................................................................................................................................ 28 7.2 Databases ..................................................................................................................................... 28 7.3 Security and Access to a SQL Azure Database ............................................................................. 29 7.4 SQL Azure architecture ................................................................................................................ 29 7.5 Logical Databases on a SQL Azure Server .................................................................................... 29 7.6 Network Topology ........................................................................................................................ 31 7.7 High Availability with SQL Azure .................................................................................................. 33 7.8 Failure Detection .......................................................................................................................... 33 7.9 Reconfiguration............................................................................................................................ 33 7.10 Availability Guarantees ................................................................................................................ 34 7.11 Scalability with SQL Azure ............................................................................................................ 34 7.12 Throttling ..................................................................................................................................... 34 7.13 Load Balancer ............................................................................................................................... 35 7.14 SQL Azure Management .............................................................................................................. 35 7.15 Pricing in SQL Azure ..................................................................................................................... 35 8. Amazon WebServices .................................................................................................................... 37 8.1 Amazon Relational Database Service (Amazon RDS) ................................................................... 37 8.2 Amazon RDS Architecture/Features ............................................................................................ 37 8.3 Scalability with Amazon RDS ........................................................................................................ 38 8.4 High Availability ........................................................................................................................... 39 8.5 Pricing .......................................................................................................................................... 39 9. Google Cloud SQL ......................................................................................................................... 40 5 9.1 Pricing .......................................................................................................................................... 41 10. Summary of RDBMSaaS and common considerations ................................................................. 42 11. NOSQL ........................................................................................................................................... 45 12. Amazon SimpleDB and DynamoDB............................................................................................... 45 12.1 Dynamo History ........................................................................................................................... 45 12.2 Amazon DynamoDB DataModel .................................................................................................. 46 12.3 Amazon DynamoDB Features ...................................................................................................... 48 12.4 Amazon SimpleDB ........................................................................................................................ 49 12.5 Pricing .......................................................................................................................................... 51 13. Google Datastore
Load more

Recommended publications
  • Oracle Metadata Management V12.2.1.3.0 New Features Overview
    An Oracle White Paper October 12 th , 2018 Oracle Metadata Management v12.2.1.3.0 New Features Overview Oracle Metadata Management version 12.2.1.3.0 – October 12 th , 2018 New Features Overview Disclaimer This document is for informational purposes. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described in this document remains at the sole discretion of Oracle. This document in any form, software or printed matter, contains proprietary information that is the exclusive property of Oracle. This document and information contained herein may not be disclosed, copied, reproduced, or distributed to anyone outside Oracle without prior written consent of Oracle. This document is not part of your license agreement nor can it be incorporated into any contractual agreement with Oracle or its subsidiaries or affiliates. 1 Oracle Metadata Management version 12.2.1.3.0 – October 12 th , 2018 New Features Overview Table of Contents Executive Overview ............................................................................ 3 Oracle Metadata Management 12.2.1.3.0 .......................................... 4 METADATA MANAGER VS METADATA EXPLORER UI .............. 4 METADATA HOME PAGES ........................................................... 5 METADATA QUICK ACCESS ........................................................ 6 METADATA REPORTING .............................................................
    [Show full text]
  • Oracle Database on AWS October 2013
    Amazon Web Services – RDBMS in the Cloud: Oracle Database on AWS October 2013 RDBMS in the Cloud: Oracle Database on AWS Jean-Pierre Le Goaller, Carlos Conde, and Shakil Langha October 2013 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 33 Amazon Web Services – RDBMS in the Cloud: Oracle Database on AWS October 2013 Table of Contents Abstract ................................................................................................................................................................................... 3 Oracle Database Solutions on AWS ........................................................................................................................................ 3 Oracle Database on Amazon RDS ....................................................................................................................................... 3 Oracle Database on Amazon EC2 ........................................................................................................................................ 3 Other Database Scenarios ................................................................................................................................................... 3 Choosing between Amazon RDS and Amazon EC2 for an Oracle Database ........................................................................... 4 Oracle Database Feature Comparison between Amazon RDS and Amazon EC2 ............................................................... 5 Oracle Licensing and
    [Show full text]
  • Website Hosting Amazon Web Services
    Website Hosting Amazon Web Services Arpit Ahuja, Principal Consultant [email protected] Why to host your website on AWS Website on Amazon Web Service Low Scalable Flexible Cost Stable About Amazon Web Services • World’s leading Cloud Computing Platform • Collection of Remote Computing Services (Web Services) • Powered by Amazon.com – World’s leading Ecommerce Portal • Currently have Data Centers in 10 Geographic locations • Multiple Availability Zones in each region • Edge locations for content distribution in many other geographies • Have done 42 Price Reductions in the last 8 years (Launched in 2006) • More than a Use Cases • Public Website • A company’s website is one of its most visible, accessible, and valuable ways of communicating with current and potential customers. Putting your website on the AWS cloud is fast, easy, and low-cost. • Online Application • Connected applications underpin the modern Internet. Amazon Web Services provides the services you need to make your application successful online. • Intranet Site • Internal websites help share information within your organization and aid collaboration while keeping the information protected from those outside your organization. • Connected Mobile Application • Many mobile applications rely on servers behind the scenes to deliver the information that makes them useful. Many of the world’s biggest sites uses AWS Capabilities • AWS is a flexible cloud computing solution. You can use whatever platform you like. AWS even provides SDKs for many popular platforms like Java, Ruby, PHP, Node.js, .Net, and more. Use Your Favorite Tools • Your content management system (CMS) may be the core of your website. No matter which system you choose; it can run on AWS Let your website grow and shrink with demand • Website traffic can fluctuate a lot.
    [Show full text]
  • Apache Log4j 2 V
    ...................................................................................................................................... Apache Log4j 2 v. 2.4.1 User's Guide ...................................................................................................................................... The Apache Software Foundation 2015-10-08 T a b l e o f C o n t e n t s i Table of Contents ....................................................................................................................................... 1. Table of Contents . i 2. Introduction . 1 3. Architecture . 3 4. Log4j 1.x Migration . 10 5. API . 16 6. Configuration . 19 7. Web Applications and JSPs . 50 8. Plugins . 58 9. Lookups . 62 10. Appenders . 70 11. Layouts . 128 12. Filters . 154 13. Async Loggers . 167 14. JMX . 181 15. Logging Separation . 188 16. Extending Log4j . 190 17. Programmatic Log4j Configuration . 198 18. Custom Log Levels . 204 © 2 0 1 5 , T h e A p a c h e S o f t w a r e F o u n d a t i o n • A L L R I G H T S R E S E R V E D . T a b l e o f C o n t e n t s ii © 2 0 1 5 , T h e A p a c h e S o f t w a r e F o u n d a t i o n • A L L R I G H T S R E S E R V E D . 1 I n t r o d u c t i o n 1 1 Introduction ....................................................................................................................................... 1.1 Welcome to Log4j 2! 1.1.1 Introduction Almost every large application includes its own logging or tracing API. In conformance with this rule, the E.U.
    [Show full text]
  • Creating Smart Virtual Appliances with IBM Image Construction and Composition Tool
    Front cover Creating Smart Virtual Appliances with IBM Image Construction and Composition Tool Create smart appliances that are cloud-ready Develop PowerVM, KVM, and ESX customized virtual appliances Learn from experts how to cloudify your applications Jarek Miszczyk Greg Hurlebaus Pat Nickel Rashed Ferdous David Peraza John Jacobson Moises Romo Li-Fang Lee Kerry Staples ibm.com/redbooks International Technical Support Organization Creating Smart Virtual Appliances with IBM Image Construction and Composition Tool July 2013 SG24-8042-01 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. Second Edition (July 2013) This edition applies to Version 2, Release 2, Modification 1.1 of the IBM Image Construction and Composition Tool. © Copyright International Business Machines Corporation 2012, 2013. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . .x Preface . xi Authors. xi Now you can become a published author, too! . xiii Comments welcome. xiii Stay connected to IBM Redbooks . xiv Chapter 1. Introduction to virtual appliance construction . 1 1.1 Deploying your applications into the cloud . 2 1.2 Solving the terminology puzzle . 3 1.3 Why implement software virtual appliances . 4 1.4 A need for a virtual appliance construction tool . 5 1.4.1 Application packaging options . 5 1.4.2 Supported deployment options . 5 1.5 Putting the Image Construction and Composition Tool into context . 7 1.5.1 Image Construction and Composition Tool and the IBM PureSystems . 7 1.5.2 Image Construction and Composition Tool and the IBM Workload Deployer.
    [Show full text]
  • Amazon Dynamodb
    Dynamo Amazon DynamoDB Nicolas Travers Inspiré de Advait Deo Vertigo N. Travers ESILV : Dynamo Amazon DynamoDB – What is it ? • Fully managed nosql database service on AWS • Data model in the form of tables • Data stored in the form of items (name – value attributes) • Automatic scaling ▫ Provisioned throughput ▫ Storage scaling ▫ Distributed architecture • Easy Administration • Monitoring of tables using CloudWatch • Integration with EMR (Elastic MapReduce) ▫ Analyze data and store in S3 Vertigo N. Travers ESILV : Dynamo Amazon DynamoDB – What is it ? key=value key=value key=value key=value Table Item (64KB max) Attributes • Primary key (mandatory for every table) ▫ Hash or Hash + Range • Data model in the form of tables • Data stored in the form of items (name – value attributes) • Secondary Indexes for improved performance ▫ Local secondary index ▫ Global secondary index • Scalar data type (number, string etc) or multi-valued data type (sets) Vertigo N. Travers ESILV : Dynamo DynamoDB Architecture • True distributed architecture • Data is spread across hundreds of servers called storage nodes • Hundreds of servers form a cluster in the form of a “ring” • Client application can connect using one of the two approaches ▫ Routing using a load balancer ▫ Client-library that reflects Dynamo’s partitioning scheme and can determine the storage host to connect • Advantage of load balancer – no need for dynamo specific code in client application • Advantage of client-library – saves 1 network hop to load balancer • Synchronous replication is not achievable for high availability and scalability requirement at amazon • DynamoDB is designed to be “always writable” storage solution • Allows multiple versions of data on multiple storage nodes • Conflict resolution happens while reads and NOT during writes ▫ Syntactic conflict resolution ▫ Symantec conflict resolution Vertigo N.
    [Show full text]
  • Best Practices for Building Virtual Appliances Vmware White Paper
    WHITE PAPER Best Practices for Building Virtual Appliances VMWARE WHITE PAPER Table of Contents Objectives. 3 Design Principles . 3 Completely Encapsulated. 3 Optimized Virtual Disk and Operating System. 4 Initial Configuration. 4 ‘Standard’ Components. 5 Command Line Interface . 5 SSH Support. 5 Web Management Interface . 5 External Management . 5 Virtual Machine Configuration. 6 Updates and Ongoing Maintenance. 6 Packaging and Publishing . 6 2 VMWARE WHITE PAPER Best Practices for Building Virtual Appliances A virtual appliance is a pre-installed, pre-configured operating system and software solution delivered inside a virtual machine. 60-70% of support calls relate to initial installation and Deploying a software solution as a virtual appliance enables you configuration of a software application to build a complete turnkey package that customers are able to download and immediately deploy. Thus, customers skip the time-consuming and often support-intensive task of installing and configuring the appliance. This lets customers focus all their energies on trying or using your solution rather than struggling Design Principles to get it to run. Completely Encapsulated This document describes the best practices for building a virtual A virtual appliance contains all of the components required to appliance. It covers high level design principles as well as low run your solution on top of a virtualization layer. Since virtual level details for building virtual appliances ready for certification appliances are designed to run a specific solution, customers under the VMware Certified Virtual Appliance program. In turn, should not need root access to the operating system inside virtual appliances built according to these standards will allow your appliance.
    [Show full text]
  • Performance at Scale with Amazon Elasticache
    Performance at Scale with Amazon ElastiCache July 2019 Notices Customers are responsible for making their own independent assessment of the information in this document. This document: (a) is for informational purposes only, (b) represents current AWS product offerings and practices, which are subject to change without notice, and (c) does not create any commitments or assurances from AWS and its affiliates, suppliers or licensors. AWS products or services are provided “as is” without warranties, representations, or conditions of any kind, whether express or implied. The responsibilities and liabilities of AWS to its customers are controlled by AWS agreements, and this document is not part of, nor does it modify, any agreement between AWS and its customers. © 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction .......................................................................................................................... 1 ElastiCache Overview ......................................................................................................... 2 Alternatives to ElastiCache ................................................................................................. 2 Memcached vs. Redis ......................................................................................................... 3 ElastiCache for Memcached ............................................................................................... 5 Architecture with ElastiCache for Memcached ...............................................................
    [Show full text]
  • Reproducibility, Virtual Appliances, and Cloud Computing
    1 Reproducibility, Virtual Appliances, and Cloud Computing Bill Howe University of Washington CONTENTS 1.1 Introduction ...................................................... 1 1.2 Background on Cloud Computing and Virtualization ........... 2 1.3 Related Approaches and Examples .............................. 3 1.3.1 Other Uses of Virtual Machines ......................... 5 1.3.2 Towards Services Instead of Artifacts ................... 6 1.4 How Cloud Computing can Improve Reproducibility ........... 6 1.4.1 Capturing More Variables ............................... 6 1.4.2 Fewer constraints on research methods ................. 6 1.4.3 On-Demand Backups .................................... 7 1.4.4 Virtual Machines as Citable Publications ............... 7 1.4.5 Code, Data, Environment, plus Resources .............. 7 1.4.6 Automatic Upgrades ..................................... 8 1.4.7 Competitive, Elastic Pricing ............................ 8 1.4.8 Reproducibility for Complex Architectures. ............. 8 1.4.9 Unfettered Collaborative Experiments .................. 8 1.4.10 Data-intensive Computing ............................... 9 1.4.11 Cost Sharing ............................................. 9 1.4.12 A Foundation for Single-Payer Funding ................. 9 1.4.13 Compatibility with Other Approaches .................. 9 1.5 Remaining Challenges ............................................ 10 1.5.1 Cost ...................................................... 10 1.5.2 Culture ..................................................
    [Show full text]
  • Chainsys-Platform-Technical Architecture-Bots
    Technical Architecture Objectives ChainSys’ Smart Data Platform enables the business to achieve these critical needs. 1. Empower the organization to be data-driven 2. All your data management problems solved 3. World class innovation at an accessible price Subash Chandar Elango Chief Product Officer ChainSys Corporation Subash's expertise in the data management sphere is unparalleled. As the creative & technical brain behind ChainSys' products, no problem is too big for Subash, and he has been part of hundreds of data projects worldwide. Introduction This document describes the Technical Architecture of the Chainsys Platform Purpose The purpose of this Technical Architecture is to define the technologies, products, and techniques necessary to develop and support the system and to ensure that the system components are compatible and comply with the enterprise-wide standards and direction defined by the Agency. Scope The document's scope is to identify and explain the advantages and risks inherent in this Technical Architecture. This document is not intended to address the installation and configuration details of the actual implementation. Installation and configuration details are provided in technology guides produced during the project. Audience The intended audience for this document is Project Stakeholders, technical architects, and deployment architects The system's overall architecture goals are to provide a highly available, scalable, & flexible data management platform Architecture Goals A key Architectural goal is to leverage industry best practices to design and develop a scalable, enterprise-wide J2EE application and follow the industry-standard development guidelines. All aspects of Security must be developed and built within the application and be based on Best Practices.
    [Show full text]
  • Amazon Documentdb Deep Dive
    DAT326 Amazon DocumentDB deep dive Joseph Idziorek Antra Grover Principal Product Manager Software Development Engineer Amazon Web Services Fulfillment By Amazon © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Agenda What is the purpose of a document database? What customer problems does Amazon DocumentDB (with MongoDB compatibility) solve and how? Customer use case and learnings: Fulfillment by Amazon What did we deliver for customers this year? What’s next? © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Purpose-built databases Relational Key value Document In-memory Graph Search Time series Ledger Why document databases? Denormalized data Normalized data model model { 'name': 'Bat City Gelato', 'price': '$', 'rating': 5.0, 'review_count': 46, 'categories': ['gelato', 'ice cream'], 'location': { 'address': '6301 W Parmer Ln', 'city': 'Austin', 'country': 'US', 'state': 'TX', 'zip_code': '78729'} } Why document databases? GET https://api.yelp.com/v3/businesses/{id} { 'name': 'Bat City Gelato', 'price': '$', 'rating': 5.0, 'review_count': 46, 'categories': ['gelato', 'ice cream'], 'location': { 'address': '6301 W Parmer Ln', 'city': 'Austin', 'country': 'US', 'state': 'TX', 'zip_code': '78729'} } Why document databases? response = yelp_api.search_query(term='ice cream', location='austin, tx', sort_by='rating', limit=5) Why document databases? for i in response['businesses']: col.insert_one(i) db.businesses.aggregate([ { $group: { _id: "$price", ratingAvg: { $avg: "$rating"}} } ]) db.businesses.find({
    [Show full text]
  • A Motion Is Requested to Authorize the Execution of a Contract for Amazon Business Procurement Services Through the U.S. Communities Government Purchasing Alliance
    MOT 2019-8118 Page 1 of 98 VILLAGE OF DOWNERS GROVE Report for the Village Council Meeting 3/19/2019 SUBJECT: SUBMITTED BY: Authorization of a contract for Amazon Business procurement Judy Buttny services Finance Director SYNOPSIS A motion is requested to authorize the execution of a contract for Amazon Business procurement services through the U.S. Communities Government Purchasing Alliance. STRATEGIC PLAN ALIGNMENT The goals for 2017-2019 includes Steward of Financial Sustainability, and Exceptional, Continual Innovation. FISCAL IMPACT There is no cost to utilize Amazon Business procurement services through the U.S. Communities Government Purchasing Alliance. RECOMMENDATION Approval on the March 19, 2019 Consent Agenda. BACKGROUND U.S. Communities Government Purchasing Alliance is the largest public sector cooperative purchasing organization in the nation. All contracts are awarded by a governmental entity utilizing industry best practices, processes and procedures. The Village of Downers Grove has been a member of the U.S. Communities Government Purchasing Alliance since 2008. Through cooperative purchasing, the Village is able to take advantage of economy of scale and reduce the cost of goods and services. U.S. Communities has partnered with Amazon Services to offer local government agencies the ability to utilize Amazon Business for procurement services at no cost to U.S. Communities members. Amazon Business offers business-only prices on millions of products in a competitive digital market place and a multi-level approval workflow. Staff can efficiently find quotes and purchase products for the best possible price, and the multi-level approval workflow ensures this service is compliant with the Village’s competitive process for purchases under $7,000.
    [Show full text]