Programmers Guide Sybase Event Stream Processor 5.1 SP01 DOCUMENT ID: DC01612-01-0511-01 LAST REVISED: November 2012 Copyright © 2012 by Sybase, Inc

Total Page:16

File Type:pdf, Size:1020Kb

Programmers Guide Sybase Event Stream Processor 5.1 SP01 DOCUMENT ID: DC01612-01-0511-01 LAST REVISED: November 2012 Copyright © 2012 by Sybase, Inc Programmers Guide Sybase Event Stream Processor 5.1 SP01 DOCUMENT ID: DC01612-01-0511-01 LAST REVISED: November 2012 Copyright © 2012 by Sybase, Inc. All rights reserved. This publication pertains to Sybase software and to any subsequent release until otherwise indicated in new editions or technical notes. Information in this document is subject to change without notice. The software described herein is furnished under a license agreement, and it may be used or copied only in accordance with the terms of that agreement. Upgrades are provided only at regularly scheduled software release dates. No part of this publication may be reproduced, transmitted, or translated in any form or by any means, electronic, mechanical, manual, optical, or otherwise, without the prior written permission of Sybase, Inc. Sybase trademarks can be viewed at the Sybase trademarks page at http://www.sybase.com/detail?id=1011207. Sybase and the marks listed are trademarks of Sybase, Inc. ® indicates registration in the United States of America. SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. Java and all Java-based marks are trademarks or registered trademarks of Oracle and/or its affiliates in the U.S. and other countries. Unicode and the Unicode Logo are registered trademarks of Unicode, Inc. All other company and product names mentioned may be trademarks of the respective companies with which they are associated. Use, duplication, or disclosure by the government is subject to the restrictions set forth in subparagraph (c)(1)(ii) of DFARS 52.227-7013 for the DOD and as set forth in FAR 52.227-19(a)-(d) for civilian agencies. Sybase, Inc., One Sybase Drive, Dublin, CA 94568. Contents CHAPTER 1: Introduction ...............................................1 Data-Flow Programming .......................................................1 Continuous Computation Language ....................................2 SPLASH ..................................................................................3 Authoring Methods ................................................................3 CHAPTER 2: CCL Project Basics ...................................5 Events .....................................................................................5 Operation Codes ....................................................................5 Streams ...................................................................................6 Windows .................................................................................7 Retention ........................................................................7 Named Windows ...........................................................10 Unnamed Windows .......................................................11 Delta Streams .......................................................................12 Comparing Streams, Windows, and Delta Streams .........12 Input/Output/Local ...............................................................13 Implicit Columns ..................................................................15 Schemas ...............................................................................15 Stores ....................................................................................16 CCL Continuous Queries ....................................................17 Adapters ...............................................................................18 Order of Elements ................................................................19 CHAPTER 3: Developing a Project in CCL ..................21 CHAPTER 4: CCL Language Components .................23 Datatypes ..............................................................................23 Programmers Guide iii Contents Intervals ........................................................................26 Operators ..............................................................................27 Expressions .........................................................................31 CCL Comments ....................................................................32 Case-Sensitivity ...................................................................33 CHAPTER 5: CCL Query Construction .......................35 Filtering .................................................................................35 Splitting Up Incoming Data .................................................36 Unions ...................................................................................37 Example: Merging Data from Streams or Windows ......38 Joins .....................................................................................38 Key Field Rules .............................................................40 Join Examples: ANSI Syntax ........................................41 Join Example: Comma-Separated Syntax ....................43 Pattern Matching ..................................................................44 Aggregation ..........................................................................44 CHAPTER 6: Advanced CCL Programming Techniques .................................................................47 Declare Blocks .....................................................................47 Typedefs .......................................................................48 Parameters ...................................................................48 Variables .......................................................................49 Declaring Project Variables, Parameters, Datatypes, and Functions ...........................................................51 Flex Operators .....................................................................52 Modularity .............................................................................52 Module Creation and Usage .........................................53 Example: Creating and Using Modules ........................53 Example: Parameters in Modules .................................54 Data Recovery ......................................................................56 Log Store Optimization Techniques ..............................57 Error Streams .......................................................................57 iv Sybase Event Stream Processor Contents Monitoring Streams for Errors .......................................59 CHAPTER 7: Writing SPLASH Routines .....................61 Internal Pulsing ....................................................................61 Order Book ...........................................................................62 CHAPTER 8: Integrating SPLASH into CCL ................65 Access to the Event .............................................................65 Access to Input Streams .....................................................65 Output Statement .................................................................67 Notes on Transactions ........................................................67 CHAPTER 9: Using SPLASH in Projects .....................69 CHAPTER 10: PowerDesigner for Event Stream Processor ...................................................................73 Getting Started .....................................................................73 Data Modeling Scenarios ............................................. 73 Sample PowerDesigner Project ....................................74 Opening the Sample Project ................................74 Learning More About PowerDesigner ...........................74 Data Model ............................................................................74 ESP Schema Logical Data Model .................................75 Finding an Object in a Diagram ....................................75 Data Model Tables ........................................................75 Extensions ....................................................................77 Category Set ........................................................78 Schema Definitions ..............................................78 Impact and Lineage Analysis ...............................79 Extended Model Setup ........................................................79 Extending an Existing Model ........................................ 79 Setting Up the Model Category Set File .......................80 Programmers Guide v Contents Merging ESP Categories .....................................80 Changing the Default Category ...........................81 Setting Datatypes for an ESP Schema .........................81 ESP Schema Model Development ......................................82 Exploring the Sample Model .........................................82 The Sample Model ........................................................83 Creating an ESP Schema Model ..................................85 Creating a Model Using Categories .....................85 Creating a Logical Data Model ............................85 Adding Schema Definition ...................................86 Defining Schema Properties ................................87 Validating a Model ........................................................90 PowerDesigner Validity Checks ...........................91 Custom Checks for ESP Schema Extensions .....91 Importing a CCL File .....................................................91 Exporting a CCL File ....................................................92 Model Generation ................................................................92
Recommended publications
  • Data Warehouse Logical Modeling and Design
    Data Warehouse 1. Methodological Framework Logical Modeling and Design • Conceptual Design & Logical Design (6) • Design Phases and schemata derivations 2. Logical Modelling: The Multidimensionnal Model Bernard ESPINASSE • Problematic of the Logical Design Professeur à Aix-Marseille Université (AMU) • The Multidimensional Model: fact, measures, dimensions Ecole Polytechnique Universitaire de Marseille 3. Implementing a Dimensional Model in ROLAP • Star schema January, 2020 • Snowflake schema • Aggregates and views 4. Logical Design: From Fact schema to ROLAP Logical schema Methodological framework • From fact schema to relational star-schema: basic rules Logical Modeling: The Multidimensional Model • Examples towards Relational Star Schema • Examples towards Relational Snowflake Schema Logical Design : From Fact schema to ROLAP Logical schema • Advanced logical modelling ROLAP schema in MDX for Mondrian 5. ROLAP schema in MDX for Mondrian Bernard ESPINASSE - Data Warehouse Logical Modelling and Design 1 Bernard ESPINASSE - Data Warehouse Logical Modelling and Design 2 • Livres • Golfarelli M., Rizzi S., « Data Warehouse Design : Modern Principles and Methodologies », McGrawHill, 2009. • Kimball R., Ross, M., « Entrepôts de données : guide pratique de modélisation dimensionnelle », 2°édition, Ed. Vuibert, 2003, ISBN : 2- 7117-4811-1. • Franco J-M., « Le Data Warehouse ». Ed. Eyrolles, Paris, 1997. ISBN 2- 212-08956-2. • Conceptual Design & Logical Design • Cours • Life-Cycle • Course of M. Golfarelli M. and S. Rizzi, University of Bologna
    [Show full text]
  • ENTITY-RELATIONSHIP MODELING of SPATIAL DATA for GEOGRAPHIC INFORMATION SYSTEMS Hugh W
    ENTITY-RELATIONSHIP MODELING OF SPATIAL DATA FOR GEOGRAPHIC INFORMATION SYSTEMS Hugh W. Calkins Department of Geography and National Center for Geographic Information and Analysis, State University of New York at Buffalo Amherst, NY 14261-0023 Abstract This article presents an extension to the basic Entity-Relationship (E-R) database modeling approach for use in designing geographic databases. This extension handles the standard spatial objects found in geographic information systems, multiple representations of the spatial objects, temporal representations, and the traditional coordinate and topological attributes associated with spatial objects and relationships. Spatial operations are also included in this extended E-R modeling approach to represent the instances where relationships between spatial data objects are only implicit in the database but are made explicit through spatial operations. The extended E-R modeling methodology maps directly into a detailed database design and a set of GIS function. 1. Introduction GIS design (planning, design and implementing a geographic information system) consists of several activities: feasibility analysis, requirements determination, conceptual and detailed database design, and hardware and software selection. Over the past several years, GIS analysts have been interested in, and have used, system design techniques adopted from software engineering, including the software life-cycle model which defines the above mentioned system design tasks (Boehm, 1981, 36). Specific GIS life-cycle models have been developed for GIS by Calkins (1982) and Tomlinson (1994). Figure 1 is an example of a typical life-cycle model. GIS design models, which describe the implementation procedures for the life-cycle model, outline the basic steps of the design process at a fairly abstract level (Calkins, 1972; Calkins, 1982).
    [Show full text]
  • MDA Transformation Process of a PIM Logical Decision-Making from Nosql Database to Big Data Nosql PSM
    International Journal of Engineering and Advanced Technology (IJEAT) ISSN: 2249 – 8958, Volume-9 Issue-1, October 2019 MDA Transformation Process of A PIM Logical Decision-Making from NoSQL Database to Big Data NoSQL PSM Fatima Kalna, Abdessamad Belangour, Mouad Banane, Allae Erraissi databases managed by these systems fall into four categories: Abstract: Business Intelligence or Decision Support System columns, documents, graphs and key-value [3]. Each of them (DSS) is IT for decision-makers and business leaders. It describes offering specific features. For example, in a the means, the tools and the methods that make it possible to document-oriented database like MongoDB [4], data is stored collect, consolidate, model and restore the data, material or immaterial, of a company to offer a decision aid and to allow a in tables whose lines can be nested. This organization of the decision-maker to have an overview of the activity being treated. data is coupled to operators that allow access to the nested Given the large volume, variety, and data velocity we entered the data. The work we are presenting aims to assist a user in the era of Big Data. And since most of today's BI tools are designed to implementation of a massive database on a NoSQL database handle structured data. In our research project, we aim to management system. To do this, we propose a transformation consolidate a BI system for Big Data. In continuous efforts, this process that ensures the transition from the NoSQL logic paper is a progress report of our first contribution that aims to apply the techniques of model engineering to propose a universal model to a NoSQL physical model ie.
    [Show full text]
  • A Logical Design Methodology for Relational Databases Using the Extended Entity-Relationship Model
    A Logical Design Methodology for Relational Databases Using the Extended Entity-Relationship Model TOBY J. TEOREY Computing Research Laboratory, Electrical Engineering and Computer Science, The University of Michigan, Ann Arbor, Michigan 48109-2122 DONGQING YANG Computer Science and Technology, Peking Uniuersity, Beijing, The People’s Republic of China JAMES P. FRY Computer and Information Systems, Graduate School of Business Administration, The University of Michigan, Ann Arbor, Michigan 48109-1234 A database design methodology is defined for the design of large relational databases. First, the data requirements are conceptualized using an extended entity-relationship model, with the extensions being additional semantics such as ternary relationships, optional relationships, and the generalization abstraction. The extended entity- relationship model is then decomposed according to a set of basic entity-relationship constructs, and these are transformed into candidate relations. A set of basic transformations has been developed for the three types of relations: entity relations, extended entity relations, and relationship relations. Candidate relations are further analyzed and modified to attain the highest degree of normalization desired. The methodology produces database designs that are not only accurate representations of reality, but flexible enough to accommodate future processing requirements. It also reduces the number of data dependencies that must be analyzed, using the extended ER model conceptualization, and maintains data
    [Show full text]
  • Physical and Logical Schema
    Physical And Logical Schema Which Samuele rebaptizing so alright that Nelsen catcalls her frangipane? Chance often aggravates particularly when nostalgicallydysphonic Denny mark-down misbelieves her old. reluctantly and acquiesces her Clair. Salique and confiscatory Conroy synchronize, but Marc Link copied to take example, stopping in this topic in a specific data models represent a database. OGC and ISO domain standards. Configure various components of the Configure, Price, Quote system. Simulation is extensively used for educational purposes. In counter system, schemas are synonymous with directories but they draft be nested in all hierarchy. Data and physical schemas correspond to an entity relationship between tables, there is logically stored physically turns their fantasy leagues. Source can Work schema to Target. There saying one physical schema for each logical schema a True b False c d. Generally highly dependent ecosystems, logical relationships in real files will also examine internal levels are going to logic physical data warehouse and any way. Enter search insert or a module, class or function name. Dbms schema useful to apply them in virtual simulations, physical warehouse schema level of compression techniques have as. Each record or view the logical schema when should make sure that. Results include opening only a kind data standard, robustly constructed and tested, but the an enhanced method for geospatial data standard design. The internal schema uses a physical data model and describes the complete details of data storage and access paths for create database. Portable alternative to warn students they are specified in its advantages of database without requiring to an sql backends, you can test the simulation include visualization of points.
    [Show full text]
  • Database Reverse Engineering Tools
    7th WSEAS Int. Conf. on SOFTWARE ENGINEERING, PARALLEL and DISTRIBUTED SYSTEMS (SEPADS '08), University of Cambridge, UK, Feb 20-22, 2008 Database Reverse Engineering Tools NATASH ALI MIAN TAUQEER HUSSAIN Faculty of Information Technology University of Central Punjab, Lahore, Pakistan Abstract: - Almost every information system processes and manages huge data stored in a database system. For improvement and maintenance of legacy systems, the conceptual models of such systems are required. With the growing complexity of information systems and the information processing requirements, the need for database reverse engineering is increasing every day. Different Computer Assisted Software Engineering (CASE) tools have been developed as research projects or as commercial products which reverse engineer a given database to its conceptual schema. This paper explores the capabilities of existing CASE tools and evaluates to which extent these tools can successfully reverse engineer a given database system. It also identifies the constructs of a conceptual model which are not yet supported by the database reverse engineering tools. This research provides motivation for software engineers to develop CASE tools which can reverse engineer the identified constructs and can therefore improve the productivity of reverse engineers. Key-Words: - Database reverse engineering, CASE tools, Conceptual schema, ER model, EER model 1 Introduction (OMT), and Entity-Relationship (ER) Database Reverse Engineering (DBRE) is a model. ER model is widely used as a data process of extracting database requirements modeling tool for database applications due from an implemented system. Traditionally, to its ease of use and representation. An legacy systems suffer from poor design Enhance Entity-Relationship (EER) model is documentation and thus make the an extension of ER model which has maintenance job more difficult.
    [Show full text]
  • Managing Data Models Is Based on a “Where-Used” Model Versus the Traditional “Transformation-Mapping” Model
    Data Model Management Whitemarsh Information Systems Corporation 2008 Althea Lane Bowie, Maryland 20716 Tele: 301-249-1142 Email: [email protected] Web: www.wiscorp.com Data Model Management Table of Contents 1. Objective ..............................................................1 2. Topics Covered .........................................................1 3. Architectures of Data Models ..............................................1 4. Specified Data Model Architecture..........................................3 5. Implemented Data Model Architecture.......................................7 6. Operational Data Model Architecture.......................................10 7. Conclusions...........................................................10 8. References............................................................11 Copyright 2006, Whitemarsh Information Systems Corporation Proprietary Data, All Rights Reserved ii Data Model Management 1. Objective The objective of this Whitemarsh Short Paper is to present an approach to the creation and management of data models that are founded on policy-based concepts that exist across the enterprise. Whitemarsh Short Papers are available from the Whitemarsh website at: http://www.wiscorp.com/short_paper_series.html Whitemarsh’s approach to managing data models is based on a “where-used” model versus the traditional “transformation-mapping” model. This difference brings a very great benefit to data model management. 2. Topics Covered The topics is this paper include: ! Architectures of Data
    [Show full text]
  • Entity Chapter 7: Entity-Relationship Model
    Chapter 7: Entity --Relationship Model These slides are a modified version of the slides provided with the book: Database System Concepts, 6th Ed . ©Silberschatz, Korth and Sudarshan See www.db-book.com for conditions on re-use The original version of the slides is available at: https://www.db-book.com/ Chapter 7: EntityEntity--RelationshipRelationship Model Design Process Modeling Constraints E-R Diagram Design Issues Weak Entity Sets Extended E-R Features Design of the Bank Database Reduction to Relation Schemas Database Design UML Database System Concepts 7.2 ©Silberschatz, Korth and Sudarshan Design Phases Requirements specification and analysis: to characterize and organize fully the data needs of the prospective database users Conceptual design: the designer translates the requirements into a conceptual schema of the database ( Entity-Relationship model, ER schema – these slides topic) A fully developed conceptual schema also indicates the functional requirements of the enterprise. In a “specification of functional requirements”, users describe the kinds of operations (or transactions) that will be performed on the data Logical Design: deciding on the DBMS schema and thus on the data model (relational data model ). Conceptual schema is “mechanically ” translated into a logical schema ( relational schema ) Database design requires finding a “good” collection of relation schemas Physical Design: some decisions on the physical layout of the database Database System Concepts 7.3 ©Silberschatz, Korth and Sudarshan Outline
    [Show full text]
  • From Conceptual to Logical Schema
    Logical database design: from conceptual to logical schema Alexander Borgida Rutgers University, http://www.cs.rutgers.edu/ borgida Marco A. Casanova PUC - Rio, http://www.inf.puc-rio.br/ casanova Alberto H. F. Laender Universidade Federal de Minas Gerais, http://www.dcc.ufmg.br/ laender SYNONYMS “Logical Schema Design”“Data Model Mapping” DEFINITION Logical database design is the process of transforming (or mapping) a conceptual schema of the application domain into a schema for the data model underlying a particular DBMS, such as the relational or object-oriented data model. This mapping can be understood as the result of trying to achieve two distinct sets of goals: (i) representation goal: preserving the ability to capture and distinguish all valid states of the conceptual schema; (ii) data management goals: addressing issues related to the ease and cost of querying the logical schema, as well as costs of storage and constraint maintenance. This entry focuses mostly on the mapping of (Extended) Entity-Relationship (EER) diagrams to relational databases. HISTORICAL BACKGROUND In the beginning, database schema design was driven by analysis of the prior paper or file systems in place in the enterprise. The use of a conceptual schema, in particular Entity Relationship diagrams, as a preliminary step to logical database design was proposed by P. P. Chen in 1975 [2, 3], and the seminal paper on the mapping of EER diagrams to relational databases was presented by Teorey et al. in 1986 [7]. Major milestones in the deeper understanding of this mapping include [6] and [1], which separate the steps of the process and pay particular attention to issues such as naming and proofs of correctness.
    [Show full text]
  • Appendix A: a Practical Guide to Entity-Relationship Modeling
    Appendix A: A Practical Guide to Entity-Relationship Modeling A Practical Guide to Entity-Relationship Modeling Il-Yeol Song and Kristin Froehlich College of Information Science and Technology Drexel University Philadelphia, PA 19104 Abstract The Entity-Relationship (ER) model and its accompanying ER diagrams are widely used for database design and Systems Analysis. Many books and articles just provide a definition of each modeling component and give examples of pre-built ER diagrams. Beginners in data modeling have a great deal of difficulty learning how to approach a given problem, what questions to ask in order to build a model, what rules to use while constructing an ER diagram, and why one diagram is better than another. In this paper, therefore, we present step-by-step guidelines, a set of decision rules proven to be useful in building ER diagrams, and a case study problem with a preferred answer as well as a set of incorrect diagrams for the problem. The guidelines and decision rules have been successfully used in our beginning Database Management Systems course for the last eight years. The case study will provide readers with a detailed approach to the modeling process and a deeper understanding of data modeling. Introduction Entity relationship diagrams (ERD) are widely used in database design and systems analysis to represent systems or problem domains. The ERD was introduced by Chen (1976) in early 1976. Teorey, Yang, and Fry (1986) present an extended ER model for relational database design. The ERD models a given problem in terms of its essential elements and the interactions between those elements in a problem domain.
    [Show full text]
  • Entity-Relationship Diagrams
    Entity-Relationship Diagrams Fall 2017, Lecture 3 There is nothing worse than a sharp image of a fuzzy concept. Ansel Adams 1 Recall: Relational Database Management Relational DataBase Management Systems were invented to let you use one set of data in multiple ways, including ways that are unforeseen at the time the database is built and the 1st applications are written. (Curt Monash, analyst/blogger) 2 3 Software to be used in this Chapter… • MySQL Workbench which can be downloaded from http://www.mysql.com/products/workbench/ 4 Recap: Steps in Database Design Miniworld Functional Requirements Requirements this lecture Analysis Data Requirements Functional Conceptual Analysis Design High LevelTransaction Conceptual Schema Specification DBMS independent Logical Design DBMS dependent Application Program Design Logical Schema Physical Design Transaction Implementation Internal Schema Application Programs 5 Phases of DB Design • Requirements Analysis § Database designers interview prospective users and stakeholders § Data requirements describe what kind of data is needed § Functional requirements describe the operations performed on the data • Functional Analysis § Concentrates on describing high-level user operations and transactions • Does also not contain implementation details • Should be matched versus conceptual model 6 Phases of DB Design • Conceptual Design § Transforms data requirements to conceptual model § Conceptual model describes data entities, relationships, constraints, etc. on high-level • Does not contain any implementation
    [Show full text]
  • Programmers Guide Table of Contents
    PUBLIC SAP Event Stream Processor 5.1 SP08 Document Version: 1.0 - 2014-06-25 Programmers Guide Table of Contents 1 Introduction.................................................................. 7 1.1 Data-Flow Programming.......................................................... 7 1.2 Continuous Computation Language..................................................9 1.3 SPLASH......................................................................9 1.4 Authoring Methods..............................................................9 2 CCL Project Basics.............................................................11 2.1 Events.......................................................................11 2.2 Operation Codes...............................................................12 2.3 Streams.....................................................................13 2.4 Delta Streams.................................................................14 2.5 Keyed Streams................................................................ 15 2.6 Windows.....................................................................18 2.6.1 Retention............................................................. 19 2.6.2 Named Windows........................................................22 2.6.3 Unnamed Windows......................................................23 2.7 Comparing Streams, Windows, Delta Streams, and Keyed Streams...........................24 2.8 Bindings on Streams, Delta Streams, and Windows...................................... 27 2.9 Input/Output/Local.............................................................30
    [Show full text]