Metadata Integration Vendor Panel Introduction & Welcome
Total Page:16
File Type:pdf, Size:1020Kb
Metadata Integration Vendor Panel Introduction & Welcome presented by Christian Bremeau Meta Integration, President, CEO Adaptive Geoff Sherwood Senior Consultant, Adaptive Repository ASG Scott McCurdy Vice President, Rochade Business Objects Awez Syed Director, Product Management CA Danny Sandwell Product Manager, ERwin Cognos Rachel Bland Product Manager, Metadata & Modeling Embarcadero Greg Keller Vice President, Product Management IBM Nathan Bobbin Product Manager, Metadata Services Informatica Marc Bourget Product Manager, Metadata Services MetaMatrix John Verhaeg Principal Software Engineer Microsoft Donald Farmer Group Program Manager, SQL Server BI NCR Teradata Steve Long Product Manager, Meta Data Services Oracle Joseph Zheng Director, Software Development, OWB SAS Liz McIntosh Metadata Integration Technologies Sybase Dave Dichmann Product Manager, PowerDesigner The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 1 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Metadata Flow & Life Cycle: the heart beat… Forward Metadata Flow The metadata movement between tools can: - preserve the model “as is” or include transformations Legacy (e.g. forward or reverse engineering from/to BI tools) Reverse Metadata Flow - create and a new model, or update an existing one Migration Multi-Vendor Development Tools Design & Modeling Business Intelligence (BI) OM - Object DM - Data Dimensional Report Modeling Modeling Data Movement & Modeling Authoring Data Integration (EAI, ETL, EII) Metadata inside Operational Data Stores & Data Warehouses Flat File Structures RDBMS Schema / DDL XML Schema or DTD OLAP metadata The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 2 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Metadata Lineage & Impact Analysis “Quadrant of Use Cases” ODS > ETL > DW > DM > BI Forward Lineage Reverse Lineage Technical Users VeryVery HighHigh InterestInterest HighHigh InterestInterest - Application Development: LifeLife CycleCycle SupportSupport BusinessBusiness Users:Users: RDMS, ETL, EAI, EII, ImpactImpact AnalysisAnalysis Metadata/DataMetadata/Data OriginOrigin DW, BI, & Reporting ChangeChange ManagementManagement ReportReport JustificationsJustifications - Unit Testing - Integration Testing - Certification Testing HighHigh InterestInterest - User Acceptance - Deployment LittleLittle toto NoNo ReportReport Analysis:Analysis: -Auditing wherewhere isis thisthis datadata comingcoming from?from? howhow waswas itit calculated?calculated? InterestInterest Business Users Sarbanes-OxleySarbanes-Oxley ActAct (SOX)(SOX) Compliance!!!Compliance!!! The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 3 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Metadata Lineage & Impact Analysis more & more vendors involved… Classic Enterprise Architecture Operational Staging Data Data Reports Data Stores Databases Warehouse Marts ETL Vendors BI Vendors Modern Enterprise Architecture Staging Data Data Databases Warehouse Marts Dimensional Operational OLAP Cubes Stores Reports Data Stores (semantic/business layer) EII Stores RDBMS Vendors ETL Vendors BI Vendors OLAP Vendors EII Vendors The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 4 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Metadata Lineage & Impact Analysis more & more complex… Classic Enterprise Architecture Operational Staging Data Data Stores Databases Warehouse Reports Modern Enterprise Architecture Dimensional Operational Staging Data Data Stores Reports Data Stores Databases Warehouse Marts (semantic/business layer) OLAP Cubes EII Stores The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 5 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Metadata Lineage & Impact Analysis “Metadata Stitching” Metadata Resource COB REC OBJ CPP JAV ERA REL DTD XSD TRF DIM CUB REP Types: Cobol Record Object C++ Java Data RDBMS XML XML Transformation Dimensional Cube Report code definition Model code code Model Schema(DDL) DTD Schema in ETL, BI, etc. Model Model Model CA AllFusion Teradata ERwin MDS BO Universe BO Reporter ERA TRF REL REL REL TRF DIM DIM TRF REP IBM Rational Informatica Rose PowerCenter Embarcadero OBJ TRF XSD XSD TRF REL ER/Studio BO Crystal 9 ERA TRF REL REL TRF REP Oracle Warehouse NCR Teradata Microsoft DTS Builder FastLoad / BulkLoad REL TRF REL REL TRF REL REL TRF REL IBM / Ascential IBM DB2 DataStage Cube Views REL TRF REL REL TRF DIM TRF CUB Cognos Framework Cognos Manager ReportNet REL TRF DIM DIM TRF REP The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 6 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Metadata Integration Strategies Metadata Merging - The classic “one version of the truth” CA AllFusion that drove so many repositories… ERwin - Metadata is merged as side effect of ERA the metadata import into the repository. Informatica PowerCenter BO Universe TRF XSD TRF TRF DIM - The target of the ETL is merged with source of the BI for one version of the truth Ascential DataStageREL Cognos ReportNet REL TRF TRF DIM Metadata Stitching - Each tool has its own version / interpretation of the truth for each metadata store. CA AllFusion - Metadata is integrated as a “stitching” (post) process ERwin which is independent of the metadata acquisition process. ERA Informatica PowerCenter BO Universe - A data flow “Configuration” integrates (stitches) XSD TRF REL TRF REL TRF DIM together a set of “Versions” of data stores and data processes like ETL, EII, BI, etc. Ascential DataStage REL Cognos ReportNet REL TRF REL REL TRF DIM - Leads to metadata Version & Configuration Management for metadata life cycle management / change management, and for metadata lineage & Impact Analysis The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 7 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th Repository Categories “similar data & metadata architectures” Development Operational Life Cycle Analysis Metadata Metadata Metadata Metadata Repositories Repositories Repository Repository The development and operational metadata repositories The life cycle and analysis metadata repositories can be the same product (development vs. production instance) can be the same product. or the operational repository can be a specific product with only run time metadata Metadata Data Modeling Tool e.g. CA AllFusion ERwin Check-in Check-out Version & configuration Metadata DW / BI Model Management Manager Metadata Metadata Comparison bi-directional Metadata Integration ETL Metadata Mapping Metadata one-way ETL Development Tool e.g. Informatica ETL Metadata Stitching Metadata Lineage Power & Impact Analysis Development to production Center Metadata Reporting Metadata EAI Run-time (execution log) Metadata import/export Metadata BI Development Tool e.g. Cognos ReportNet Framework Development to production Manager The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 8 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th OMG Meta Data Standards from CWM to IMM New Information Management Metamodel RFP (IMM) (CWM 2.0) Meta Object Facility Unified Modeling Language (MOF) (UML) Meta- OMG Common Warehouse Metamodel Levels Examples (CWM) The MOF MetaMetaModel M3 Warehouse Meta-metamodel Management Warehouse Warehouse M2 The UML MetaModel Process Operation with Class, Operations, Metamodel, Attributes, Relationships, etc. Meta-metadata The CWM Relational Analysis MetaModel with Table, columns, Data Information Business Transformation OLAP Primary Keys, etc. Mining Visualization Nomenclature M1 A UML Object Model with a Class “Customer” and an Model, operation “getAddress” Resources Object- Record- Multi Metadata, A CWM Relational Model with a Relational XML (also Schema) Table “CustomerAddress” and Oriented Oriented Dimensional Columns: “Street”, “Zip”, etc. M0 { Meta Integration, Inc., Data, Object, 949 Sherwood Ave. Suite 200, Los Altos, CA 94041 } Instance, Foundation Business Data Keys Type Software Expressions (also record, row) Information Types Index Mapping Deployment XML Metadata Interchange CWM Levels Instance of Level… Instance (XMI) Object Core The 10th Annual Wilshire Meta-Data Conference Metadata Integration Vendor Panel –Page 9 Denver, Colorado and the 18th Annual DAMA International Symposium, Tuesday, April 25, 2006 10:30 am - 11:30 am &11:45 am - 12:45 pm 2006, April 23d, to 27th What level of Metadata support to expect from these vendors ? Shall your next modeling tool, EAI, ETL, EII design tool, or metadata repository provide: 9More Metadata Integration between tools ? ¾for better