Effective Data Governance

Total Page:16

File Type:pdf, Size:1020Kb

Effective Data Governance PERSPECTIVE EFFECTIVE DATA GOVERNANCE Abstract Data governance is no more just another item that is good to talk about and nice to have, for global data management organizations. This PoV looks into why data governance is now on the core agenda of next-generation organizations, and how they can implement it in the most effective manner. Why is data governance Variety of data and increase in demanding around data privacy, personal important and sandboxing culture information protection, data security, data lineage, and historical data. challenging now? The next-generation analytics utilize data from all kinds of social networks and This makes data governance top priority for Data has grown significantly blogospheres, machine-generated data, Chief Information Officers (CIOs). In fact, a Omniture / clickstream data, as well as survey by Gartner suggested that by 2016, Over time the desire and capability of customer data from credit management 20% of CIOs in regulated industries would organizations, to collect and process data lose their jobs for failing to implement and loyalty management. Alongside this, has increased manifold. Some of the facts the discipline of Information Governance, organizations have now set up sandboxes, that came out in various analyst surveys successfully [3]. pilot environments, and adopted data and research suggest that: discovery tools and self-service tools. Such Data to insights to actions: Need for Structured data is growing by over 40% • data proliferation and the steep increase in accurate information every year data consumption applications demands Today’s managers use data for decisions Traditional content types, including stringent and effective data governance. • and actions. In our experience, many unstructured data, are growing by managers feel that the data they are [1] More stringent regulations and up to 80% every year accessing is inaccurate or incomplete, compliance Global data will grow to 40 zettabytes and hence, both confidence and adoption • The growing regulatory and compliance (ZB) by 2020 [2] of business intelligence and analytics requirements are making effective data systems is low. Hence, data governance • 85% of this data growth is expected to governance a must have for industries initiatives need to generate good come from new types; with machine- like financial services and healthcare. The confidence in the data managers see and generated data being projected to regulatory requirements are now more use for decision-making. increase 15 times by 2020[2] What are organizations consumption applications like data vision, identify data to be governed, doing to establish warehousing, business intelligence support the implementation of DG effective data and analytics systems, data quality, policies, while actively participating metadata management, master data in change management and governance? management, data strategy, and data monitoring. IT teams are responsible Role of the chief data officer life cycle. for the management of data and measurement of data quality, as well (CDO) Collaborative Data Governance as collection and management of Gartner predicts that 50% of all Organizations metadata and master data. They also companies in regulated industries It is important for Chief Data Officers provide tools and technologies for will have a CDO by 2017 [4]. The to engage the right teams in the Data implementation of the related tools CDO will be responsible for Governance Organization, to align and technologies. enterprise data management, data governance and business goals. enterprise data governance, data Business teams are important to define External Document © 2018 Infosys Limited External Document © 2018 Infosys Limited Typical Data Governance Org Structure » Set strategy and direction for overall data products Steering Committee » Approve funding and resource allocation from BUs BU » Prioritize adoption of enterprise data capabilities Sr. Mgmt. » Ultimate Business Authority for the data they own Data Governance Business » Council Data Owners » Support data governance and standards teams » Develop investment recommendations for Exec. Management review / approval » Ensure data-related work is performed according to operating procedures Data » Determine usage permissions and policies Standards Group Data Steward » Liaison between business and technology around data issues and questions » Delivery / » Responsible for understanding data modeling, tracking usage, access, Execution Group Data Custodians Key SMEs and implementation » Ensure data is available / accessible, well-performing, and recoverable Figure 1: Role of Business Teams in Data Governance Articulate tangible benefits from governance strategy includes policy and implementations that drive common data governance initiatives and rules for data quality management, goals and integrate outcomes across these metadata management, master data disciplines enjoy benefits like improved In order to keep all the stakeholders management, as well as data security. The reliability, traceability, and authenticity engaged and ensure continuous implementation of each of these individual of data. This will also provide a common investments in data governance initiatives, disciplines presents the intended benefits. communication platform across all the it is important to articulate the value However, data governance strategies stakeholders. generated by data governance initiatives via the right metrics. A dashboard with relevant metrics can be an easy tool to assess the impact of data governance initiatives, such as improvement in data quality parameters, improvement Reliability Traceability Authenticity in dollar-value impact because of End-to-End data lineage Consistent consumption of improved data quality, and the ability governance policies, and traceability, enabling data from authoritative standards, and procedures better audit controls data assets that are to rationalize enterprise metrics to data Better accountability and Capability to respond to data-ownership improves changes rapidly through Better understanding of definition standardization. Such tools comprehensive impact play an important role in monitoring data being reported both analysis consistent usage externally and internally Improve quality, Robust quality controls and controlling adherence to the data Enable better quality consistency, and usability across the data life cycle governance policies. information delivery and of master and reference analytics data across segments Sum of parts is greater than the KEY BENEFITS whole – seamless data governance Accountability Business Better Stronger For Data Agility Compliance IT Agility Insights Organizations are now looking at data governance holistically. The Data Figure 2: Benefits of Seamless Data Governance External Document © 2018 Infosys Limited External Document © 2018 Infosys Limited Big data user ratings are replacing Effective Data Governance at requirements, tools and business traditional data quality (DQ) metrics Infosys processes, easy decision-making process, Ratings by data consumers are replacing stakeholder interaction, and business Infosys holistic service offerings help next- traditional means of measuring data access. generation organizations to implement accuracy for non-traditional data such Once an enterprise establishes the above effective data governance. as sentiments and opinions. Most of the process of enabling informed business leading data platform providers such as The goal of data governance initiative decisions as the collective aim of data Cloudera, Hortonworks, and Informatica is to manage data for delivering timely, governance, it becomes significantly easier (BDE) offer ways of capturing the usage trustworthy, and relevant information to define the goals and priorities for any of data from data lakes and user ratings to make informed business decisions. initiative. Good data governance paves the about the usefulness and quality of the However, data governance is not only way for enterprise policies, people, and information. about data, but also about enabling clear processes to launch that initiative. ownership, business rules, operational Enterprise Data Quality Master Data Metadata Data Data Strategy Data Management Management Management Protection & Diagnostics Governance Enterprise data Data quality Leverages Frameworks, Deploy data Data governance assessment, Infosys deep accelerators security across Assessment framework experience on backed up by the enterprise Toolkit to including monitoring, master data deep with identify processes, transformation management competency in optimization organization, framework, implementation industry-leadin scalable areas in data and Infosys and toolkit s, and unique g tools and solution, landscape, Data backed up by methodology. technologies. ensuring data redundancy, Governance pre-built protection and technology solutions and privacy, as a and data solution. accelerators. service. life cycle Setting data management life cycle management policies. Figure 3: Effective Data Governance @ Infosys The focus now turns to the tools and technologies to implement and ensure compliance with data governance requirements in accordance to business access. Infosys Data Governance Solution offers a robust framework and technology solutions that leverage partnerships with leading product vendors in this space. External Document © 2018 Infosys Limited External Document © 2018 Infosys Limited Infosys Data Governance Framework with measurable KPIs
Recommended publications
  • A Guide to Data Governance Building a Roadmap for Trusted Data a Guide to Data Governance Contents
    A Guide to Data Governance Building a roadmap for trusted data A Guide to Data Governance Contents What is Data Governance? ...............................................................................................3 Why Do We Need It? ............................................................................................................................................................................. 4 The Need to Create Trusted Data ..................................................................................................................................................... 4 The Need to Protect Data .................................................................................................................................................................... 5 Requirements For Governing Data In A Modern Enterprise ........................................7 Common Business Vocabulary ........................................................................................................................................................... 7 Governing Data Across A Distributed Data Landscape............................................................................................................ 7 Data Governance Classification ......................................................................................................................................................... 8 Data Governance Roles and Responsibilities ..............................................................................................................................
    [Show full text]
  • Definitive Guide to Data Governance Contents
    Definitive Guide to Data Governance Contents Introduction: Why trusted data is the key to digital transformation 03 Chapter 1: What is data governance and why do you need it? 05 Chapter 2: Choosing the best governance model for you 11 Chapter 3: Three steps to deliver data you can trust 18 Chapter 4: Dos & don’ts: the 12 labors of the data governance hero 41 Chapter 5: New roles of data governance 46 Chapter 6: Successful trusted data delivery stories 50 Chapter 7: Managing the transition from data integration to data integrity 60 Chapter 8: Moving toward the data intelligence company 66 2 Definitive Guide to Data Governance Introduction Why trusted data is the key to digital transformation We’ve entered the era of the information economy, tools in order to get results fast While these tactics may where data has become the most critical asset of every solve for speed in the short term, they are not scalable as organization Data-driven strategies are now a competitive the company grows, and create quality and compliance imperative to succeed in every industry To support risk due to the lack of oversight On the other hand, business objectives such as revenue growth, profitability, organizations that try to solve the data trust problem often and customer satisfaction, organizations are increasingly create a culture of “no” with the establishment of strict relying on data to make decisions Data-driven controls and an authoritative approach to governance decision-making is at the heart of your digital However, it’s resource-intensive, cumbersome,
    [Show full text]
  • Data Governance Part II: Maturity Models – a Path to Progress
    NASCIO: Representing Chief Information Officers of the States Data Governance Part II: Maturity Models – A Path to Progress Introduction When government can respond effectively and expeditiously to its constituents, it In the previous report on Data Governance1 gains credibility with citizens. The an overview of data governance was opposite is also true. When government presented describing the foundational can’t respond, or responds incorrectly, or issues that drive the necessity for state too slowly, based on inaccurate informa- government to pursue a deliberate effort tion, or a lack of data consistency across for managing its key information assets. agencies, government’s credibility suffers. Data governance or governance of data, information and knowledge assets resides This research brief will present a number within the greater umbrella of enterprise of data governance maturity models2 architecture and must be an enterprise- which have been developed by widely wide program.There is a significant cost to recognized thought leaders. These models March 2009 state government when data and informa- provide a foundational reference for tion are not properly managed. In an understanding data governance and for NASCIO Staff Contact: emergency situation, conflicts in informa- understanding the journey that must be Eric Sweden anticipated and planned for achieving Enterprise Architect tion can jeopardize the lives of citizens, [email protected] first responders, law enforcement officers, effective governance of data, information fire fighters, and medical personnel. and knowledge assets. This report contin- ues to build on the concepts presented in Redundant sources for data can lead to Data Governance Part I. It presents a conflicting data which can lead to ineffec- portfolio of data governance maturity tive decision making and costly models.
    [Show full text]
  • GAVS' Blockchain-Based
    Brochure GAVS’ Blockchain-based Master Data Management Framework For Enterprises Enterprise-wide Data Stewardship, Shared Ownership Of Data Master Data Challenges With enterprises moving full throttle towards digital transformation and the consequent proliferation of data, the magnitude of Master Data Management (MDM) challenges are on a steep rise. Implementing a sustainable MDM strategy has now gained critical importance. 01 www.gavstech.com Master Data Management Challenges Centralized Authority Data Management Centralized management of Master Data is complex, Data Reconciliation expensive and prone to security compromise & Mergers & acquisitions involve complex reconciliation accidental loss. and appropriate definition for Data Stewardship & Governance. Data Security Data Movement A single malicious attack to a centralized infrastructure Sharing Master Data across enterprise boundaries, with can do a lot of damage. subsidiaries or BUs across geographies, or multi-master updates is highly resource intensive. Data may also be compromised by breaches through the backend, bypassing business logic-based front-end Transfer of Ownership controls. Transfer of Master Data ownership to customers or to other BUs comes with a compliance risk due to the lack of cryptography-based authentication. Data Lineage Audit trails may be incomplete, unavailable or corrupt leading to lack of data lineage & traceability, which in-turn will affect downstream systems. Blockchain-based Master Data Management to the Rescue! A Blockchain is a kind of distributed ledger consisting of cryptographically signed, irrevocable transactional records based on shared consensus among all participants in the network. Decentralized Trust & Transparent Secured Resilient Innovative application of Blockchain is key to transformation in several industry verticals 02 www.gavstech.com Decentralization Data Transparency/Traceability The cornerstone of the Blockchain technology is Since Blockchains are based on smart contracts and decentralization.
    [Show full text]
  • The Evolving Role of the Chief Data Officer in Financial Services
    The evolving role of the chief data officer in financial services: From marshal and steward to business strategist The evolving role of the chief data officer in financial services | From marshal and steward to business strategist The evolving role of the chief data officer in financial services: From marshal and steward to business strategist Over the past few years, financial institutions core businesses, products, customers, and (FIs) have increasingly come to recognize supporting data infrastructure’s capabilities that their data assets represent highly and needs. strategic sources of insight and leverage for a wide array of business functions, More recently, the CDO’s job description–for including risk management, regulatory the most progressive organizations–has compliance, sales and marketing, product evolved from its initial focus on data asset development, and operational performance, gathering, governance, and stewardship among others. To realize this embedded to proactive business enablement, with value, however, organizations need to many institutions even marrying the CDO proactively and effectively manage their and chief analytics officer (CAO) roles into a information assets at the enterprise level. In single senior-level position. This is especially response, they have been appointing chief true for organizations that aggressively data officers (CDOs) to provide required seek to leverage data science and advanced strategic guidance and execution support, analytical modelling to generate new insights and also to assure access to and the into the markets and customers they serve, quality of critical data. In addition, CDOs the products they build and price, the risks will undoubtedly play a strategic role in they assume or pass on, and the means by helping FIs adapt and transform their data which they operate the business to benefit ecosystems in response to rapid technology stakeholders.
    [Show full text]
  • Data Governance with Oracle
    Data Governance with Oracle Defining and Implementing a Pragmatic Data Governance Process with Oracle Metadata Management and Oracle Data Quality Solutions ORACLE WHITE P A P E R | SEPTEMBER 2015 Disclaimer The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. DATA GOVERNANCE WITH ORACLE Table of Contents Disclaimer 1 Introduction 1 First Define the Business Problem 2 Identify Executive Sponsor 3 Manage Glossary of Business Terms 4 Identify Critical Data Elements 4 Classify Data from an Information Security Perspective 5 Manage Business Rules 6 Manage Allowable Values for Business Terms 7 Support for Data Lineage and Impact Analysis 8 Manage Data Stewardship Workflows 10 Govern Big Data 11 Manage Data Quality Rules 12 Execute Data Quality Rules 12 View Data Quality Dashboard 16 Data Quality Remediation 16 Data Privacy and Security 17 Ingredients for Data Governance Success 17 Governance with Any Enterprise System 19 Align with Other Oracle Solutions 20 About the Author 22 DATA GOVERNANCE WITH ORACLE . DATA GOVERNANCE WITH ORACLE Introduction Data governance is the formulation of policy to optimize, secure, and leverage information as an enterprise asset by aligning the objectives of multiple functions. Data governance programs have traditionally been focused on people and process. In this whitepaper, we will discuss how key data governance capabilities are enabled by Oracle Enterprise Metadata Manager (OEMM) and Oracle Enterprise Data Quality (EDQ).
    [Show full text]
  • Data Management Capability
    Data Management Capability In today’s world, data fuels the Fresh Gravity supports a wide spectrum Information Driven Enterprise. It of your data management needs, offering powers business growth, ensures end-to-end services for your organization. cost control, launches products Our data management focus areas are: and services, and penetrates new markets for the organization. » Big Data Effective data management helps » Cloud Services to achieve the goal of Customer Centricity for organizations of any » Data Architecture size. When it comes to making » Data Governance the most of data, organizations » Metadata Management must get their information in order if they want to turn insights » Master Data Management into action and deliver better » Data Warehouse Modernization business outcomes. With data increasing in velocity, variety, and » Data Integration volume, organizations are finding it increasingly difficult to gather, store, and effectively use data to fuel their analytics and decision support systems. Core Capabilities Big Data Data Quality & Governance Master Data Management » Big Data Strategy » Data Quality Health Check — » Master Data Integration » Big Data Architecture Profile, Analyze and Assess » Match and Merge Rules » Data Lake Implementation Services » Data Remediation Services » Establish Golden Record » Data Quality Tools Implementation » Advanced Analytics » Master Data Syndication » Operational Data Quality » Reference Data Management Procedures Cloud Services » Hierarchies and Affiliations » Standards, Policies,
    [Show full text]
  • Data Governance Part III: Frameworks – Structure for Organizing Complexity
    NASCIO: Representing Chief Information Officers of the States Data Governance Part III: Frameworks – Structure for Organizing Complexity Introduction frameworks and maturity models assist in describing the scope—both breadth and NASCIO has presented previous research depth—of an initiative. This holds true as briefs that introduce the subject of data well for data, information and knowledge governance, and emphasize the impor- management. tance of managing data and information assets as enterprise assets. Maturity models were presented that help describe the The Challenge journey state government must anticipate and plan. The challenge in state government is a history of state agencies operating fairly This research brief presents the concept of autonomously regarding processes and frameworks that will describe what consti- investment related to managing informa- May 2009 tutes a data governance program. The tion. In the decades of this history, focus will be on frameworks from the Data strategic intent, processes, organization, NASCIO Staff Contact: Management Association (DAMA), the information management, infrastructure, Eric Sweden Enterprise Architect Data Governance Institute (DGI), and IBM. technology, training, incentives and opera- [email protected] tions have been developed in a highly In general, frameworks assist in describing decentralized manner to meet the needs of major concepts and their interrelationships. state agencies independent of one anoth- Frameworks assist in organizing the er. As state government pursues an complexity of a subject. Frameworks facili- enterprise perspective in managing its data tate communications and discussion. All of and information assets, it will recognize a these descriptors apply as well to frame- disparity in data maturity levels within the works related to data governance.
    [Show full text]
  • Data Governance Officer Job Description
    Data governance officer Role brief Directorate Strategy and corporate services Base location Bristol ectionGrade 15 Job level C Job family Professional services Date April 2017 Reports to Enterprise data manager Responsible for The continued establishment of a data governance programme within Jisc supporting the data warehouse, other core systems and datasets and implementing best practice across the company. 1. Background The data governance officer is a role within the information strategy team that forms part of group infrastructure in the strategy and corporate services directorate. This directorate, working closely with finance and commercial directorate, brings together into a single management framework all back office functions that support the operations and governance aspects of Jisc’s offering. The data management and governance team consists of the enterprise data manager supported by the data governance officer. The data governance officer role has been supporting the establishment of the data warehouse as it transitions from a project to business as usual. This includes working with data owners feeding key datasets in our CRM and finance systems. The data warehouse will be shortly moving into a business as usual state and will give a great opportunity for the data governance officer to develop and implement best practices policies and guidance across the company’s key systems and data sources. 2. Purpose and scope The purpose of this role is to work with the enterprise data manager as a liaison between Jisc business units to improve business processes, improve the quality of data within our core systems and introduce an enterprise taxonomy and ontology consistently across the business and systems.
    [Show full text]
  • The Chief Data Officer in Government a CDO Playbook
    The Chief Data Officer in Government A CDO Playbook A report from the Deloitte Center for Government Insights The Chief Data Officer in Government About the Deloitte Center for Government Insights The Deloitte Center for Government Insights shares inspiring stories of government innovation, looking at what’s behind the adoption of new technologies and management practices. We produce cutting-edge research that guides public officials without burying them in jargon and minutiae, crystalizing essential insights in an easy-to-absorb format. Through research, forums, and immersive workshops, our goal is to provide public officials, policy professionals, and members of the media with fresh insights that advance an understanding of what is possible in government transformation. About the Beeck Center for Social Impact + Innovation The Beeck Center for Social Impact + Innovation at Georgetown University engages global leaders to drive social change at scale. Through our research, education, and convenings, we provide innovative tools that leverage the power of capital, data, technology, and policy to improve lives. We embrace a cross-disciplinary approach to building solutions at scale. Deloitte Consulting LLP’s Technology Consulting practice is dedicated to helping our clients build tomorrow by solving today’s complex business problems involving strategy, procurement, design, delivery, and assurance of technology solutions. Our service areas include analytics and informa- tion management, delivery, cyber risk services, and technical strategy
    [Show full text]
  • Achieving Regulatory Compliance with Data Lineage Solutions
    ACHIEVING REGULATORY COMPLIANCE WITH DATA LINEAGE SOLUTIONS An Industry Perspective Report brought to you by ASG Technologies and FIMA This report is based on recommendations made by the industry experts who participated in ASG’s live webinar in the Summer of 2016. SETTING THE SCENE In the Summer of 2016, ASG and the FIMA conference series partnered to produce a webinar focused on addressing the real questions that arise when working on data lineage projects. Why is lineage important? How are people approaching the creation of a data lineage analysis? What are reasons it should potentially be automated? What does automated analysis bring in terms of accelerated compliance? This report uncovers the answers to these questions, as identified by the several industry experts listed below, and includes their recommendations on building out your own data lineage projects. PANELISTS THOMAS SERVEN Vice-President of Enterprise Data Governance State Street FRED ROOS Director of ICAAP Transformation Santander Holdings US IAN ROWLANDS Vice-President of Product Marketing ASG Technologies 2 What does the current A secondary shift is data and regulatory occurring through an explosive change environment look like? in the technology environment. Cloud- based applications IAN ROWLANDS: There are several factors today and services, as well adding to a heightened focus on data lineage. One of the most prominent is change in the as big data as a new regulatory environment. In the past, you may storage infrastructure have only needed to respond to one new are leading to regulation a year, and been audited at most once a quarter. It would have been likely that your IT an increasingly team knew more about the information that they were being asked for sophisticated than the regulators themselves.
    [Show full text]
  • The Relationship Between Information Governance, Data Governance
    The Relationship Between Information Governance, Data Governance, and Big Data Richard Kessler November 2015 Definitions and Interpretations Data Governance "The exercise of authority and control over the management of data assets to define, approve and communicate data strategies, policies, and standards; to track and enforce regulatory compliance and conformance to data…" etc. – Data Architecture Management Association (DAMA) "Data governance is a set of processes that ensures that important data assets are formally managed throughout the enterprise. Data governance ensures that data can be trusted and that people can be made accountable for any adverse event that happens because of low data quality." – Wikipedia Information Governance "The specification of decision rights and an accountability framework to ensure appropriate behavior in the valuation, creation, storage, use, archiving and deletion of information. It includes the processes, roles and policies, standards and metrics that ensure the effective and efficient use of information in enabling an organization to achieve its goals." – Gartner "The activities and technologies that organization employ to maximize the value of their information while minimizing associated risks and costs." – Information Governance Initiative Definitions and Interpretations Big Data "Volume, Variety, Velocity." (Note that others have added other V's, including Veracity, Validity, and Visibility.) - Doug Laney of Gartner, 2001. "Transactions, Interactions, and Observations." - Shaun Connolly of Hortonworks.
    [Show full text]