Open Data and Open Government

Information is a valuable national resource and a strategic asset to the Federal government, its partners, and the public. In order to ensure that the Federal government is taking full advantage of its information resources, executive departments and agencies...must manage information as an asset throughout its life cycle to promote and interoperability, and properly safeguard systems and information.

OMB Policy — Managing Information as an Asset¹

Summary Responsibilities and governance are widely distributed in this “ policy area. Some initiatives are led by the Federal CIO, while others come directly from The White House. GSA manages Data. Stakeholders gov and Project Open Data. To date, over 185,000 government datasets have been posted on Data.gov. However, it can be difficult to measure the broader economic and civic impacts of open data and open government Impact efforts. While most CIOs reported interest in open government and open data initiatives, many expressed challenges in obtaining resources, navigating conflicts with existing policies, and balancing priorities against other efforts such as infrastructure Risk modernization and cybersecurity. Efficiently managing government data and information can increase operational efficiencies, reduce costs, improve services, and better safeguard personal information. Making information resources accessible, discoverable, and usable by the public can Policy help fuel entrepreneurship, innovation, and scientific discovery.

STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 C-1 Open Data and Open Government C-2 5 and information can increase operational operational can increase and information services, improve costs, reduce efficiencies, information. personal safeguard and better information improved Furthermore, the efficient for can allow management others by this data of and reuse release section next The an agency. outside of and the strategies of will discuss several has government Federal the that initiatives manage agencies how improve to pursued to data more to provide and information the public. systems (see Figure C1) and weather weather C1) and Figure (see systems changed fundamentally that forecasting impact had a tremendous and lives citizens economy. American on the is these goals of both achieving to Key management efficient and the effective Improving information. government of data government of the management POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE Figure C1: GPS Equipment Revenue in the between 2005 to 2010 2005 to between States in the United Revenue C1: GPS Equipment Figure

allowed for the creation of navigation navigation of the creation for allowed government’s release of weather data data weather of release government’s (GPS) System Positioning and the Global public can transform citizen-facing services services citizen-facing public can transform innovation, and help fuel entrepreneurship, example, For the discovery.⁴ and scientific collaboration.³ Making information and data and information Making collaboration.³ the and usable by discoverable, accessible, three central principles that set the tone for for the tone set principles that central three (1) ; in this area: efforts future and (3) (2) public participation; generated in the Federal government as government in the Federal generated The memo established asset. a national Administration, the President signed the President the Administration, Open and Transparency on Memorandum information recognizes that Government right and ability to access this information.² information.² this access to and ability right of the Obama full day the first On The Federal government creates and creates government Federal The and data valuable of variety wide a collects with the citizens provide to has long sought Overview Overview Open Data and Open Government Open and Data Open Open Data and Open Government C-3 Open Data Action Plan and Action Data Open Goals CAP Data.gov and the IT Dashboard Dashboard and the IT Data.gov National Government Open Plans Action Strategy Government Digital — Managing Policy Data Open Asset as an Information Transparency and the Open the Open and Transparency Directive Government — 2015 — present 2014 2011 2012 2013 2009 Mandates collaboration with public and civil actors with public and civil actors collaboration Mandates open new of release the and prioritize identify to such efforts public outreach incentivizes sets, data focuses roundtables, and industry as challenges data innovation on Fellows Innovation Presidential projects. Citizen-facing websites designed to increase to increase designed websites Citizen-facing directly data government and share transparency with the public. online petitions the People” Launches the “We modernizes public participation, promotes platform, improves management, and information records administration. FOIA new of and adoption the development Directs API policies. Requires web and content, open data, customer-facing major two identify to agencies to the exposed can be that with information systems APIs. web-based via public and open data machine-readable standard Requires and information supports interoperability formats, Data establishes the Enterprise accessibility, listing. and public data Inventory Lays out open government principles of being principles of out open government Lays collaborative. and participatory, transparent, Dashboard. Government the Open Establishes in open online post information to agencies Requires to datasets high-value three identify and to formats, post on Data.gov. 2009 Key Initiatives Key POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE

with increased access to government government to access with increased information. , and information and information accountability, the public while providing management The recurring theme throughout all of all of theme throughout recurring The transparency, to improve was these efforts areas like cybersecurity, customer service, service, customer cybersecurity, like areas decisionmaking.”⁹ data-driven and internal governance and to emphasize the message the message emphasize and to governance data good is an output of Data Open that in to success and critical management government-wide strategy shifted “to “to shifted strategy government-wide data on enterprise broadly more focus (e.g. the release of structured, machine- structured, of the release (e.g. weather pertaining to data readable 2016, the primary In and climate).⁸ which could become platforms for for platforms become which could and innovation entrepreneurship, research, of other legislation (e.g., USASpending. legislation other of included the efforts in 2007).⁷ Later gov public resources sharing of increased function or dataset (e.g., Regulations.gov Regulations.gov (e.g., dataset function or as a result created websites in 2003),⁶ and domain directory of Federal websites. websites. Federal of domain directory of the creation period also saw This supporting a single business websites the requirements of the E-Government E-Government the of the requirements establishing a public which included Act, Prior to 2009, government-wide efforts efforts 2009, government-wide to Prior the public into data government bring to meeting on focused largely were sphere Policy Evolution Policy Open Data and Open Government C-4

Jump-started the movement to release release to movement the Jump-started datasets government support executive high-level Provided to improve efforts government-wide for accountability and transparency with the data performance Shared dashboards web-based public through raised initiatives, other many Like without agencies for expectations resources additional providing was the initiative of focus The of number the on counting frequently data than the rather datasets shared released impact of or value, quality, datasets the potential discussion of the Began and open government open of value customers to data • • • • • •

Transparency and the and Transparency Directive Government Open Key Strengths Key Challenges Policy Impact POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE

later renewed agencies’ focus on these focus agencies’ renewed later for instructions updating by approaches in 2016.¹² Plans Government Open Agency value data sets which were not previously previously not were which sets data value OMB within 45 days. available, publicly publishing agency information online information publishing agency a agencies and gave formats”, in “open high- publishing three of specific target Government Directive tasked agencies agencies tasked Directive Government Plan, Government Open an with creating agency official accountable for the quality the quality for accountable official agency via public- presented information of Open addition, the In websites.¹¹ facing was issued that, among other things, among other that, issued was a senior of the appointment required three principles: transparency, public transparency, principles: three Later collaboration.¹⁰ and participation, Directive Government an Open year, that he issued a Transparency and Open and Open Transparency a he issued based on memorandum Government Government Directive Government office in day first Obama’s President On 2009 2009 Open and the Transparency Open Data and Open Government C-5 Provides a one stop shop for for shop stop a one Provides datasets government easily more data government Made and searchable discoverable Administration’s the Obama Supported objectives open government shop for a one stop Provides datasets government easily more data government Made and searchable discoverable Administration’s the Obama Supported objectives open government government-wide a new Signaled the to opening up data to approach public portal for a public-facing Created spark to datasets government data) weather (e.g., innovation • • • • • • • •

Data.gov Key Strengths Key Challenges Policy Impact

POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE Data.gov, launched in May 2009, launched in May Data.gov, Figure C2: Data Sets Available on Data.gov increased by over 400% from 2012 - 2016¹⁷ 400% from over by increased on Data.gov Available Sets C2: Data Figure are being used by private sector companies companies sector private used by being are and the public.¹⁶ the Data.gov website includes a number of of includes a number website the Data.gov these datasets how of examples anecdotal Inventory (usually not posted publicly) as publicly) posted not (usually Inventory by read which can be files data structured of section “impact” The and OMB. Data.gov the site.¹⁵ Finally, Agencies maintain their their maintain Agencies Finally, the site.¹⁵ Data Enterprise and (publicly) listings data (e.g., PDF versus XML) or are not updated updated not are XML) or versus PDF (e.g., limiting year, per than once often more on provided the data of the usefulness many cases the datasets are not available available not are cases the datasets many machine-readable easily or in open formats about 911 emergency service areas.¹³ areas.¹³ service about 911 emergency sectors different 14 lists Data.gov Currently, in However, is available.¹⁴ which data for range of agency datasets, ranging from from ranging datasets, agency of range information to data complaint consumer Data.gov: Data.gov: a broad publicize push to made an early one stop shop for government datasets datasets government shop for one stop public health to data census from ranging information. the transparency ofgovernment spending spending ofgovernment the transparency a provide and to investments IT on major The Obama Administration launched Administration Obama The to improve initiatives additional several 2009-present 2009-present Dashboard IT and the Data.gov Open Data and Open Government C-6 shift away from the static, document- static, the from away shift data live toward approaches, driven visualizations and analyze public can download The citizen increasing themselves, the data and oversight engagement TechStat and Dashboard IT The OMB, and sessions helped agencies, and projects at-risk IT identify Congress measures corrective implement Improves transparency into major IT IT major into transparency Improves investments public so the available data Makes taxpayer spend agencies see how could dollars began the Dashboard 2015, In use agile or agencies whether displaying on practices development incremental projects IT and under budget over both Variances as negative reported are budget schedule of well as ahead (as conditions some leading to and behind schedule), confusion that data from draws Dashboard IT The leading agencies, by is self-reported and quality about data questions to completeness detailed, provided have all agencies Not by “Evaluations up-to-date regular, investments major all for CIO” Agency a major represents Dashboard IT The • • • • • • • • •

Federal IT Dashboard IT Federal Policy Policy Impact Key Strengths Key Challenges POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE In 2009, OMB publicly publicly OMB 2009, In IT spending for FY 2016. FY spending for IT displays cost, schedule, and performance schedule, and performance cost, displays IT federal 770 major over for data $81.5 billion in for accounting investments agency CIO of the investment’s overall overall the investment’s of CIO agency Dashboard the IT Currently, risk.¹⁸ of level with information as to whether major IT IT major whether to as with information within and on schedule were investments the by as an assessment well as budget, IT Dashboard: Dashboard: IT Dashboard IT the Federal launched Open Data and Open Government C-7 and software and open source Provided additional support from support from additional Provided open for Administration the Obama in project both efforts, government public communications support and Administration with synergies Created usage government on increasing focus and services tools digital of challenge” “grand of a number Makes difficult are results where commitments track to of CIO outside offices of Engagement made it sometimes have organization focus on open to CIOs for difficult efforts and open data government the the “We of the development to Led platform online petitioning People” platform the “Challenge.gov” Improved the public in providing engage to government’s to solve solutions problems “mission-centric” the of the development Initiated on reusable Policy Code Source Federal • • • • • • •

Open Government National Action Plans Action National Government Open Key Strengths Key Challenges Policy Impact POLICY PAPERS POLICY

STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE Creating Safer Communities Safer Creating Accountability Corporate Increasing Improving Public Services Public Improving Integrity Public Increasing Public Managing Effectively More Resources • • • • • NAP Grand Challenge Commitments Challenge Grand NAP . the number of participating agencies. participating of the number person to find the prizes and challenges challenges and the prizes find to person both increasing them by interested that and data the available of the accessibility NAP’s focus on Challenge.gov centered centered on Challenge.gov focus NAP’s the average for making it easier around in providing solutions to government government to solutions in providing with veterans providing (e.g., challenges The to health services).²¹ access better portal is designed to publish innovative innovative publish portal is designed to to engage the public for opportunities The special focus placed on improving on improving placed special focus The a NAP of is an example Challenge.gov The Challenge.gov from 2015. initiative digital service strategies, such as the CAP as the CAP such strategies, digital service Goals.²⁰ connected with a number of other open other of with a number connected and citizen-facing open data, government, online petitioning platform). The initiatives The initiatives platform). online petitioning (2015) continue last NAP in the proposed and are today be implemented to participation and citizen engagement in engagement and citizen participation People” The “We the (e.g., government first in a series of National Action Plans Action National of series in a first in the initiatives of Many (NAPs).¹⁹ public on enabling focused the NAPs Open Government Partnership, the Partnership, Government Open launched the Administration Obama Action Plans Action international the part of 2011, as In 2011 — 2015 — 2015 2011 National Government Open Open Data and Open Government C-8 Provided clear guidance (e.g., identify 2 identify (e.g., guidance clear Provided sets) data high-value such concepts open data Emphasized and interoperability as accessibility tagging metadata through metrics contain did not strategy The of accuracy or assess quality to result, it is As a released. information fulfilled the actually agencies if unclear the policy of requirements in 2013 and 2016 reviews PortfolioStat developed APIs of included the number performance in its key each agency by (KPIs) indicators with the creation compliance Agency was never JSON files and the HTML of KPIs in PortfolioStat measured • • • • • Apply metadata tagging and publish and publish tagging metadata Apply high- additional transition to a plan systems. value which websites new Establish (HTML) human-readable hosted (JSON) and machine-readable progress their of descriptions each action and implementing milestone.²⁵ • • Digital Government Strategy Government Digital Key Strengths Key Challenges Policy Impact and their success. and their While there were a number of clear clear of a number were there While came from that outcomes implementation (e.g, Strategy Government the Digital performance web a of the development experience and customer guidance²⁶ information is no available there metrics²⁷), initiatives these of impact overall the about POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE facing systems available through web web through available systems facing APIs. candidates to make compliant with compliant make to candidates web and content, open data, new API policy. in content and data high-value Make customer- major existing least two at gov/developer pages. gov/developer at identify to with customers Engage customer- major existing least two high- contain that services facing as first-move content or data value Ensure all new IT systems follow the follow systems IT all new Ensure API web and content, open data, agency. and operationalize policy • • • addition, agencies were required to: required were addition, agencies data feeds. These feeds are particularly particularly are feeds These feeds. data In developers.²⁴ software IT for useful agency APIs. Since August of 2013, the of August Since APIs. agency the features access public has been able to automatic receive to in order APIs these of expanded to include a web API catalog for for API catalog web include a to expanded aggregate centrally to agencies all Federal accessible mobile applications to draw to draw mobile applications accessible addition, pursuant In upon those datasets. was Data.gov Strategy, the Digital to and the adoption of an API-first mindset mindset API-first an of and the adoption highly create to developers allow to accessibility. This involved the application the application involved This accessibility. make to order in tagging metadata of searchable easily more published datasets The strategy’s data-driven components components data-driven strategy’s The and interoperability both emphasized government data more easily available to to available easily more data government the public.²³ to improve the delivery of citizen-facing citizen-facing of the delivery improve to the of focus primary A digital services.²² of quantities vast the make to was strategy In May 2012, the Administration launched launched Administration 2012, the May In sought that Strategy Government a Digital 2012 Strategy Government Digital Open Data and Open Government C-9

tension with existing policies with existing tension of the impacts is difficult to measure It policies because it is hard open data such as data concepts quantify to and downstream transparency, usability, innovation on the attention agency Focused released datasets of usability Dashboard Data Open Project The of a number track publicly is used to efforts open data for metrics Reemphasized that data should be data that Reemphasized default by “open” to data” “open Expanded the meaning of and usable accessible more encourage of and descriptions licenses, formats, datasets Data Open Project Launch of Data Enterprise such as the Efforts a high degree introduced Inventory for making it difficult (cost), burden of without implement fully to agencies additional support a in some cases have efforts data Open • • • • • • • • Open Data Policy — Managing Information — Managing Policy Data Open Asset as an Policy Policy Impact Key Strengths Key Challenges materials across the following goals: the following across materials Listing, Data Public Inventory, Data Enterprise & Security, Engagement, Public of Many & Impact.³² Capital, and Use Human a government- at also appear these metrics CAP Data in the Open level wide aggregate on Performance.gov. Goal OMB and the Office of Science and Science of the Office OMB and also launched (OSTP) Policy Technology clearinghouse for as a Data Open Project tools, case studies,practices, best definitions, obstaclesWhile interaction.³⁰ and community (e.g., limited remain adoption widespread to priorities),³¹ policy competing budgets, agency focus in helped shift agency the policy to datasets releasing simply from open data usability. dataset improving Data Open Project the Additionally, and metrics track launched to was Dashboard the completeness, to related OMB comments data open agency and use of accuracy, POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE customers to help facilitate and help facilitate to customers release. data prioritize Create and maintain an Enterprise an Enterprise and maintain Create Inventory; Data a public data and maintain Create listing; and with engage to a process Create metadata; to support systems information Build and information interoperability accessibility; Use data standards; data Use stewardship information Ensure open licenses; the use of through and extensive core common Use Use machine-readable and open machine-readable Use formats; • • • • • • • • if you cannot inventory your asset, you you asset, your inventory cannot you if asset. your protect or manage cannot use of an Enterprise Data Inventory. This This Inventory. Data an Enterprise use of of is based on the concept requirement A significant component of this policy this policy of component significant A and maintenance, the establishment, was Under the Open Data Policy agencies were were agencies Policy Data the Open Under to: directed “improve the discoverability and usability of of and usability the discoverability “improve “open.”²⁹ making them by datasets existing growth.”²⁸ That same day, OMB issued an same day, That growth.”²⁸ to the need highlighting Policy Data Open to and as an asset” information “manage delivery of efficient and effective services effective and efficient of delivery economic to public, and contributes the to Government Information” with the simple Information” Government government in “openness principle that the promotes , our strengthens an Executive Order titled “Making Open“Making titled Order an Executive for Default the New Readable and Machine Information as an Asset Asset as an Information issued Obama 2013, President 9, May On 2013 — Managing Policy Data Open Open Data and Open Government C-10 prizes and “Datapaloozas” prizes comprehensive a more Introduced data open mechanism for oversight Performance.gov through efforts have sub-goals CAP Data Open Many a or progress agency a lack of shown baseline levels³⁸ decline from holding a reported agencies 17% of public outreach other or datapalooza Q3³⁹ 2016 in FY event data Focused on public outreach through through on public outreach Focused techniques such as incentive innovative • • • • Open Data Action Plan and CAP Goals Plan and CAP Action Data Open Key Strengths Key Challenges Policy Impact strategies and initiatives, the CAP goal CAP the and initiatives, strategies calculated metrics the of many includes a at Dashboard Data Open on Project to in addition level, government-wide For initiatives. related from updates describes actions one sub-goal example, the overall improve to taken have agencies through datasets government of usage Datapaloozas, activities such as outreach and roundtables. code-a-thons, POLICY PAPERS POLICY In May 2014, the 2014, the May In STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE In 2014, the Open 2014, the Open In PortfolioStat). Summarizing performance Summarizing performance PortfolioStat). the aforementioned of many across those measures are not tightly integrated integrated tightly not are those measures (e.g., processes management IT with other Performance.gov website.³⁷ Agency Agency website.³⁷ Performance.gov through has also been evaluated progress but Dashboard, Data Open the Project actions and measures have been published have actions and measures on the publicly-available quarterly implementation and oversight mechanisms oversight and implementation and information open government for on these Progress efforts.³⁶ management Data Cross-Agency Priority (CAP) goal was was goal (CAP) Priority Cross-Agency Data comprehensive more provide to created private sector.³⁵ private Goal. CAP Data Open datasets and to spur additional spur and to datasets the within innovation for opportunities should be prioritized for release. This release. for should be prioritized both to increase was intended effort government released of the usefulness , and private organizations in organizations and private civil society, datasets what solicit input on to order enhancements to specific datasets and datasets specific to enhancements also tasked were Agencies programs. data public, to outreach of level with a greater dedicated Presidential Innovation Fellows, Fellows, Innovation Presidential dedicated detailed and a list of licenses, appropriate sector-specific feedback sessions feedback sessions sector-specific government, outside of with groups open-data- challenges, prizes, incentive Numerous other approaches were also were approaches other Numerous Plan, including Action the by promoted included expanding agencies’ use of “Data “Data use of agencies’ included expanding and “Datapaloozas.”³⁴ (workshops) Jams” many of the Federal government’s government’s Federal the of many committing while date, to accomplishments commitments These initiatives.³³ new to Federal government released the Open Open the released government Federal which summarized Plan Action Data Goals Plan. Action Data Open 2014 CAP Plan and Action Data Open Open Data and Open Government C-11 looking for effective ways to measure the to measure ways effective looking for datasets, released and impact of value thesetranslate to it is difficult that realizing impact. quantifiable into concepts webpages or through in-person events events in-person through or webpages and Datapaloozas. such as recognition a by motivated was this Though of value measuring the impact and that these metrics be important, would datasets rather events counting focus on still results and satisfaction than gathering agency of users external from information datasets. by been augmented have metrics These uses of sector about private anecdotes “Impact” Data.gov’s to posted public data are however, anecdotes, These page. agencies, between compare to difficult thewhat clear make always do not overall to was public data of contribution connects the anecdote how or value, agency or on Data.gov available data to is still government Federal The websites. Lessons Learned Lessons focused OMB Data.gov, of the launch After each by released datasets of number on the however, realized, quickly was It agency. such understand to context additional that the story. part of an important was a count agencies OMB required M-13-13, With all unreleased a baseline of establish to the public count which against datasets be compared. could more creating simply that Realizing of the objective match not may datasets on focus began to agencies area, the policy the feedback from soliciting and measuring means on their electronic public through POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE different efforts and priorities. efforts different metric to evaluate the complete picture picture the complete evaluate to metric on open progress government’s the of these across and open government data Data CAP Goal, and the Project Open Data Data Open and the Project Goal, CAP Data or no single place was there Dashboard, other agency reporting, such as how many many as how such reporting, agency other datasets. had shared the agency at bureaus Open the PortfolioStat, between However, of calculations drawn from their public their from drawn calculations of and inventories, data enterprise datasets, parts of tracking public engagement. public engagement. tracking parts of Dashboard Data Open the Project Finally, based on dozens each agency evaluates counts of and Datapalooza and Datapalooza hackathon of counts important became agencies held by events external organizations to understand how how understand to organizations external datasets. released using publicly are they and usage based on dataset Anecdotes an Open Data CAP Goal which emphasized Goal CAP Data an Open to outreach agency of the importance datasets or percentage of datasets released released datasets of percentage or datasets of years of became a KPI used in a number OMB established Additionally, PortfolioStat. datasets managed internally at each agency agency each at internally managed datasets of count This inventories). data (enterprise Over time, OMB introduced more nuances more time, OMB introduced Over on “high priority” focusing this approach, to all of a baseline and developing datasets Examples datasets. counting focused on efforts Early qualitative anecdotes as well as tracking key key well as tracking as anecdotes qualitative way. along the efforts outputs of measuring outcomes can be difficult. measuring outcomes a series of OMB adopted Therefore, innovation based on government resources, resources, government on based innovation Because engagement. public and increase directly these goals, of the nature of open data and open government has been open government and open data enable external transparency, improve to Metrics and Oversight Metrics in efforts OMB’s of objective primary The Metrics and Oversight and Metrics in Emphasized Objective Primary Open Data and Open Government C-12 dollars…” dollars…” — Agency CIO Agency — hundreds of millions of millions of of hundreds collect this data requires requires this data collect funding for it. To accurately accurately To it. funding for data, but we don’t get extra extra get don’t we but data, Everyone loves the concepts the concepts loves Everyone of open government and open open government of precedence (e.g., (e.g., precedence modernizing strengthening infrastructure, IT agency there Finally, protections). cybersecurity should an agency consequences limited are open government implement to decide not to the compared especially initiatives, or breach a public data from consequences services. in network a disruption FINDING #1 FINDING Difficulty Expressed CIOs Agency Open to Resources in Dedicating Initiatives. Data Open and Government support they that stated CIOs many While behind open government the principles challenges face they efforts, and open data dedicating to resources these initiatives. limited Given support budgets, mission of activities takes POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE

and initiatives. uncertainty in agencies about the in agencies uncertainty of and impact measurement, prioritization, policies and open data open government management, public information access, access, public information management, some has led to This and cybersecurity. can sometimes directly conflict with the conflict directly can sometimes openness in government, principles of with records including those dealing of each other. Additionally, there are a are there Additionally, each other. of and policies that laws existing of number stakeholders that drive government-wide government-wide drive that stakeholders efforts and open data open government independent and simultaneously both may be more urgent. These efforts are are efforts These urgent. be more may of group a large by complicated further government and open data initiatives, initiatives, data and open government limited their focus to have often they that goals policy on other resources Findings in open value see CIOs agency Although Agency Observations and Observations Agency Open Data and Open Government C-13 Overall, the wide range of stakeholders stakeholders of wide range the Overall, to engage CIOs for it difficult can make compliance and ensure in these efforts requirements IT agency with broader and other privacy) cybersecurity, (e.g., recent In addition, the initiatives. policy Officers Data Chief of appointments the adds to only agencies many at complexity. Implementation of the Digital the of Implementation (DATA Act Transparency and Accountability pattern. a similar 2014 follows of Act)⁴⁰ a significant contains this statute While provisions open data IT-related of number being are efforts current CIOs, to relevant community. the CFO by primarily driven and open government of ownership The agency of the outside initiatives open data conflicts to can lead CIO organization and the CIO. leadership agency between POLICY PAPERS POLICY future. Data CAP Goal with GSA and OSTP with GSA Goal CAP Data CAP Data Open Open311, Challenge.gov, Data, Open Project Data.gov, with OMB and OSTP Goal Roundtables, Plans (NAPs), Action National Government Open with OMB Goal Data CAP Open Initiatives,⁴¹ Data” “My Datapaloozas, and GSA People The We Act) (DATA Act Transparency and Accountability Digital Key Initiatives and Projects and Initiatives Key Open Dashboard, IT Policy, Data Open Directive, Government Open

— Agency CIO Agency — is working on open data open data on working is Our enterprise architect architect enterprise Our STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE public data sets… but I’m not but I’m not sets… public data now, open data is not a high- is not open data now, but I think there will be more will be more but I think there efforts, and we release limited limited release we and efforts, value initiative for our agency, agency, our for initiative value personally focused on it. Right on it. Right focused personally focus on this policy area in the area on this policy focus Key Organizations in Government-wide in Organizations Key Initiatives Data and Open Government Open Administration Financial Federal of OMB - Office (OFFM) Management Technology Policy (OSTP) Policy Technology of Office House White The General Services Administration (GSA) Administration Services General and Science of Office House White The OMB - Office of the Federal Chief Chief Federal of the OMB - Office (OFCIO) Officer Information Lead Organization Lead significant engagement from the OFCIO or or the OFCIO from engagement significant the CIO Council. In addition, GSA, OSTP, and the White White and the OSTP, addition, GSA, In open government lead numerous House without often efforts, and open data agency CIO agency organization. without needing the the support of open data open data initiatives, officials can officials independently out carry the traditional CIO community. Program Program community. CIO the traditional agency other mission leads, and offices, Open government and open data tools tools and open data government Open available widely are and applications outside stakeholders by and accessible The Broad Range of Stakeholders Stakeholders of Range Broad The Governance. Complicates FINDING #2 FINDING Open Data and Open Government C-14 websites such as the Project Open Data Data Open such as the Project websites been a primary not have they dashboard, do As such, CIOs PortfolioStat. of focus as efforts these of measurement see not of as the number OMB, even for a priority in this policy and initiatives requirements expanded. has area FINDING #4 FINDING and Open Government Open of Outcomes Gauge. to Hard Be Can Efforts Data open of the adoption to challenge Another initiatives data and open government assessing directly in is the difficulty is civic impacts.⁴² It and economic their measure to directly difficult inherently and economic as broader well as outcomes and sets data releasing of social impacts As such, information. government other has been on measuring focus the primary datasets of number (e.g., leading indicators and highlighting on Data.gov) released the across and anecdotes stories success open While sectors.⁴³ public and private and Goals via CAP is tracked progress data public-facing Government-wide various POLICY PAPERS POLICY STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE government and open data efforts. and open data government struggling to balance adherence to legacy legacy to adherence balance to struggling open of in the context policies and laws datasets, despite the fact that each that the fact despite datasets, contain does not data of individual piece are CIOs Ultimately, information. sensitive sensitive information to be derived to be derived information sensitive multiple public of the combination from Furthermore, as more datasets are are datasets as more Furthermore, – can emerge challenges new released, which allows such as the “mosaic effect”, could inadvertently create vulnerabilities vulnerabilities create inadvertently could information. confidential expose or implementation of open data initiatives. initiatives. data open of implementation expressed CIOs agency instance, For datasets of the release that concern data sources in a digital government. digital government. in a sources data agency complicate can tension This the advent of modern technologies and technologies modern of the advent the ease for account necessarily did not connecting and sharing, collecting, of various records management policies and policies management records various to established prior were requirements Paperwork Reduction Act (PRA) of 1995, of Act (PRA) Reduction Paperwork Act (FOIA) Information of the Freedom 1974, and of Act 1966, the Privacy of with Open Data Efforts. Data with Open such as the and policies statutes Existing FINDING #3 FINDING Conflict Can Statutes Policies and Existing Open Data and Open Government - - - - - C-15 - - -

http://cat https:// ). Additional Additional ). https://www.

https://www.challenge. https://www.WhiteHouse. https://itdashboard.gov/drupal/ https://www.data.gov/metrics

https://www.whitehouse.gov/open/ http://www.data.gov/impact/ https://www.data.gov/impact/ https://www.whitehouse.gov/the_press_of https://www.whitehouse.gov/sites/default/ . See also, “Digital Government: Building a Building Government: also, “Digital . See https://www.whitehouse.gov/blog/2009/05/21/ https://www.whitehouse.gov/sites/default/files/

. President Barack Obama. “Transparency and Open Govern and Open “Transparency Obama. Barack President 1/21/2009. ment”. fice/TransparencyandOpenGovernment 12/8/2009. Directive. Government Open M-10-06. www.whitehouse.gov/sites/default/files/omb/assets/memo randa_2010/m10-06.pdf 7/14/2016. Plans. Government Open Agency M-16-16. 2016 https://www.whitehouse.gov/sites/default/files/omb/memo randa/2016/m-16-16.pdf Data”. “Democratizing Blog. House White The Orszag. Peter 5/21/2009. democratizing-data Consumer, Climate, Business, Agriculture, are: sectors These Gov Local Health, Finance, Energy, Education, Ecosystems, and Science Safety, Public Ocean, Manufacturing, ernment, Topics”. “Browse Data.gov. Source: & Research. data.gov/ 186,467 datasets of the total 20%) of has 36,529 (or Data.gov Catalog”. “Data Data.gov. Source: format. in PDF are Office of Management and Budget. FY 2012 Report to Con to Report FY 2012 Budget. and Management of Office of Act The E-Government of on the Implementation gress 2002. 3/2013. files/omb/assets/egov_docs/fy12_e-gov_act_report.pdf Data.gov. “Impact”. “Impact”. Data.gov. “Metrics”. Data.gov. Source: Savings”. “Cost Dashboard. IT cost-savings Plans”. Action National Government “Open Whitehouse.gov. 11/4/2016. Retrieved partnership/national-action-plans can be highlights) initiative stories, (success data Anecdotal ( on Data.gov found and Dashboard Data Open on Project can be found measures on Performance.gov as reported updates Goals CAP the quarterly and ad the site developed with OSTP, in consultation GSA, available. currently 700 challenges the approximately ministers Challenges”. “Newest Challenge.gov. gov Gov”. “Digital Whitehouse.gov. gov/DigitalGov People”. American the Serve Better to Platform 21st Century 5/23/2012. omb/egov/digital-government/digital-government.html also emphasized the strategy APIs, and to data addition In support to development and improving usage mobile device the mobile experience. alog.data.gov/dataset#sec-res_format 10. 11. 12. 13. 14. 15. 24. 16. 17. 18. 19. 20. 21. 22. 23. ------POLICY PAPERS POLICY https://www. . The site site The . http://www. and provides details details and provides

http://www.mckinsey.com/ https://www.statista.com/

STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE https://www.gpo.gov/fdsys/pkg/ https://s3.amazonaws.com/app_perfor https://www.whitehouse.gov/the_press_of https://www.gpo.gov/fdsys/pkg/PLAW- https://www.whitehouse.gov/sites/default/

Open%20Data%20FINAL.pdf Performance.gov. “Cross-Agency Priority Goal: Open Data”. Data”. Open Goal: Priority “Cross-Agency Performance.gov. 2016 Q3 Update. FY mance_prod_ahwdtloxcxcy/s3fs-public/FY%2016%20Q3%20 Service, U.S. Geological Survey, Natural Resources Conserva Resources Natural Survey, Geological U.S. Service, Administration. Space and Aeronautics National Service, tion Corporation”. 500. “Climate Data Source:Open opendata500.com/us/climate-corporation/ In one example of data-driven entrepreneurship and innova entrepreneurship data-driven of one example In National from the data utilizes Corporation tion, the Climate Weather National Administration, Atmospheric and Oceanic information contained on USASpending.gov to include nearly to include nearly on USASpending.gov contained information Account 113-101. Digital Law Public expenditures. all federal 2014. 5/9/2014. of Act Transparency and ability gpo.gov/fdsys/pkg/PLAW-113publ101/content-detail.html regarding spending on Federal contracts and grants. The site site The and grants. contracts spending on Federal regarding the of the Department to GSA from transferred recently was Transpar and Accountability the Digital to pursuant Treasury the expanded also greatly Act DATA The Act). (DATA Act ency Accountability and Transparency Act of 2006. Public Law 109– Law 2006. Public of Act Transparency and Accountability of Act Transparency and Accountability Funding 282. Federal 2006. 9/26/2006. 109publ282/pdf/PLAW-109publ282.pdf the beginning of the year. Source: Regulations.gov. “Site Data.” Data.” “Site Regulations.gov. Source: year. the the beginning of https://www.regulations.gov/siteData Funding the Federal under created was USASpending.gov and allows the public to comment on proposed rules. As of As of rules. on proposed the public to comment and allows on posted regulations most-commented 11/1/2016, the five since comments 704,531 public received had Regulations.gov E-gov Act of 2002. Public Law 107-347. The E-Government E-Government The 107-347. Law Public 2002. of Act E-gov 12/17/2002. 2002. of Act PLAW-107publ347/pdf/PLAW-107publ347.pdf online in a single location rules available all proposed makes statistics/199890/revenues-of-gps-equipment-in-the-united- states-since-2005/ of the Section 206 to pursuant was created Regulations.gov ta-unlocking-innovation-and-performance-with-liquid-infor mation “Statistics”. NPD Group. Source: and gas, Healthcare, and Consumer finance”. McKinsey Global McKinsey finance”. and Consumer and gas, Healthcare, and performance Unlocking innovation data: “Open Institute. 10/2013. with liquid information”. business-functions/digital-mckinsey/our-insights/open-da According to a 2013 private sector report, “Open data can data “Open report, sector a 2013 private to According annually value to $5 trillion in economic help unlock $3 trillion “Ed were: listed sectors diverse The sectors.” seven across Oil Electricity, products, Consumer Transportation, ucation, President Barack Obama. “Transparency and Open Govern and Open “Transparency Obama. Barack President 1/21/2009. ment”. fice/TransparencyandOpenGovernment https://www.gpo.gov/fdsys/pkg/USCODE-2012-title5/html/ USCODE-2012-title5-partI-chap5-subchapII-sec552.htm is the Act (FOIA) of 1966, which pro 1966, of Act (FOIA) Information of is the Freedom government their of records the to access with public the vides Rules, Agency Information; Public § 552. 5 U.S.C. leaders. 2012 edition. and Proceedings. Records, Orders, Opinions, Asset. 5/9/2013. Asset. files/omb/memoranda/2013/m-13-13.pdf area in this efforts well-known and most the earliest of One M-13-13. Open Data Policy — Managing Information as an Information — Managing Policy Data Open M-13-13.

9. 8. 7. 6. 5. 4. 3. 2. 1. Notes Open Data and Open Government - - - - C-16 - - https://sun

for examples for https://www.gpo.gov/fdsys/pkg/ https://www.performance.gov/content/ https://s3.amazonaws.com/app_perfor https://www.whitehouse.gov/the-press-of https://data.gov/impact https://s3.amazonaws.com/app_performance_prod_ahwdt loxcxcy/s3fs-public/FY%2016%20Q3%20Open%20Data%20 FINAL.pdf Transparency and Accountability 113-101. Digital Law Public 5/9/2014. 2014. of Act PLAW-113publ101/pdf/PLAW-113publ101.pdf healthcare) (for Button Blue such as the initiatives, Data” “My to give designed are usage), energy (for Button and Green data personal own their to access electronic secure Americans measuring the impact of to approach new “A Keserű. Júlia 5/5/2015. Foundation. Sunlight The open data”. In 2016 alone, the White House and OSTP have highlighted a highlighted have and OSTP House White alone, the 2016 In partner occurring in initiatives public data-related of variety the Initiative, Data the Police including: with agencies, ship Day Data Open Summit), (and Initiative Medicine Precision Datapaloo House, Camp Open Summer Data DC, the Open leaders. with industry roundtables open data various zas, and for the People, by Data Sheet: Fact House. White The Source: Government Opening Progress of Years — Eight the People Growth. Economic & Opportunity, Innovation, Spur to Data 9/28/2016. fice/2016/09/28/fact-sheet-data-people-people-eight-years- progress-opening-government OFCIO, by by is shared Goal CAP Data the Open of Ownership Transportation of Department and the OSTP, Data”. Open Goal: Priority “Cross-Agency Performance.gov. 2016 Q2 Update. FY open-data#supporting-info Data”. Open Goal: Priority “Cross-Agency Performance.gov. 2016 Q3 Update. FY mance_prod_ahwdtloxcxcy/s3fs-public/FY%2016%20Q3%20 Open%20Data%20FINAL.pdf 2016 Q3 Update. FY Data”. Open Goal: Priority “Cross-Agency lightfoundation.com/blog/2015/05/05/a-new-approach-to- measuring-the-impact-of-open-data/ See: 40. 41. 42. 35. 36. 37. 38. 39. 43. ------POLICY PAPERS POLICY https://www. . This method of of method This . https://www.whitehouse. STATE OF FEDERAL IT REPORT / PUBLIC RELEASE VERSION 1.0 / PUBLIC RELEASE REPORT IT FEDERAL OF STATE https://labs.data.gov/dashboard/offices https://project-open-data.cio.gov/ https://web.archive.org/web/20130417085852/ https://www.data.gov/safety/white-house-safety-dat https://www.whitehouse.gov/sites/default/files/mi https://www.digitalgov.gov/services/dap/dap-digital-met who have utilized the government’s datasets to build useful to build useful datasets government’s the utilized who have Data.gov. and applications. services, products, and creative “Safety”. apalooza crosites/ostp/us_open_data_action_plan.pdf to highlight intended events informational are Datapaloozas and academic sectors nonprofit, within the private, innovation Data.gov. “Dashboard”. “Dashboard”. Data.gov. 5/9/2014. Plan”. Action Data Open “U.S. House. White The pp. 2-6. finding below: “Agency CIOs Expressed Difficulty in Dedicating Dedicating in Difficulty Expressed CIOs “Agency finding below: Initiatives” Data and Open Government Open to Resources Project Open Data. “Open Data Policy — Managing Informa — Managing Policy Data “Open Data. Open Project Asset”. tion as an these obstacles, see the of explanation detailed a more For https://www.whitehouse.gov/the-press-office/2013/05/09/ executive-order-making-open-and-machine-readable-new-de fault-government- ing-open-and-machine-readable-new-default-government- Read and Machine Open “Making Obama. Barack President 5/9/2013. Information”. Government for Default able the New President Barack Obama. Executive Order 13642: Making 13642: Order Executive Obama. Barack President Govern for Default the New Readable and Machine Open 5/9/2013. Information. ment gov/the-press-office/2013/05/09/executive-order-mak Digital.gov. “DAP: Digital Analytics Program”. Program”. Analytics Digital “DAP: Digital.gov. digitalgov.gov/services/dap/ Digital.gov. “DAP: Digital Metrics Guidance and Best Practic and Best Guidance Metrics Digital “DAP: Digital.gov. es”. rics-guidance-and-best-practices/ information about government-wide data center consolidation consolidation center data government-wide about information Infrastruc IT B: Chapter Policy see policies, and optimization Modernization ture http://www.itdashboard.gov/digitalgov would be reporting automated real-time publicly-transparent implementing progress agency measure OMB to by used later more For Initiative. Consolidation Center and the Data FITARA in real-time and summarized government-wide progress progress government-wide and summarized in real-time was summary this however performance, and each agency’s ar through Available in 2015. Dashboard the IT from removed at: chive.org OMB’s IT Dashboard then aggregated agencies’ reporting reporting agencies’ then aggregated Dashboard IT OMB’s 34. 32. 33. 30. 31. 29. 28. 27. 26. 25.