BIG DATA TO SMART CITY: RECOMMENDATIONS TO COR

Brazil International Laboratory 2017 Price School of Public Policy University of Southern California Photo: Claude Mazé Submitted to Centro de Operações do Rio (COR) on June 2, 2017

Authored by: Alexander Yee, Andrea Avila, Fazrin Rahman, Gabriel Armsted, Jennifer Roglà, Leigh Adamo, Martha De La Torre, Max Sherman, Nicholas Ryu, Radin Rahimzadeh, Rui Zhang, and Suhail Alrashidi.

Acknowledgements: We would like to thank COR for providing us with their time and resources. Roger that.

A special thanks to Mr. Pedro Seixas and Dr. Antonio Bento for coordinating our visits and faciliting the creation of this report.

Muito obrigada(o)! EXEC SUMMARY

EXECUTIVE SUMMARY COR has an opportunity to build upon its intial successes and establish itself as an innovative Since a landslide tragedy in 2010, the city of and indispensible agency for the city. , , has been heavily using information and communication technology Background to bring the government closer to the citizens under the umbrella of its Smart City Plan. It COR brings together 30 of the municipality’s has enabled solutions that are helping the city departments along with private suppliers in to become more inclusive and to provide a a single monitoring room. Here they track better quality of life. real-time conditions in the city, and coordinate responses to emergencies and disruptions. The basis for the development of the Smart Other cities have similar projects – Madrid has City Plan for Rio de Janeiro was the expansion one control room for police, fire and ambulance of the local government’s telecommunications services – but none are as big or broadly network, which has intensified the presence operational as that of Rio. of the government throughout the city, along with a digital inclusion program, an important Information is shared real-time between indicator that tracks the population’s access to city staff from various departments – from new technologies particularly in disadvantaged transportation to sanitation, health to communities across the city. emergency services – as well as with the private contractors that own the transit lines, Among the smart services offered by the do road work, and collect trash. For example, municipal government are the monitoring staff from RioÁguas - the City entity tasked and operation of the city’s operations center, with preventing floods - monitor the level of the Centro de Operações or COR, which enhances rivers; the CET-Rio traffic agency keeps tabs integration between agencies and utilities, on vehicle flow via the video wall, changing supporting the local government’s decision- traffic lights if necessary and calling field making processes. agents to manage accidents as soon as they happen. Upstairs is a room for journalists, who can access much of the same information – effectively acting as COR’s megaphone, and helping crowdsource information back to COR’s systems (Frey, 2014).

COR serves as the city’s nerve center, applying analytical models to more effectively anticipate and coordinate emergency responses.

COR’s social media outlets also provide frequent updates on weather and traffic, as well as recommended alternative routes around A giant wall monitor is broken into a grid showing status the city on days of special events including graphs, meteorological reports and live video feeds from concerts, soccer matches and festivals. traffic and CCTV. Photograph: David Levene

4 SWOT ANALYSIS

‘SWOT’ Analysis of COR officially “illegal,” since residents often do not own the land they built their homes Strengths upon, and yet the communities are also openly tolerated, as they provided affordable The strength of COR is its ability to integrate housing options for the urban poor (Penglase, many departments involved in Rio’s daily 2009). This is imperative because 23-34% management; and to manage crisis and of the city’s population (around 1.5 million) emergency situations. COR’s ability to manage lives in vulnerable low-income communities, crisis and emergency situations is a globally most of which are located on slopes which recognized strength. COR also provides and become hazardous in intense rain (Catalytic exchanges information with the public through Communities, n.d.). the media and social networks. The public reaps great value from these services, and has Opportunities the opportunity to contribute to the improving these services by submitting crowdsourced An opportunity for COR to enhance its capacity information (Harrison et al., 2012). These to serve the people of Rio is to mobilize strengths allow COR to be a cutting edge universities partnerships to improve service organization with the potential to drive delivery. Cooperative university links could innovation. help develop a data science workforce that will help COR innovate its services in the future. Weaknesses These links strongly rely on both informal personal networks and formal organisational Current statistics from COR’s and structures (Turpin et al., 1996). The page illustrate a potential weakness in implementation of a cooperative university- terms of COR’s social media outreach. Rio de government link could increase COR’s working Janeiro has a population of almost 6.5 million capacity that will enhance service delivery and people in the city of Rio de Janeiro (IBGE, would be aligned with Rio’s long-term strategic 2010), while there are 290,566 Facebook plan to become a smart city model, that invests followers. Their page is still new, created in in innovation and efficiency for a sustainable, 2015, and has been accessed approximately inclusive and resilient urban administration. 4,000 times to date, revealing the need to continue expanding COR’s social media outreach.

Equitable delivery and access to services in low income communities is a weakness that requires special attention due to the proliferation of informal housing developments in the City of Rio de Janeiro. These neighborhoods have long occupied an ambiguous grey zone in Rio de Janeiro, at once not own the land they built their homes upon, and yet also openly tolerated, as they were

5 SWOT ANALYSIS PEOPLE & PARTNERS

COR now needs to develop a Post-Olympic mission that will equitably serve the citizens of Rio de Janeiro in COR’s day to day functions. According to the Stanford Innovation Review, a good mission statement is about the what, not the how (Starr, 2012). This would be an excellent opportunity for COR because the organization can reconsider its mission statement and rebrand itself as it enhances its social media outreach.

Threats

Threats that will impede the progress of COR are directly related to having a small staff, which could lead to systemic failures for COR. A small critical emergency response team could lead to productivity loss due to the intense amount of mental capcity such work demands. This could adversely impact the effectiveness of COR’s information communication technology systems in a time of crisis, disaster, and risk management. Additionally, Kahn (1990, 2010) describes engagement as the harnessing of people’s selves to their work, such that they fully invest their physical, cognitive, and emotional resources in their work roles. Ensuring employees are engaged and fully attentive to their tasks will be an ongoing challenge for the small direct COR team. ~~~~~~~~~~~~~~~~ COR’s ample strengths can be built upon when addressing the weaknesses, opportunities, and threats considered here. In particular, COR’s wide experience with partnerhsip building with other City agencies as well as private companies can be leveraged and expanded. The next section will consider who are COR’s current stakeholders, who are their potential partners, followed by our vision for this report. We will then consider three main areas for our COR recommendations: smart data capacity, indicators, and communication to stakeholders.

6 7 PEOPLE & PARTNERS

PEOPLE AND PARTNERS

COR’s general categories of partnerships are laid out in the above figure. When considering their current partnerships, consistent engagement, communication, and performance measurement of internal and external stakeholders will help maintain support, advocacy, and mutually beneficial partnerships.

Yet COR has an opportunity to increase their number of external stakeholders by fostering meaningful partnerships and pushing forward collaborative efforts. Additionally, COR can work towards measuring the productivity of their internal partnerships, and evaluate the overall processes of COR to identify opportunities and develop best partnership practices.

VISION FOR RECOMMENDATIONS

To identify and strategically focus how city management in Rio de Janeiro,

specifically Centro de Operações Rio (COR), can use big data to promote

resilience and smarter city growth consistent with COR’s mission.

7 SMART DATA SMART DATA

Most of the data out there is unstructured and SMART DATA & OPEN SOURCE it is only with artificial intelligence and ana- lytics that that data can be turned into mean- ingful data or smart data that can be used for Recommendations proactive policy-making, rather than reactive Require partners to collect more variables re- policy making. Multiple layers of intelligence lated to the same data points can be built into the big data that is collected to Ex. Populations in the same area who process, analyze, store, interpret and improve experience a shock differently because the data and effectively make the data point to they live at different points in elevation. nuanced patterns and information that is very Facilitate partnerships with universities to useful (Shumpeter, 2011). create guideline for data sharing Recommend partnerships with data science The exciting potential to make use of big data startups to help organize, store, visualize data is highlighted in its participatory possibility Create PENSA 2.0 within COR to facilitate that gives not only policymakers a voice, but data flows and also allows for citizens to contribute data that analysis. The team will continue to include: 1) highlights their urgent needs to their repre- Strategic planning 2) Data analysis 3) Research sentatives. Better resource allocation, mitiga- 4) Public policy development forecasting tion and/or response to issues allow for more resilient cities, cost-effective policy practice, From Big Data to Smart Data and most importantly, higher quality of life for constituents. That is, a smart city should be The Case for Rio’s Open Source Portal able to actively generate smart ideas in an open environment through fostering open data that Initiatives achieved towards building a smart will directly involving citizens in the co-creation city democratize the policy making process and process of public policies or services (Bakici shift the old world order where policy makers et. al, 2013). In order to create an optimal open influenced the data that would be collected to source portal that would make smart data a new paradigm where the data allows for the available, there are two requirements: 1. Data formulation of robust policy questions. Howev- collected must be aggregated measure for equi- er, with this new shift in paradigm comes new ty and 2. The scope of the data must extend in challenges to address. scale over a longer time horizon.

8 SMART DATA

Data equity federal and local institutions. Each subcom- mittee has a maximum of 20 working days to Big data has similar issues to existing data. complete fieldwork, to document and photo- Large data sets aggregate data points that lead graph damage using GIS devices, and to itemize to obscure models that make broad assump- reconstruction needs and the related costs. tions and forecasts (Shumpeter, 2011). As When the full damage assessment is being mentioned, smart data, data that is disaggregat- completed, a timely report is sent to the appro- ed, has the potential to describes the distinct priate governing and a viable request for fund- experiences of diverse populations, especially ing is created, allowing for the government to with relationship to providing better policy forecast an optimal financial strategy per fiscal solutions for city-wide resiliency. Having sound year (Global Facility for Disaster Reduction and and disaggregated data available to be properly Recovery, 2014). analyzed by data scientists, academics and pol- icy makers, allows policymakers to focus in on Data.Rio Scope certain groups, devising policies and allocating resources to meet their needs (Citiscope, 2017). In order for the data collected by the city of Rio The more that policymakers can understand de Janeiro to become meaningful, COR needs about the lived experience of citizens of varying to not only standardize the method in which sex, age, disability status and location (to name partnering agencies collect data but also re- a few), the more they can do to ensure the quire that the data be collected over longer time vulnerable are not left behind and tailor policy horizons per agency. In partnership with Data. solutions for particular demographics (Citi- Rio, COR can advocate for the better organiz- scope, 2017). To tackle the issue of data equity, ing and streaming of multi-agency data and COR is positioned to create a set of standard- also, work with the agency to apply machine ized indicators that can be shared across agen- learning and visualization tools through part- cies partnering with COR to forecast long-term nerships with Universities to produce acces- risk what affect this risk would on populations sible and easy to understand analysis to the even accounting for differences among those public. In order to create the best open source who live in the same neighborhood. Collecting portal, COR has the opportunity to facilitate the disaggregated data will also lend to better re- growth and scale of data.rio. It would be to the source allocation and cost savings for the city. advantage of the city, as well as private part- ners and citizens for this expansion that would An example that allows for optimal resource also create transparency, expose data vari- allocation is demonstrated in the case of cities ability, enable for better simulation and help that are prone to natural disasters. This data partnering public and private sector partners will allow for pre-and-post disaster evaluation to segment populations and thus to customize that will encourage adequate and immediate more meaningful actions and policies for them. funding once more precise social and monetary In order to facilitate the expansion of Data.Rio, costs are determined. This pre/post evaluation it is critical that data is: 1) Complete: All public will also encourage investment and implemen- data is made available. Public data is not sub- tation of mitigation and adaptation methods to ject to limitations, 2) Primary: Data is as col- reduce future risk and high costs. In the case of lected at the source, with the highest possible Mexico and the World Bank, a Disaster Assess- level of granularity, not in aggregate or modi- ment Committee (DAC) was created before a fied forms. 3) Timely: Data is made available as disaster struck which consisted of sectorial quickly as necessary to preserve the value of

9 SMART DATA SMART DATA

of the data. 4) Accessible: Data is available to Models for Success: Funding Structure & Po- the widest range of users for the widest range litical Capacity Building of purposes. 5) Machine processable: Data is reasonably structured to allow automated The smart city open data portal will be success- processing. 6) Non-discriminatory: Data is avail- ful if two key components of its structure are able to anyone, with no requirement of regis- met: funding and political capacity building. tration. 7) Non-proprietary: Data is available In the era of public-private partnerships, it is in a format over which no entity has exclusive possible to identify strategic collaborations that control. 8) License-free: Data is not subject would render many positive external returns to any copyright, patent, trademark or trade to the city and the stakeholders involved. Even secret regulation. Reasonable privacy, securi- more crucial is achieving buy-in from bureau- ty and privilege restrictions may be allowed cratic champions of innovation within the city (Smart City Open City Guide, 2017). In the case government itself build political capacity and of Singapore (identified as a leader in smart city move smart city initiative forward in a timely initiatives), over 100 apps have been developed fashion. through integration of government data. Private sector application developers have utilized data Funding Structure from the Land Transport Authority to create The funding structure that is recommended apps that inform motorists about car park avail- is one that will allow for multi-sector deci- ability and road pricing. Community groups sion-making and drive public policy solutions have created apps for topics that add value to and projects that target resiliency goals, benefit the public by informing citizens of options and a diverse public and motivate capital to contin- warning them of potential encounters (e.g. ue funding such projects (Plastrik and Wylde, clean public toilet locations and street cats). 2001). The model is inspired by the corpo- Lastly, a collaboration between People’s Associ- rate-civic investment fund that was established ation and Civil defense force that alerts first re- by New York City in the early two thousands. sponders to perform CPR before the ambulance With adequate and sustained funding, COR will arrives (Singapore Public Data, 2017). become not only a big data

10 SMART DATA

facilitator between its partners but also a big Political Capacity Building data service provider by contributing to the cleaning and analytical reports after process- Although external partners are critical to col- ing the data. The funding model takes shape lecting meaningful data, implementing useful as sector experts are identified and invited to public policy projects and ensuring sustainable pool their capital to a city fund. These sector funding, building relationships within city experts will choose high potential civic proj- government is crucial to scaling an innovative ects that target resiliency goals. The internal government agency in a smart city context that analytics team that resembles the prior or- is gradually evolving. The model of capacity ganization of PENSA, will create metrics to building that is recommended is to: 1) identify gauge the effectiveness of the selected projects visionary bureaucrats, 2) create a feedback through measurements of the projects such loop, 3) optimize city government operations as: cost-benefit analysis, level of citizen satis- and 4) ultimately scale COR. Due to limited city faction and relative changes to resilience. As funds, it is important to identify other bureau- the number of projects grow, the relationship crats across local government to champion the between private capital, public problem-solvers necessity for COR across the government. The and [smart] big data city government capacity creation of a feedback loop that allows for em- will solidify and persist to fund further proj- ployees across the government to consistently ects. The increasing number of projects would ask questions about the work of COR and its then encourage partnerships with sister cities impact, is crucial for the growth of COR. This to share best practices and initiatives to coordi- feedback loop creates better coordination and nate data sharing and city to city projects. The communication across the government and as last value add in this structure is the availabili- a positive externality, optimizes the operational ty for the city of Rio to monetize its data which methodology both with in COR and between allows for yet another stream of return of COR and other departments, highlighting the investment to both COR and the city of Rio by viability of COR. Lastly, with the positive con- providing tailored analysis to agencies. tribution of COR to the government space, COR will be encouraged and assisted in its team and capacity expansion.

11 SMART DATA SMART DATA

Recommendation role within the strategic plan will promote the idea of a mutually beneficial a partnership. The Increase COR’s strategic partnerships and Stakeholder table lists COR’s current Inter- measure the success of the agency by imple- nal and External Stakeholders and their level menting Scorecards to evaluate performance in of awareness of COR’s value. The chart also terms of ‘value provided to stakeholders’ and includes each stakeholder’s sphere of influence further identify best practices. and role within COR’s strategic plan. We recommend that COR facilitate partner- ships with data science start-ups and Academic Institutions to sustain operational integration, actionable intelligence and, social participa- tion.

Stakeholder Analysis

The Operation Center in Rio de Janeiro is essential to providing Rio with information about situations and proposing quick solutions to minimize inconvenience and save lives. In order to make this mission possible and sustain its current and future operation, COR must en- sure the needs and criteria of its stakeholders are met (Bryson, 2011). This analysis follows Bryson’s (2011) Basic Analysis Technique by, further developing a vision for what exactly COR is planning to accomplish, identifying The influence that COR’s Stakeholders have on the current and potential stakeholders of the the agency is further broken down by using the agency, and communicating the specific vision “Power vs. Interest Grid”, which helps visu- with them. It is also important to consider the alize the various levels of interest and power criteria each stakeholder may use to assess among stakeholders. Further to the right, we COR’s value and evaluate the organization’s find stakeholders with both direct and indi- performance internally against that criteria. rect power over COR’s initiatives, and higher By sharing expected outcomes and strategic up, we find stakeholders with more interest in goals with stakeholders during the planning the success of COR (Ackerman, 2011, p. 183). In- phase, COR can showcase a clear vision of creasing the number of valuable partnerships what they are working to accomplish and what and ‘Players’ within COR is achieved by foster- collaborative initiatives will enable COR to ing relationships, improving communication achieve its mission. COR will have more sup- and increasing engagement opportunities. By port and trust from its stakeholders if there is sustaining valuable partnerships and main- an increased clarity of the agency’s purpose. In taining Stakeholder interest, COR will increase addition, characterization of the stakeholder’s the number of financial investments received, improve overall funding mechanisms, boost visibility, and strengthen its operation.

12 SMART DATA

Value of External Stakeholders Additional resources (financial, research, content knowledge/expertise) Improved funding mechanisms will provide COR with the tools needed to implement the ‘Smart City’ recommendations put forth by The Inter-American Development Bank (De Lancer Julnes, 2006). Improved Stakeholder communication will help reiterate COR’s mission and confirm Stakehold- er’s understanding of COR’s purpose. Individual and agency partners are far more likely to advo- cate on behalf of COR to potential investors/partners, community leaders, and citizens. Value of Internal Stakeholders The value of COR’s Internal Stakeholders can be measured and increased through the utilization of Balanced Scorecards. Scorecards can also measure COR’s success by evaluating the entire in- ternal process, and providing the agency with a better understanding of which areas are success- ful and which areas need improvement. By measuring the productivity and performance of COR’s Internal Stakeholders, COR has the abil- ity to utilize these results to implement and achieve its goals more effectively. This creates further opportunities for the growth and development of COR’s staf which is important to address based on the limited number of staf members due to budget constraints.

13 SMART DATA SMART DATA

Potential Academic & Data Science Partnerships Implementation Case Study: University-Government Partner- ships in Support of State Reform- Lessons from In terms of partnering with outside universities the Caribbean or other research institutions, we recommend COR pursue three options in order to minimize While working towards the implementation of the amount of resources needed to develop University-Government partnerships, it would be these relationships while still maximizing po- helpful to examine the multi-party partnership tential benefits. between the Universidad Autonoma de Santo Domingo, two Government Institutions within 1. Focus on partners with resources who have the Dominican Republic, and Utah State Univer- already expressed interest in working with sity in the Unites States. This mutually beneficial COR. partnership was initiated to support government Based on our site visits, it is clear that COR’s reform efforts in the Dominican Republic and for technology is not only one-of-a-kind in Brazil, Utah State University to position itself as a “cre- but in the entire world. As we heard, a number ator and dissemination of knowledge” (De Lancer of research institutions and universities have Julnes, 2006). Although the multi-party partner- been ready and excited about collaborations ship initially faced several challenges, such as, with COR. COR should ask about the sort of the lack of internal capacity of the Universidad funding structure those partners envision, to Autonoma de Santo Domingo, external politics, understand if they partner is willing to con- and economic concerns (De Lancer Julnes, 2006). tribute resources, human or material, to these However, the ‘Lessons from the Caribbean’ case collaborations. Typically these institutions study displays the value of new partnerships and will already have some funding ready for joint different perspectives, which in this case, stimu- projects, or outside researchers seeking a rela- lating the City’s development agenda (2006). tionship at the very least will not expect COR to provide them with any additional funding, and only limited staff time. This means that COR can capitalize on research possibilities with just a small investment of staff time (Rogla, 2017).

2. Focus on trilateral relationships between COR, Brazilian universities, and a foreign university. This option allows COR to have a local uni- versity partner, but still capitalize on funding possibilities and additional levels of expertise from researchers at foreign universities. If COR has not already been approached by local universities seeking to carry out collaborative projects, they should consider reaching out to the international relations unit of a local univer- sity, letting that unit know that COR would like to partner both with the university but also

14 15 SMART DATA

capitalize on one of the applicable internation- Typically these relationships begin with sim- al partnerships the university already has in ple talks about collaboration probabilities and the areas of planning, policy, or other types of goals of each side for the partnership. Ten public administration and/or transportation. partner organizations sign a memorandum For example, FGV-EASP has an International of understanding (MOU) that lays out more Relations Office, and already partners with the details of collaboration, including more tech- University of Southern California Price School nical aspects such as any intellectual property of Public Policy, which provides joint project concerns. Typically the legal arms of each or- possibilities with local participation and thus ganization get involved, but only to ensure the increased sustainability, combined with the language in the agreements is accurate, and you additional funding and expertise of a foreign can request identical agreements be signed in university (Rogla, 2017). multiple languages. If it is a foreign university, their international ofce will also typically help 3. Focus on international intergovernmental facilitate these agreements and/or the collabo- initiatives related to COR’s mission. ration overall. Once you have an initial MOU in place, the groundwork is laid for the part- The United Nations Office for Disaster Risk Re- nership, and sometimes partners choose to sign duction (UNISDR), in partnership with the Eu- project-specifc agreements as collaborations ropean Commission, IBM, AECOM and others, move forward. While an initial MOU is not came out with a new Disaster Resilience Score- always necessary, the more complex the proj- card for Cities tool in May 2017 (UNISDR 2017). ect is, it is a best practice to put an agreement Rio de Janeiro is one of the participants in the into place to ensure projects are completed and UNISDR Making Cities Resilient program, and completed in the way desired by both partners is most likely one of the few cities that has (Rogla, 2017). enough data to complete this very comprehen- sive new scorecard tool. The City could apply to move to ‘Role Model’ status, which may Value of Performance Management provide notoriety that will raise the profile of the City to increase the number and quality of Case Study: United Nations Office for Disaster partnerships in the future. The City could addi- Risk Reduction tionally reach out to the agency asking if there are any other pilot initiatives or tests that COR Balanced Scorecards are a set of detailed level could participate in on behalf of Rio de Janeiro. assessment tools that allow local governments Participation in pilot programs may come with to monitor and review progress and challenges. additional resources in the form of technical The Scorecard examples provided for COR are assistance or funding that could help COR based on the UNISR Scorecards implemented move forward on its goals, especially in terms to measure the ‘Ten Essentials for Making Cit- of prediction or creating simulations. ies resilient’. In this specific case, Scorecards measured and displayed the risk scenarios for each of the identified city hazards and prompts agencies to understand its “most probable” and “most severe” areas of concern (UNISR, 2017). Scorecards also measure city responses to each risk scenario (pre and post) to measure and improve its efficiency.

15 SMART DATA SMART DATA

COR’s performance has many complex compo- One way COR can enhance its measurement nents that should be measured by implement- of success is by implementing Balanced Score- ing balance score cards within the agency and cards which will assess the agency’s perfor- City to establish a culture of using data to shape mance within the categories of ‘Objectives, strategic goals and track progress against them Measurements, Targets, and Initiatives’ (Ka- in the short and long-term. When looking for plan, 2001). When the evaluation is completed indicators of success, we are, essentially judging (every six months), the scores act as a distilla- the value that an agency provides its partners tion of key performance patterns and identify and the population it serves (Weiss, 1972). Te the root causes of challenges which will provide indicators of success should directly connect COR with an understanding of which areas the to the goals of the agency and further provide agency is succeeding and which areas need the measurable feedback as to whether or not those most improvement. Balanced Scorecards can goals are being obtained within the proposed provide COR with clarity and direction that is timeline (Carnochan, Samples, Myers, & Aus- achieved by breaking down each category into tin, 2004). specifc areas of focus. Te Scorecard evalua- tion scores will then be incorporated into the next phase of COR’s strategic plan.

16 SMART DATA

Objectives: one Scorecard should include:

“Citizens Perspective”, which would provide citizen feedback on the agency’s initiatives and en- sure citizen’s feel that their opinions are valuable to the City and their concerns are acted upon. Scorecards will be evaluated to measure citizen satisfaction, determine the needs of citizens that are not currently being met, and correct actions. Below are samples of ‘Citizen Engagement’ Scorecards that can be implemented and posted as an interactive link on COR’s website and social media outlets to promote engagement and participation in evaluation efforts.

17 SMART DATA SMART DATA

Measurements:

An additional Scorecard should include the “Learning & Development Perspective” to measure the skills, resources, and productivity of COR employees and Agency Representatives in order to improve performance, create value and progress towards resilience. Below are examples of ‘Inter- nal Process’ Scorecards that can be shared with employees to promote engagement, incentivized participation and improve communication efforts. Furthermore, COR can track its scores every six months to increase employee satisfaction and productivity.

18 SMART DATA

Targets:

The “Internal Perspective of Mission” Scorecard should be included as communicating a succinct list of agency objectives and goals to internal employees is crucial for the team to excel beyond citizen/agency expectations. By targeting the diverse skill set of COR’s employees, the agency can prevent mission stretch and/or mission drift when new partners are introduced.

Initiatives:

It is crucial to include a Scorecard that measures the “Financial Perspective & Trust” of COR’s stakeholders. This allows COR to determine if its efforts are creating value for its stakeholders so the agency can attract additional sources of funding and establish ways to gain trust.

19 INDICATORS

suggest policy based on the results. INDICATORS Recommendations Although indices are complicated and time- Work with academic specialists to develop the consuming to construct, the value to be gained following indices: from the development and maintenance of • Hazard Vulnerability Index indices more than offsets these challenges. • Resilience Index There are many reasons that COR should • Smart City Index commit to developing these three indices.

Introduction Value of Indicators

We recommend that COR work with academic COR’s Value: Well-constructed indices can help specialists to develop three indices: a hazard COR quantify its added value to the Mayor’s vulnerability index, a resilience index, and Office, other agencies, potential donors, and a smart city index. An index is a type of most importantly, the citizens. The indices composite measure that summarizes and we have proposed are tailored to help COR ordinally ranks data (Babbie 2016). Indices quantify its value through savings, efficiency, are difficult to develop, and require a robust and prevented loses. theoretical basis and sound methodological approach in order to be both accurate and Comparative Advantage: Indices are a project instructive. An index is an aggregating tool that logically belongs at COR because of COR’s that is best used to answer focused questions. comparative advantage as a data aggregator. One index focusing on quality of life in a Indices are a tool for data aggregation, and may require very different data than another require lots of data. With data from over index focusing on quality of life in the city thirty agencies and partners, COR is the best center. Consequently, before undertaking positioned entity in the city to undertake this any index development endeavor, it is crucial task, and should move to act on this strategic to determine precisely what the indices are position. meant to capture, and which measures are appropriate for the chosen location and scale, Performance Evaluation: COR can use the for example, how they might differ in formal balanced index scores from a variety of areas and informal contexts. In short, indices are as a performance evaluation tool to monitor complicated and highly sensitive instruments, whether COR is making progress toward its and require expertise and careful guidance. mission goals, and identify potential for greater Such expertise can be solicited through internal efficiencies. Additionally, these indices dedicated in-house researchers (see PENSA 2.0 can produce “scorecards” for the city or for recommendation), and/or through partnerships neighborhoods within the city that will that with the academic sector. Academic partners allow for transparent monitoring. are particularly valuable because they can be engaged without need for significant additional Implement RioResiliente Strategy: The resources from COR, while still providing indices are the best application of the resilience needed capacity for research and program indicators identified as flagship project of the development. Lastly, academic partners should Rio Strategic Plan 2017-2020 and RioResiliente guide the interpretation of the indices and Strategy, the latter of which COR is tasked public policy experts should be engaged to with implementing. These indices are critical

20 INDICATORS

for monitoring success in implementation measurements based off of COR’s assets and ensuring that a robust dialogue is opened and capabilities identified within the Inter- about appropriate metrics. The three indices American Development Bank (IDB) Rio Smart we have proposed are also tailored specifically City case study. The site visits to CICC, Rio to the goals in the RioResiliente Strategy, and Aguas and other public offices and stations also model how COR might track progress towards allowed us to receive feedback that would allow the Strategy’s goals. Each indicator has been us to expand our indices. mapped onto a specific goal from the Strategy, which can been seen in full in Appendix XX. After conducting our research and finishing the site visits, we then began to Inform Actions: One of the most important formulate suggestions for specific indicator purposes of the indices is to evaluate and measurements and an index aggregation compile data in a way that is useful for crafting strategy for each of the indices. We also data-driven policy. While it is important to considered what other types of categorical note that policy should not be “blindly” drawn and measurable information relevant for from data, nonetheless, data is crucial for each indicator. For example, the ideal unit of policymakers not only in determining the analysis was inputted as a category so that best future actions, but also evaluating the the indices could be adaptable for different effectiveness of past actions. spatial scales whether that was at the city or neighborhood level. Other relevant information Increases Equity: Like most major cities, was identifying the source as justification for Rio de Janeiro must address the inequitable the use of each indicator and how indicators access to and distribution of city services. would align with different goals or capabilities Although there is broad awareness that certain outlined within the strategic documents neighborhoods are better served in general produced by public entities. than others, specific deficiencies in specific services may more difficult to capture. Each of Limitations the sub-indices allows for a multi-dimensional approach to monitoring these differences. Although the indices produced here reflect a long process of research and adaptation to Rio’s Our Process context, it is also important to point out the limitations of these indices, and of any indices In order to develop the three indices, we that may be built through partnerships in the began by reviewing academic and professional future. First, because we did not have access sources (such as the 100 Resilient Cities report) a full menu of data that COR aggregates, our that allowed us to structure and measure the capacity to comprehensively map our indices indicators identified by COR. We also reviewed onto COR’s existing data was limited. This the RioResiliente Strategy and identified the can affect certain aspects of the indices such most applicable goals and subgoals of the six as the units of analysis as well as relevance to overarching RioResiliente Strategy goals to be different RioResiliente goals. incorporated within the indices. By doing so, COR can understand how measured indicators Second, there may be overlap of certain can help COR achieve RioResiliente Strategy indicators between indices and sub-indices. goals. Lastly, the indicators within the Smart Overlap of indices that are highly correlated is City Index were adapted to reflect realistic called multicollinearity, and causes problems

21 21 INDICATORS

when weighting indicators and prevents The third issue is closely related to the second. accurate results. Although every effort has COR must ensure that any indices developed in been taken to eliminate multicollinearity the future are aggregated using methodology with each sub-index, it could become an issue from academic or other research partners, with when aggregating the three indices together a theoretically sound basis that encompasses as the potential for overlapping variables appropriate variables, scoring mechanisms, would increase. This issue must be addressed and relevance to specific goals. This is to ensure by future academic partners before further that the final scores produced by these new adaptation of the indices proposed below. and/or combined indices are meaningful and accurate.

How to Build an Index Building an Index is a complicated and technical endeavor. The following steps outline a basic overview on how an index is constructed. Additionally, we use the Disaster Resilience Index as an index example. It was created and applied by authors including Susan Cutter, a leading author in the field of resilience. Scale. Consider the scale of the measurement. Clean. “Clean” the data and address any of missing These measurements could be specifc populations, values. There are four methods to clean the data: (1) 1 neighborhoods, or cities. This is important because 4 Standardize the data to avoid problems that occur when the scale will inform the variables and measure- mixing measurement units. (2) Check to make sure no ments that could capture specifcally-desired information. For two indicators are strongly correlated, thus ensuring the integrity of example, Cutter et al. chose to evaluate a region comprised of the weighting system. (3) Perform an item analysis to check whether eight states in the U.S.A that is under the management of a each of the items included in a composite measure makes an indepen- federal disaster management agency known as FEMA. dent contribution. (4) Normalize measurements so that variables are on a similar measurement scale. The Min-Max rescaling method can be used.

Theory. An index needs a theorical basis to Weights. Use a theoretical basis to determine the determine what should go into it. This can be weights of each indicator and sub-index. Typically 2 an existing theory from an academic source or 5 items should be weighted equally, unless the literature developed anew. Cutter et al., chose the “Disaster recommends otherwise. Some theories should require Resilience of Place (DROP)” theoretical model, but different participatory feedback to gauge the weights of different measures. For models may be adopted according to need. For any theoretical example, social justice theories might require a participatory process to basis, it important that the theory or idea can be empirically assign weights based on differing community perceptions of priorities. tested.

Variables. Choose appropriate variables, tak- Score. Create the index score. One can simply add up ing note of the data’s consistency of measurement the sum of the indicators or sub-indices. In our example, 3 and the data quality. You may need to balance 6 the authors needed to frst average the sub-index scores variables from academic research or the available to account for an inequal number of variables across the data. Between the two, variables from the chosen prescribed sub-indices. Once the average score was determine, the scores were theory should be prioritized. added together to create a fnal Disaster Resilience Score.

22 23 INDICATORS

Resilience Index The city’s ability to predict and react to disasters does not only come from advanced The resilience index is designed to meet two techniques and comprehensive infrastructure, of the needs identified by COR: how to use but also from the public’s’ ability to access the disaster-related and mobility-related data information and therefore make necessary and how to achieve city resilience objectives preparations. Thus, it is important to build a related to RioResiliente Strategy goals. Seven comprehensive evaluation system integrating sub-indices were constructed to capture the the various aspects within the context of Rio experiences of citizens living in both formal de Janeiro. Given the that the city needs to and informal communities. Furthermore, recognize that different communities have the vulnerability to disasters varies due to different resilience capabilities to cope with geographical locations which implies that different types of disasters, communities resilience improvement solutions must be should have customized resilience customized accordingly. improvement plans.

See Appendix 1 for full table.

Mobility In the short-run, public safety stresses the We can demonstrate how the rest of the need for a necessary communication channel index would be built out using the mobility of transportation information when disaster indicator as an example. The mobility indicator strikes. By evaluating the effectiveness and can help COR track the performances of the efficiency of the information platforms that transportation systems in Rio de Janiero. This include physical information boards and indicator targets both the short-term goals of smartphone applications, COR can be more disaster management (see the Saturation of aware of where the resources should be Road Infrastructure sub-index in Appendix distributed to expand its ability to inform XXX) and the long-term goals of sustainability. people of transit options. The 12 variables within the mobility indicator help construct a performance evaluation Reachability is also important on rainy days system and a focus on transportation planning as it directly affects the connectivity of the Rio based on the perspectives of infrastructure, city transportation system, intermodal integration, operation, and transport usage sectors.

23 INDICATORS

and the modal split of transportation options. Long-term policy making such as vehicle Unexpected road obstacles can change emission control relies on the analysis of people’s choice to choose transportation emission variables (listed in the Saturation modes and routes. For example, a larger of Road Infrastructure part in Appendix 3). metro station can accommodate more people One important concept to note is the “sponge as an intermediary transfer option between city” concept implemented in two series of different transportation modes over a longer pilot cities in China. This concept stresses the period of time. However, the availability of flexibility of road infrastructure to permeate, these alternative modes can vary amongst absorb and recycle water, which combines communities due to the transit access that was the rainfall treatment system with the road allocated by resource distribution and planning system. agencies. Hazard Vulnerability Index In the long-run, the measurements contribute to sustainable transportation and land-use The Hazard Vulnerability Index is an index planning in Rio de Janeiro. According to a that is partially derived from the overarching research study on a comparative evaluation Resilience Index. It was made as a separate of mobility in several Brazilian cities: section to better clarify 11 sub-indices Belém, , Goiânia, Juazeiro do Norte, that specifically focus on Rio de Janeiro’s Uberlândia and Itajubá, data availability vulnerabilities to disasters. These are namely and data quality were the two major the 11 chronic stresses and shocks identified factors affecting mobility within the cities. in the RioResiliente Strategy as opposed to the Benchmarking a well-structured and detailed overall resilience of city operations and the mobility evaluation system that has been tested citizens of Rio de Janeiro. The indices specific in the context of Brazil would be a valuable to each shock will enable COR and the city source for the further enhancement of Rio’s to generate a more detailed resilience plan to mobility evaluation system. distribute disaster management resources.

See Appendix 3 for full table.

24 INDICATORS

Intense Rain predict when and where certain accidents or disasters will occur. While the Smart Cities An applied example of the Hazard Vulnerability Index does not list as many variables that can Index is Intense Rain, which showcases how be adapted for COR’s prediction capabilities, sub-indicators from the Hazard Vulnerability this is something COR can further study and index are constructed and explained. In the utilize academic professionals for to develop case of Intense Rain, sub-indicators range more relevant indicators for COR. from Landslide Vulnerability to Community Perception. The aforementioned sub-indicators Lastly, the Smart City Index can help suggest utilize different measurements that either have actions that can help COR achieve some of a positive or negative effect on resilience within the RioResilinte goals (such as the Execution the city of Rio de Janeiro. Furthermore, the Simulations for Crisis Response) while also measured sub-indicators had extrapolated data referencing COR’s assets and capabilities based from data portal sources such as AlertaRio, on the informational sections of IDB Rio Smart Data.Rio, and GeoRio, city case studies, and/or City case study (RioResiliente Strategy). other academic sources. Safety and Security Smart City Index An applied example of the Smart City Index While the previous two indices are more is the Safety and Security indicator. Through focused on measuring Rio de Janeiro’s nine different variables, the Safety and resilience capacity and quantifying COR’s Security indicator can measure the “Decrease added value to external stakeholders, the in Evacuation Time” sub-indicator. So when Smart City Index was created as a way to a flood disaster happens, COR can track how internally evaluate COR’s key functions and quickly it was able to evacuate potential victims performance while also offering insight and from formal and informal neighborhoods to recommendations into how COR can become a appropriately designated safety areas using more effective agency. the “Decrease in Evacuation Time” variable. Over time, COR can review and compare their The Smart City index includes seven response time records to evaluate if there were different sub-indices based on an academic improvements in their performance. literature review of six different sources. The subindices thematically revolve around COR’s By reviewing sub-indicators, COR can learn technological and partnership capacities. how to improve upon its smart city services Furthermore, the seven sub-indices encompass related to evacuation time and network 46 different measurable variables but the same congestion incidents. Specifically, COR can units of analysis as the other two indices. reduce the time needed for disaster-related evacuations as well as predict where and The Smart City Index is also helpful because when network congestion incidents will occur it also show COR how to further enhance its thus reducing the amount of potential future own capabilities. These include prevention network congestions events. measures and actions that will prevent further accidents and disasters, overall operational efficiency, and/or increasing its ability to

25 25 INDICATORS

Intense Rain Sub-index

Safety and Security Sub-index

26 INDICATORS

Mobility Sub-index

27 INDICATORS

Case Studies

Resilience by Neighborhood Level Durban, South Africa

In 2006, the eThekwini Municipality developed the Municipal Climate and Protection Programme incorporating both an assessment of climate change and development of response strategies at the local level. Created after heavy torrential rains that devastated the region’s emergency response resources, the municipality’s Environmental Planning and Climate Protection Department encouraged three sectors for development: health, water, and disaster emergency. The Programme, was one of the first to addressed climate change while also adopting a culturally competent approach. Building on social equity gains post-apartheid, the Programme specifically addressed the unique impacts of climate change on informal housing arrangements. It created job opportunities for those living in informal housing through the Green Roof Top Project, where rooftop gardens serve to conserve energy within buildings and creates jobs in agriculture. Additionally, the eThekwini Municipality allowed different neighborhoods within Durban to adopt their own customized climate response plans to improve Programme outcomes. Given the RioResiliente goal to create jobs, a similar strategy could be employed in Rio de Janeiro. This could also be an opportunity to move Rio’s data collection - and potentially strategic plans - down to the neighborhood level, which will allow for more equity in the implementation and outcomes of the city’s resilience initiatives.

Lessons from the Durban case show that support from local political leadership for climate adaptation planning is essential. This increases the opportunity for public and private cooperation to further new adaptation strategies, the City’s development objectives, and available funding and skills (ICLEI, 2012). Durban’s “learning by doing” approach was supported by robust monitoring, evaluation and defensible research. The research partnerships between the three sectors of health, water, and disaster management were essential in order to roll-out pilot tested strategies (ICLEI, 2012). Finally, a lack of social cohesion is a substantial barrier to effectively engage communities around climate change, thus the municipal government needed to consider responses at the neighborhood level in order to address the many intersectional realities that impact different communities (Roberts, 2010). Their experiences illustrate the need for resilience indicators to separately capture social and community resilience, as done in the Resilience Index

Durban

Source: ICLEI, 2012

28 INDICATORS

Case Studies

Mobility Resilience Mumbai, India

The Brihanmumbi Municipal Corporation (BMC) implemented a plan in 2016 to improve its rail- way systems by elevating and improving the structure in conjunction with the Station Area Traffic Improvement Scheme. The plan is to improve 20 railways and create high station platforms to deal with potential flood waters that would disrupt mobility services. Car, taxi, and foot traffic will also be addressed in various stages. Like Rio, Mumbai has heavy foot traffic and is prone to vehicle bottlenecks that impede emergency services to its nearly 18 million citizens.

Mumbai is also a disaster-prone city. It has been hit by a number of monsoons, and regular- ly faces challenges when citizens evacuate the city or head to emergency centers. Transpor- tation problems have arisen mainly due to the uncontrolled expansion of urban sprawl and improper land use, meanwhile employment is still concentrated in the city center which leads to a job-housing imbalance. Informal settlements have appeared along Mumbai’s roads, highways, and railways, causing accidents, poor infrastructure, and unsustainable living en- vironments (Cheshmehzangi & Thomas, 2016). Overcrowding and road congestion due to these communities would also be alleviated by raising the train tracks and expanding the railways. Rio de Janeiro could also consider elevating its BTS lines, light rail lines, or other roadways that could be used for emergencies to deal with the congestion pressures coming from large informal housing and labor sectors, increasing urban sprawl, and intense rain. It is also an important lesson to control the private vehicle ownership to reduce the emission.

Mumbai

Source: Rediff.com

29 INDICATORS

Case Studies

Disaster Resilience Manila, Philippines

Due to a combination of a growing population, degradation of resources, and climate change, Manila is increasingly vulnerable to extreme flooding events and typhoons (Roberts 2011). Ma- nila’s municipal government has initiated several disaster reduction programs relevant to Rio de Janeiro. For example, effective community-based measures were implemented to educate, train, and provide residents in vulnerable areas with real-time, localized disaster risk information. This helped residents prepare for imminent disasters in an expeditious manner. Moreover, the City of Manila gave citizens a checklist of actions, needed supplies, and communications and contingen- cy templates to build resilience and disaster preparedness on the community level. This format, could help COR implement more effective evacuation planning.

Manila has also adapted a System Dynamics Model (SD) to better quantify its resilience, which allowed them to be proactive at making policy. SD modeling platforms allow for a system to be built virtually in terms of stocks, flows, input information and feedback loops (Gotangco et al., 2016). It analyzes the interactions between diverse data inputs and outcomes, which improves the prediction of upcoming hazards and their effects. This approach helped Manila track its resilience efforts, and could help COR track and predict emergency responses as well. For example, in the context of flood resilience, COR can use the system to track economic losses from flooding and potential savings due to adaptive measures. In these times of scarce public funding, COR could even predict economic losses in the event of a disaster to demonstrate the importance of fortifying its service delivery and community outreach efforts.

Manila

Source: Rotary International

30 INDICATORS

Case Studies

Smart Cities Kuala Lumpur, Malaysia

Kuala Lumpur has composed a system to enhance its use of information communication technol- ogy and e-governance to create a comprehensive plan that will improve overall city functionality as a burgeoning smart city (Lau et al., 2014). The Economic Transportation Program was created by the city in 2014 and was divided into nine different Entry Point Projects (EPP); EPP 1, 2, and 4 specifically push forward smart city indicators. EPP 1 and 2 emphasize the need for recruiting technology firms and experts that will instigate smart technology innovation and distribution, which are smart city indicators that could incentivize new technological projects and increase the hardware and software capacity of a city. EPP 4 focuses on the need for integrating new informa- tion technologies into public transit systems, which can be measured by smart city indicators that monitor traffic accidents and can divert users to alternative routes while also incentivizing poten- tial pedestrians and car-users to utilize public transit systems.

The overall EPP plan models a multi-phase strategy to acquire and incentivize startups that can enhance the technological capacity for this emerging smart city, recruit interna- tional and domestic technology experts and firms that will incentivize smart city innova- tion, and increase technological hardware such as sensors and software systems such as Wifi networks. Kuala Lumpur’s projects speak to COR’s vision of enhancing Rio de Janei- ro’s smart city capabilities. Such projects could allow COR to increase its smart city de- velopment projects as well as expand its digital monitoring efforts throughout the city.

Kuala Lumpur

Source: Lau et al., 2014

31 COMMUNICATION

COMMUNICATION Once COR is able to develop, implement and measure the different indicators, it is important to create strategies to communicate this content with citizens and potential partners. In order to do so, we recommend: B) Facilitation of information dispersion during 1. Identification of different levels of user times of crisis access to facilitate data cleaning • Connecting social media sites, saves time 2. Target potential start-ups to develop when posting messages as a post in one Application Programming Interface (APIs platform should automatically post to 3. Solidify social media outreach and measure another. This would save time in trying to its success by using social media indicators make a post for every site, especially during 4. Use social media platforms to analyze times of crisis when agencies want to send citizen priorities and match scorecard out information as quickly as possible. results to citizens’ perceptions • “With the click of a button, a picture, 5. Dissemination of scorecards video, or message can become viral as it is sent to 10, 50, 100, or a thousand people” Value Added to COR (Thackeray et al., 2008). We see that these recommendations add value to COR’s key functions by: Low cost outreach

Time saved A) Social media tools provide a free platform to directly communicate with citizens A) Integration of social media platforms. This • “Tapping the spirit of the Free Open can be done by posting content on one site Source Software (FOSS) movement” opens which will then be automatically populated on up an opportunity for receiving “input the other sites and innovation” allowing the public and • “Automating social sharing” or cross- partners to do some work giving them referencing all existing social media will power and opportunities for innovation not only save time when posting data but that also helps COR in receiving more it will also ensure that the information personalized information from the public is reaching all followers through the (Linders, 2012). different platforms (Vahl, 2015). Doing so B) It also allows for the purchase of will allow the agency to ensure that the promotional ads for short periods of time if shared information reaches a larger target necessary (Facebook, 2017) audience through the multiple platforms as not every Facebook follower has a Twitter Increase citizens participation and trusts account and vice versa, and same goes with other social media platforms. A) Social media has been used by different government agencies to increase transparency by bringing information to citizens in their preferred platform

32 COMMUNICATION

B) The ability to bring government content via administrators (Public agencies within COR) mass distribution enables new forms of and users (citizens of Rio). citizen participation, therefore enhancing “social consciousness and citizen engagement” Developers & Administrators (Bonson et al., 2012) A) Data cleaning Improve data received • Understanding who receives data: As COR sends out data it needs to clean out A) New technologies have prompted citizens to different parts depending on who receives become more involved in the “co-production of it. As a result, it needs to dedicate more knowledge and information”, extending their staff time to this task. Creating a standard role from only users to partners (Linders, 2012) procedure of who receives the data, it • Keeping the public engaged with relevant would allow COR to set a specific number information will help bring in more public of staff dedicated for this task. This number interaction that can allow COR to receive would only change in cases of emergency. more personalized information/data. The B) APIs public can share COR’s posts taking part • The vasts amount of data that COR in the “promotional strategy” and also receives and the opportunity to receive participate in the sharing of information or more via social media to create the perfect asking questions that will help the agency opportunity to seek partnerships with small improve its content for the future as well start-ups. The partnership will allow for the as increase “viral marketing” (Thackeray et creation of an Application Programming al., 2008). Interface (API). This API can later be used B) This production of knowledge and exchange for the creation of a mobile application of information adds value to COR’s data pool that can aggregate some of the services individual agencies within COR already New partnerships provide. • This application can be used to target A) Tis new wave of information creates new different populations and create opportunities to develop partnerships with individualized content that Cariocas can Rio’s agencies as well as international fnancial use in their daily lives. institutions, such as the World Bank or the International Development Bank, to develop Users (Increasing PR & sending out relevant innovative ways to consume the data created. information)

Engagement Plan With a population of almost 6.5 million people in the city of Rio de Janeiro (IBGE, 2010), We advise the following engagement plan to distributing specific data information to the begin implementing the recommendations. public is not an easy task. COR has been doing In addition, we believe it is important to a great job of creating social media platforms distinguish between the diferent audiences that engage Cariocas and help distribute that have access and receive the data produced relevant information. However, there is still by COR. For this reason, we have divided the some room for improvement as current plan between developers (e.g: Google, Waze) as platforms only cover 12% of the population.

33 COMMUNICATION

This percentage does not take into Social Media Indicators consideration that some of the followers may not be part of the Rio population. We believe One of the most important components of COR could implement the following steps to our report is the application of indicators that continue to engage and increase their citizen can allow COR to measure implementation audience: outcomes. We are recommending the usage of the Social Media Metrics for Federal A) Implementation of a social media campaign Governments (Herman, 2013). Although • European organizations are learning about designed for federal governments, they can the opportunities digital sources and be used with local governments by picking social media are presenting, though they individual or a set of indicators depending on may still rely on print media (working what COR wants to measure. with journalists) as a primary source of media, they recognize that social media Breadth and other online forms of communication Provides information on traffic and content will be taking over the “leading position” in usage: communicating information to the public • Community Size (Verhoeven et al., 2012). It is for this reason, What it measures: Measures account that emphasis on a campaign that aims to popularity. It takes into consideration other increase the number of followers is more measures in order to not only rely on number than important than ever. of followers • Examples to increase followers include: How to measure: Number of fans, followers, usage of television and radio, “COR Bacano” subscribers and unique individuals that have campaign that engages school age children seen the page’s content by allowing school visits into the center, • Community Growth and partner with local Carioca celebrities What it measures: Account popularity that can re-Tweet and/or share COR’s How to measure: Difference between current content. number of fans from previous month or year • Another way to promote COR’s content is through the usage of other existing social media pages: The inclusion of social media links in the description section of the media pages, listing social platforms in cover photo descriptions, sharing of content from one social media site to another, and automating social sharing from one platform to another are some ways of using social media platforms as promotional tools (Vahl, 2015). (Image retrieved from http://bloggersclick.com/ grow-facebook-followers-earn-money-facebook- page/)

34 COMMUNICATION

Depth Customer Experience Looks into the time, outcome and context of It measures what it is being said about a visit. Number of desired actions that users programs, events or any other relevant content complete that can aid in the improvement of practices • Conversions and service delivering. Due to issues of privacy, What it measures: Volume of desired actions data collected should not be identifiable. How to measure: Analytics programs • Sentiment • Viewing What it measures: What is being shared about What it measures: How often and for how long programs and value trends videos are viewed How to measure: There are a number of free How to measure: Minutes watched and number analytic available, but it is important to ensure of views on YouTube analytics tools that the program ensure users’ privacy • Indicators Direct Engagement What it measures: Provides information on Measures how much followers or general social programs provided by the agency visitors use the content on social media sites. How to measure: Tools used to measured • Engagement Volume sentiment can also be used for indicators What it measures: An agency’s engagement • Survey Feedback with the public through metrics on its What it measures:Results of citizen satisfaction dimensions and frequency. on agency’s social community via surveys How to measure: Native analytics programs How to measure: Survey software. collect and report for each social media tool, Recommended to survey during targeted such as Twitter analytics, Facebook insights, campaigns in order to invest the public into the and YouTube analytics. program • Engagement Responsiveness What it measures: Success rate of an agency Campaigns for its responsiveness on social media. Performance reports of specific programs and How to measure it: Collecting data at the end of tactics with the use of the five metric categories the each day or at the end of a specific event. mentioned above. What it measures: Provides an organized Loyalty breakdown of the performance of both short It measures visitor loyalty and returns and long-term projects or programs. Return Community How to measure: Through the combination of What it measures: How many current chosen metrics based on the what the desired members return to see content end result. How to measure: Google analytics allows for the creation of a custom segment specific Strategic Outcomes produced content Reports on the direct impact to strategic organization priorities by social media strategy performances.

35 COMMUNICATION

What it measures: Extensive breakdown linking the impact of the mission to social performance metrics. How to measure: Narrative explanation of a combination of metrics, campaigns, and organizational goals.

Based on this list, we have also included a list of social media indicators for smart cities. Some of these indicators take into consideration the different characteristics of Rio’s diverse population. Please find them in the appendix section.

Scorecard

As mentioned in the performance management section, scorecards are an integral tool to measure COR’s implemented strategies and analyse their effectiveness. The scores received can also be used to compare the citizens’ perceptions of the state of COR. This can be accomplished by providing surveys via social media that can be tailored to the neighborhood level.

36 36 IMPLEMENTATION

IMPLEMENTATION STRATEGY Indicators • Identify existing data sources for indicators SMART DATA & OPEN SOURCE and check robustness of current indicators through triangulation with external data INDICATORS sources like NASA COMMUNICATION Communication Short-Term Recommendations • Solidify social media outreach via publicity campaign. Measure its success through Phase 1 (6 Months) social media indicators • Implementing Balanced Scorecards to Smart Data & Open Source measure performance • Require partners to collect more dynamic data to reflect neighborhood information Long-Term Recommendations • Recommend use of data science startups to help organize data and output through Phase 3 (2nd Year) visualization tools Smart Data & Open Source Indicators • Create a Damage Assessment Committee • Identify academic or research partners to (DAC) to improve damage and loss help develop new recommended indicators assessment procedures that will help and indices strengthen the country’s response capacity (quantify the cost-savings of COR’s work) Communication • Identify the different levels of user access Indicators to facilitate data cleaning • Determine new data sources/priorities • Target potential start-ups to develop via: Relationship to RioResiliente Plan APIs. Possibility of consolidating mobile and/or COR mission, focus groups with applications with the different agencies stakeholders especially citizens and within COR guidance from academic literature

Phase 2 (1st Year) Communication • Utilize social media platforms to strengthen Smart Data & Open Source citizen participation in COR initiatives and • Advise data.rio to release frequent output crowdsource information for real-time of reports to highlight value of COR and personalized response in times of natural sustain conversation and funding disaster • Create PENSA 2.0 within COR to facilitate data flows and analysis.The team will continue to include: 1) Strategic planning 2) Data analysis 3) Research 4) Public policy development forecasting

36 7 IMPLEMENTATION

Phase 4 (Beyond)

Indicators • Institutionalized data transparent and scale data at a neighborhood level for more targeted data sets • Adopt a disaster risk reduction mindset versus a disaster relief mindset

Communication • Empower and provide the tools for community institutions to become active partners in resilience efforts throughout Rio - including the areas of water management, sanitation and disaster relief • Build upon WhatsApp’s popularity

38 39 SOURCES

Bryson, J.M. (2011). Strategic planning for SOURCES public and nonprofit organizations: A guide to Ackermann, F., & Eden, C. (2011). Strategic strengthening and sustaining organizational management of stakeholders: Theory and achievement (4th ed.). San Francisco, CA: practice. Long range planning. 44(3). 179-196. Jossey-Bass. Retrieved from: http://www.hadjarian.com/ esterategic/tarjomeh/2-90/khamesi.pdf Burningham, S., & Stankevich, N. (2005). Why road maintenance is important Arup (2017). City Resilience Index. Retrieved and how to get it done (No. Transport from: http://www.arup.com/~/media/ Note No. TRN-4). Retrieved from: Publications/Files/Publications/C/160518_ https://openknowledge.worldbank.org/ CRI%20total-Booklet-V3%20Print.ashx bitstream/handle/10986/11779/339250rev. pdf?sequence=1&isAllowed=y Babbie, E. (2016). The Practice of Social Research (14th ed.). Belmont, CA: Thomson Carnochan, S., Samples, M., Myers, Wadsworth. M., & Austin, M. J. (2014). Performance measurement challenges in nonprofit human Bakıcı, T., Almirall, E., & Wareham, J. (2013). service organizations. Nonprofit and Voluntary A Smart City Initiative: The Case of Barcelona. Sector Quarterly, 43(6), 1014-1032. Journal of Knowledge Economy, 4(2), 135-148. Catalytic Communities. (n.d.). Rio Favela Facts. Batagan, L. (2011). Indicators for economic and Retrieved from: http://catcomm.org/favela-facts social development of future smart city. Journal of Applied Quantitative Methods, 6(3), 27. Cheshmehzangi, A., & Thomas, S. M. (2016). Prioritizing accessible transit systems for Beijing Municipal Public Security Bureau. sustainable urban development: Understanding (2009). Beijing Public Security Traffic and evaluating the parameters of a Management Yearbook 2009. Beijing, China: transportation system in Mumbai. Journal of Beijing Municipal Public Security Bureau. Urban Planning and Development, 142(4).

Bocquier, P. (2005). World urbanization Cohen, B. (2014). Smart Cities Council: Smart prospects: An alternative to the UN model City Index Master Indicators Survey. Retrieved of projection compatible with the mobility from: http://smartcitiescouncil.com/resources/ transition theory. Demographic Research, 12, smart-city-index-master-indicators-survey 197-236. Crump, Jeremy. 2011. What Are the Police Bonsón, E., Torres, L., Royo, S., & Flores, F. Doing on Twitter? Social Media, the Police and (2012). Local e-government 2.0: Social media the Public. Policy and Internet, 3(4), 1–27. and corporate transparency in municipalities. Government Information Quarterly, 29(2), 123- Cutter, S., Burton, C.G., & Emrich, C. 132. (2010). Disaster Resilience Indicators for Benchmarking Baseline Conditions. Journal of Homeland Security and Emergency Management, Vol. 7 (1), 1-18.

39 9 SOURCES

da Silva, A. N. R., de Azevedo Filho, M. A. N., Groupe Speciale Mobile Association. (2013). Macêdo, M. H., Sorratini, J. A., da Silva, A. F., Smart City Resilience: Learning from Lima, J. P., & Pinheiro, A. M. G. S. (2015). A Emergency Response and Coordination in Japan. Retrieved from: comparative evaluation of mobility conditions http://www.gsma.com/iot/wp-content/ in selected cities of the five Brazilian regions. uploads/2013/02/cl_SmartCities_emer_01_131. Transport Policy, 37, 147-156. pdf

De Lancer Julnes, P. (2006). University- Hara, M., Nagao, T., Hannoe, S., Nakamura, J. (2016). New Key Performance Indicators for a Government Partnerships in Support of State Smart Sustainable City. Sustainability; Basel Reform: Lessons from the Caribbean. Journal 8(3), 206. of Public Affairs Education, 12(4), 439-460. Harrison, T. M., Guerrero, S., Burke, G. Facebook (2017). Compra de Alcance e B., Cook, M., Cresswell, A., Helbig, N., & Pardo, T.A. (2012). Open government and Frequência, Use anúncios do Facebook para e-government: Democratic challenges from a alcançar seu público com confiança. Retrieved public value perspective. Information Polity, 17, from: https://www.facebook.com/business/ 83–97. learn/facebook-reach-and-frequency Herman, J. (2013). Social Media Metrics Goldstein, D. (2003). Laughter Out of Place: for Federal Agencies. White House’s Digital Race, Class, Violence and Sexuality in a Government Strategy. Retrieved from: Brazilian Favela. Berkeley : University of https://www.digitalgov.gov/2013/04/19/social- California Press. media-metrics-for-federal-agencies/

Gotangco, C. K., See, J., Dalupang, J. P., Ortiz, i-scoop. (2017). Unstructured data: turning data M., Porio, E., Narisma, G., Yulo-Loyzaga, A., into actionable intelligence. Retrieved from: Dator-Bercilla, J. (2016). Quantifying resilience https://www.i-scoop.eu/big-data-action-value- to flooding among households and local context/unstructured-data/ government units using system dynamics: a case study in Metro Manila. Journal of Flood Jamieson, T. (2016). Disastrous measures: Risk Management, 9(3), 196–207. Conceptualizing and measuring disaster risk reduction. International Journal of Disaster Government of Singapore. (2017). Data.gov.sg. Risk Reduction, 19, 399–412. Retrieved from https://data.gov.sg/ IBGE. (2010). City of Rio de Janeiro 2010 Graham, K. (2014). Strategic planning: five Census report. Retrieved from: http://cidades. questions to identify key stakeholders. Harvard ibge.gov.br/v4/brasil/rj/rio-de-janeiro/panorama Business Review. Retrieved from https://hbr. org/2014/03/five-questions-to-identify-key- stakeholders

40 41 SOURCES

ICLEI - Local Governments for Sustainability. Kavanaugh, A.L., Fox, E.A., Sheetz, S.D., (2012, April). A municipality’s climate Yang, S., Li, L.T., Shoemaker, D.J., Natsev, protection program in eThekwini (Durban), A., and Xie, L. (2012). Social Media Use by Government: From the Routine to the Critical. South Africa. ICLEI Case Study 139. Retrieved Government Information Quarterly, 29(4), from: http://www.iclei.org/fileadmin/ 480–91. PUBLICATIONS/Case_Studies/ICLEI_cs_139_ Durban.pdf Lau, S.L., Lin, M.W.Q., Yau, K.-L.A., & Rahman, M.S.A. (2014). Towards a smart city: the case of greater Kuala Lumpur in Malaysia, International Labor Organization. (2013). present at the International Conference on Measuring informality: A statistical manual on Frontiers of Communications, Networks the informal sector and informal employment. and Applications, Institution of Engineering Retrieved from: http://www.ilo.org/global/ and Technology, Malaysia, 2014. Retrieved publications/ilo-bookstore/order-online/books/ from: http://digitallibrary.theiet.org/content/ conferences/10.1049/cp.2014.1393 WCMS_222979/lang--en/index.htm Linders, D. (2012). From e-government to we- International Organization for Standardization, government: Defining a typology for citizen & International Electrotechnical Commission. coproduction in the age of social media. Smart Cities Preliminary Report 2014. (2015). Government Information Quarterly, 29(4), 446- 454. Retrieved from: https://www.iso.org/files/live/sites/isoorg/files/ Litman, T. (2017). Transportation affordability. developing_standards/docs/en/smart_cities_ Transportation, 250, 360-1560. report-jtc1.pdf LSA Associates, Inc. (2003). Kansas City Walkability Plan. Retrieved from: https://data. Ipsos Mori (November 2009). Understanding mo.gov/Area-Plans/Kansas-City-Walkability- your stakeholders: A best practice guide for Plan/4xta-z2pq/data the public sector. Ipsos MORI Social Research Institute. Retrieved from: https://lmscontent. Macey, W.H. and Schneider, B. (2008), “The embanet.com/USC/PPD673/Week7/Readings/ meaning of employee engagement. Industrial and Organizational Psychology: Perspectives on understanding-stakeholders.pdf Science and Practice, 1, 3-30. Kahn, W.A. (1990). Psychological conditions of Meijer, A., & Bolívar, M. P. R. (2015). Governing personal engagement and disengagement at the smart city: A review of the literature on work. Academy of Management Journal, 33(4), smart urban governance. International Review of Administrative Sciences, 82(2). 692-724. Nam, T., & Pardo, T. A. (2014). The changing Kaplan, R. S. (2001). Strategic performance face of a city government: a case study of measurement and management in nonprofit Philly31. Government Information Quarterly, organizations. Nonprofit Management and 31, S1–S9. Leadership, 11(3), 353-370. Next Generation Science Standards Adoption and Implementation Workbook. (2013). Achieve: U.S. Education Delivery Institute. Retrieved from http://www.achieve.org/files/ NGSS_Workbook_Chapter_6.pdf

41 11 SOURCES

Nicolas, J. P., Pochet, P., & Poimboeuf, Rattan et al. (2012). Modeling Walkability: H. (2003). Towards sustainable mobility Automating analysis so it is easily repeated. indicators: application to the Lyons ArcUser, Winter 2012 Edition. Retrieved from: conurbation. Transport Policy, 10(3), 197-208. http://www.esri.com/news/arcuser/0112/ modeling-walkability.html Núcleo Avançado de Educação (NAVE). (2017). Oi Futuro: The Institute & Education. Retrieved Roberts, B. (2011). Manila: Metropolitan from: http://www.oifuturo.org.br/en/the- Vulnerability, Local Resilience. In Hamnett, S., institute/ & Forbes, D. K. (Eds.), Planning Asian cities: risks and resilience (287-321). London; New Ojo, A., Curry, E., & Janowski, T. (2014). York: Routledge. Designing Next Generation Smart City Initiatives - Harnessing Findings and Lessons Roberts, D. (2010). Prioritizing climate change from a Study of 10 Smart City programs, 22nd adaptation and local level resilience in Durban, European Conference on Information Systems South Africa. Environment & Urbanization, (ECIS 2014), pp. 1–14. 22(2), 397-413.

Penglase, B. (2009). States of insecurity: Rogla, J. (2017, June 1). Personal Everyday emergencies, public secrets, and drug Communication. trafficker power in a brazilian favela. PoLAR: The Political and Legal Anthropology Review, San Francisco Department of Public Health 32(1), 47. (2015). Community Resiliency Indicator System Methods. Retrieved from: https://data.sfgov.org/ Pereira, G. V., Macadar, M. A., Luciano, E. M., api/views/banc-xdvr/files/ & Testa, M. G. (2017). Delivering public value through open government data initiatives in Schaufeli, W.B., Salanova, M., González-Romá, a smart city context. Information Systems V. and Bakker, A.B. (2002). The measurement Frontiers, 19(2), 213-229. of engagement and burnout: a two sample confirmatory factor analytic approach. Journal Pontifical Catholic University of Rio De Janeiro. of Happiness Studies, 3, 71-92. (2017). Academic Centers and Departments: Central Coordination Offices. Retrieved from: Shumpeter. (2011, May 28). Building with big http://www.puc-rio.br/english/departaments/ data. Retrieved from http://www.economist. centers_departaments.html com/node/18741392

Prefeitura da Cidade do Rio de Janeiro (2016). Smith, K. (2016). How to increase social media RioResiliente Strategy. Retrieved from: engagement. Brandwatch . Retrieved from www.100resilientcities.org/blog/entry/rio-de- https://www.brandwatch.com/blog/how-to- janeiros-resilience-strategy increase-social-media-engagement/

Smart Cities Open Data Guide (Rep.). (2016). Retrieved http://www.spml.co.in/downloads/ reports/Smart-Cities-Open-Data-Guide.pdf

42 43 SOURCES

Starr, K. (2012). The Eight-Word Mission Turpin T. , Aylward D. , Garrett-Jones S. , Statement. Johnston R. . Knowledge-based Cooperation: University–Industry Linkages in Australia, Steele, R. (2016, April 05). 2016 Robert Steele: 1996, Department of Employment, Education, Open Source Everything Engineering (OSEE) – Training and Youth Affairs, Canberra, 96/17 Creating the Academy, Economy, Government, Evaluations & Investigations Program. and Society of the Future. Retrieved from https://phibetaiota.net/2016/04/2016-robert- UNISDR. (2017). Disaster Resilience Scorecard steele-open-source-everything-engineering- for Cities. Retrieved from: http://www. osee-creating-the-academy-economy- unisdr.org/campaign/resilientcities/home/ government-and-society-of-the-future toolkitblkitem/?id=4

Thackeray, R., Neiger, B. L., Hanson, C. L., & Vahl, A. (2015). How to cross promote your McKenzie, J. F. (2008). Enhancing promotional social profiles with facebook. Social Media strategies within social marketing programs: Examiner. Retrieved from http://www. use of Web 2.0 social media. Health Promotion socialmediaexaminer.com/cross-promote-your- Practice, 9(4), 338-343. social-profiles-with-facebook/

The Embassy of the Kingdom of Netherlands. Verhoeven, P., Tench, R., Zerfass, A., Moreno, (2016). Factsheet Sponge City Construction A., & Verčič, D. (2012). How European PR in China. I & M 2016. Retrieved from practitioners handle digital and social media. https://www.nederlandenu.nl/documenten/ Public Relations Review, 38(1), 162-164. publicaties/2016/12/06/factsheet-sponge-city- construction-china Vita, L., & Marolda, M. C. (2008). Road Infrastructure–the backbone of transport The Federal University of Rio de Janeiro. (2017). system. EU Directorate General for Research History and Mission. Retrieved from: https:// and Sustainable Surface Transport, Brussels, ufrj.br Belgium. Retrieved from: http://cordis.europa. eu/pub/fp7/transport/docs/backbone_transport_ The World Bank. (2014). Coping With Loss: en.pdf Options for Disaster Risk Financing In Brazil (Rep.). Retrieved from https://www.gfdrr. Wang, W., Zhao, H., Wang, G., & Zhou, H. org/sites/gfdrr/files/publication/Options-for- (2014). The study of the Beijing traffic noise Disaster-Risk-Financing-in-Brazil-English.pdf pollution control countermeasures. Applied Mechanics & Materials, 641-642, 853-859. Tucci, C.E.M. (2002). Flood control and urban drainage management in Brazil. Water Lines, Weiss, C. (1972). Evaluation research: Methods 20(4), 6-8. for assessing program effectiveness. Upper Saddle River, NJ: Prentice Hall.

43 SOURCES

Wells, S., & Raad, R. (2007). Performance Measures for Road Networks: A Survey of Canadian Use. In 23rd Piarc World Road Congress Paris, 17-21 September 2007. Retrieved from: http://www.tac-atc.ca/sites/ tac-atc.ca/files/site/doc/resources/report-perf- measures.pdf

Zannin, P. H. T., Diniz, F. B., & Barbosa, W. A. (2002). Environmental noise pollution in the city of Curitiba, Brazil. Applied Acoustics, 63(4), 351-358.

Zhu, J., Wang, Y., & Song, R. Climate Policy Greenhouse Gas Impact Assessment: A Case Study of Beijing Emission Trading Scheme. Retrieved from: https://www. wri.org/sites/default/files/WRI-beijing-ets- workingpaperEV_S.pdf

44 Expected Disaster Additional Cities Recommended Unit RioResiliente Sub-Index Variable / Indicator How Measured Effect on Justification Additional Notes on Application to RJ Context Related Where Used of Analysis Goal Resilience Southeast Region, Migration Net migration Yes Negative Adapted from Cutter et al. 2010 City USA This capitalized on the wealth of institutional knowledge and history Percentage population locally born still residing Southeast Region, Native Born Population Yes Positive Adapted from Cutter et al. 2010 City within both formal and informal communities by families that can facilitate there USA coping with emergencies. Southeast Region, Civic Participation Percentage voter participation in the last city election Yes Positive Adapted from Cutter et al. 2010 Neighborhood 6.G USA Southeast Region, This also may relate to the number of local churches, which are often Community Faith Number of religious followers per 1000 population Yes Positive Adapted from Cutter et al. 2010 Neighborhood Community USA safe houses during intense rains. Southeast Region, Civic Involvement Number of civic organizations per 1000 population Yes Positive Adapted from Cutter et al. 2010 Neighborhood USA Number of social advocacy organizations per 1000 Southeast Region, Advocacy Yes Positive Adapted from Cutter et al. 2010 Neighborhood population USA Percentage population employed in creative class Southeast Region, This should capture the innovation strengths of neighborhood citizens Innovation Yes Positive Cutter et al. 2010 Neighborhood 5.D occupations USA that may increase problem-solving capacities during emergencies. Homeless Population Number of individuals living on the street Yes Negative RioResiliente Strategy Neighborhood 6.F Percentage of land-area within 0.5 km of at least 1 Access to Food vegetable market or supermarket selling fresh food Yes Positive Adapted from CRI 2017 Los Angeles, USA Neighborhood This attempts to capture food deserts, in particular access to fresh foods. and vegetables Percentage of malnourished children under five as a Malnourishment Yes Negative Adapted from CRI 2017 Neighborhood percentage of all citizens under five Ratio of the pct. population with college education to Southeast Region, Educational Equity Yes Negative Cutter et al. 2010 Neighborhood the pct. population with no high school diploma USA Southeast Region, Age Percentage non-elderly population Yes Positive Cutter et al. 2010 Neighborhood USA Southeast Region, Transportation Access Percentage population with a vehicle Yes Positive Cutter et al. 2010 Neighborhood USA Southeast Region, Communication Capacity Percentage population with a telephone Yes Positive Cutter et al. 2010 Neighborhood USA Percentage population who do not speak Southeast Region, Language Competency Yes Positive Adapted from Cutter et al. 2010 Neighborhood Portuguese as a second language USA Percentage population without a sensory, physical, Southeast Region, Special Needs Yes Positive Cutter et al. 2010 Neighborhood This measure will reveal physical accessibility issues by neighborhood. or mental disability USA Percentage population with health insurance Southeast Region, Health Insurance Coverage Yes Positive Cutter et al. 2010 Neighborhood 6.D coverage USA Social While this is emphasized in the RioResiliente Strategy for underserved Percentage of newborns seeing the doctor within 7 communities, breaking it down by neighborhood will allow for better Infant Care No Positive RioResiliente Strategy Neighborhood 6.D days after discharge from the hospital metrics to determine if socioeconomic status is indeed the main predictor. Percentage of land-area within 0.5 km of at least 1 Medication Access Yes Positive Adapted from CRI 2017 Los Angeles, USA Neighborhood pharmacy While this is emphasized in the RioResiliente Strategy for underserved communities, breaking it down by neighborhood will allow for better Vaccination Rate Percentage of age appropriate vaccination rate No Positive RioResiliente Strategy Neighborhood 6.E metrics to determine if socioeconomic status is indeed the main predictor. While this is emphasized in the RioResiliente Strategy for underserved Percentage of prenatal consultations started in the communities, breaking it down by neighborhood will allow for better Prenatal Care No Positive RioResiliente Strategy Neighborhood 6.E rest trimester of pregnancy metrics to determine if socioeconomic status is indeed the main predictor. While this is emphasized in the RioResiliente Strategy for underserved communities, breaking it down by neighborhood will allow for better Primary School Enrollment Percentage of youth enrolled in primary schools No Positive RioResiliente Strategy Neighborhood 6.E metrics to determine if socioeconomic status is indeed the main predictor. While this is emphasized in the RioResiliente Strategy for underserved Percentage of people with complete personal communities, breaking it down by neighborhood will allow for better Documentation No Positive RioResiliente Strategy Neighborhood 6.E documentation metrics to determine if socioeconomic status is indeed the main predictor. Population Covered by a Percentage of the population covered by a disaster Southeast Region, Metropolitan Disaster Yes Positive Cutter et al. 2010 Neighborhood 2.A Adapted to the RioResiliente goal. recovery plan USA Management Plan Attempts to capture insurance needs within low-income communities by Percentage of formal and informal housing units Southeast Region, Housing Insurance Coverage Yes Positive Adapted from Cutter et al. 2010 Neighborhood ensuring the percentages capture all housing units, rather than just covered by housing insurance policies USA formal ones. Percentage of municipal expenditures for fire, police, Southeast Region, Municipal Services Yes Positive Cutter et al. 2010 City and emergency medical USA Number of political parties receiving votes in the last Southeast Region, Political Fragmentation Yes Negative Adapted from Cutter et al. 2010 Neighborhood election USA Southeast Region, Previous Disaster Experience Number of past disaster declarations Yes Positive Cutter et al. 2010 Neighborhood Institutional USA Percentage of schools incorporating resilience into Southeast Region, Resilience Education - Schools Yes Positive Adapted from Cutter et al. 2010 Neighborhood 6.A their curriculums USA Resilience Education - MOOCs Number of students enrolled Yes Positive RioResiliente Strategy City 6.B Percentage of the population who have opted in to Southeast Region, AlertaRio SMS Coverage Yes Positive Adapted from Cutter et al. 2010 Neighborhood the AlertaRio SMS USA AlertaRio Resilient Communities Number of community leaders participating in the Southeast Region, Yes Positive Adapted from Cutter et al. 2010 Neighborhood 2.D Adapted to the RioResiliente goal. Participation Resilient Communities Program USA Participation Rates in Citizen Percentage of citizens participating in the RJ Citizen Southeast Region, Yes Positive Adapted from Cutter et al. 2010 City Adapted to the RioResiliente goal. Science Science initiative USA Participation Rates in River Percentage of citizens participating in the RioAguas Southeast Region, Yes Positive Adapted from Cutter et al. 2010 City Adapted based on site visit with RioAguas. Guards River Guards initiative USA BQQFOEJY Expected Disaster Additional Cities Recommended Unit RioResiliente Sub-Index Variable / Indicator How Measured Effect on Justification Additional Notes on Application to RJ Context Related Where Used of Analysis Goal Resilience Southeast Region, Adapted to better capture the experiences of the large informal housing Housing Types Percentage housing units that are formal Yes Positive Adapted from Cutter et al. 2010 Neighborhood 4.E USA population in Rio. Southeast Region, Adapted to better capture the experiences of the large informal housing Housing Age Average age of formal and informal housing units Yes Negative Adapted from Cutter et al. 2010 Neighborhood 4.E USA population in Rio. Shelter Capacity - Vacant Southeast Region, Adapted to better capture the experiences of the large informal housing Percentage vacant units Yes Positive Adapted from Cutter et al. 2010 Neighborhood Housing USA population in Rio. Southeast Region, Adapted to better capture the experiences of the large informal housing Shelter Capacity - Vacant Hotels Number of hotels/motels per square km Yes Positive Adapted from Cutter et al. 2010 Neighborhood USA population in Rio. Southeast Region, Medical Capacity Number of hospital beds per 1000 population Yes Positive Adapted from Cutter et al. 2010 Neighborhood Adapted to the neighborhood level. USA Southeast Region, Evacuation Potential - Access Principal arterial miles per square km Yes Positive Adapted from Cutter et al. 2010 Neighborhood USA Evacuation Potential - Safe Southeast Region, Number of public schools per square km Yes Positive Adapted from Cutter et al. 2010 Neighborhood House USA Percentage of city population with authorized Adapted to better capture the experiences of the large informal housing Electricity - Access No Positive Adapted from CRI 2017 Los Angeles, USA Neighborhood electrical service population in Rio. Energy - Consumption kW per day per person No Negative RioResiliente Strategy Neighborhood 4.C Total annual public investment (BRL) in energy use Energy - Investment in Efficiency No Positive RioResiliente Strategy City 4.C efficiency Energy (Solar) - Municipal Total kW installed in municipal buildings No Positive RioResiliente Strategy City 4.B Access Amount of mWh produced by decentralized solar Energy (Solar) - Decentralization Yes Positive RioResiliente Strategy Neighborhood 4.B energy Infrastructure Energy (Solar) - Investment Total annual public investment (BRL) in solar energy No Positive RioResiliente Strategy City 4.B Energy (Solar) - Use Metrics tons of GHG offset by solar use No Positive RioResiliente Strategy City 4.B Percentage of existing luminaires substituted for Street Lighting - Type No Positive RioResiliente Strategy Neighborhood 3.A LED technology Street Lighting - Access Number of street lights per sq km No Positive RioResiliente Strategy Neighborhood 4.E Percentage of households with authorized access to Water - Access No Positive Adapted from CRI 2017 Los Angeles, USA Neighborhood clean water Water - Consumption Liters per day per person No Negative RioResiliente Strategy Neighborhood 4.C, 5.A Total annual public investment (BRL) in water use Water - Investment in Efficiency No Positive RioResiliente Strategy City 4.C, 5.A efficiency Water - Drinking Quality Micrograms of pollutants per liter in drinking water No Negative RioResiliente Strategy Neighborhood 4.D Micrograms of pollutants per liter in other water RioResiliente Strategy / RioAguas Water - Water Body Quality No Negative City 4.D, 4.F bodies data point Percentage of population covered by the sewage Sanitation - Access disposal system with treatment in the basins of No Positive RioResiliente Strategy Neighborhood 4.D, 4.E Guanabara, Sepetiba, and Jacarepagua Percentage of land-area within 0.5 km of a San Francisco Community Contamination Risk No Negative San Francisco, USA Neighborhood contamination risk Resilience Indicator System Reduction of Waste Diverted tons per sq. km. No Positive RioResiliente Strategy Neighborhood 5.A Pavement Percentage of paved streets/pedestrian walkways No Positive RioResiliente Strategy Neighborhood 4.E Percentage of roofs converted to gardens/green Green Roofs No Positive ICLEI, 2012 Durban, South Africa Neighborhood 3.B spaces Southeast Region, More indicators are included in this sub-index to better capture the Employment (Formal) Percentage employed in the formal labor sector Yes Positive Adapted from Cutter et al. 2010 Neighborhood USA informal labor market in Rio. Percentage female labor force participation in the Southeast Region, More indicators are included in this sub-index to better capture the Employment (Formal) - Women Yes Positive Cutter et al. 2010 Neighborhood formal sector USA informal labor market in Rio. Brazilian national Brazil is already recording these measurements, and RJ sees a Employment (Informal) Share of employment in the informal sector No Negative Site visits / ILO 2013 Neighborhood statistic considerable amount of informal labor market activity (see: ILO, 2013) Employment (Informal) - Outside Share of informal employment outside the informal Brazilian national Brazil is already recording these measurements, and RJ sees a No Negative Site visits / ILO 2013 Neighborhood Informal Sector sector statistic considerable amount of informal labor market activity (see: ILO, 2013) Share of women in employment in the informal Brazilian national Brazil is already recording these measurements, and RJ sees a Employment (Informal) - Women No Negative Site visits / ILO 2013 Neighborhood sector and informal employment statistic considerable amount of informal labor market activity (see: ILO, 2013) Percentage population not employed in farming, This captures the large dependence of Rio on the petroleum industry, Single Sector Employment Southeast Region, fishing, forestry, and extractive industries (both Yes Positive Cutter et al. 2010 Neighborhood and attempts to account for the informal labor market related to these Dependence USA formal and informal employment) industries. Number of jobs created per month (formal and Adapted to better capture the experiences of the large informal labor Jobs Created No Positive RioResiliente Strategy Neighborhood 5.A Economic informal sectors) market in Rio. Southeast Region, Adapted to better capture the experiences of the large informal housing Housing Capital Percentage homeownership Yes Positive Cutter et al. 2010 Neighborhood USA population in Rio. It may be difficult to measure the GINI coefficient on a neighborhood Southeast Region, Income and Equality GINI Coefficient Yes Positive Cutter et al. 2010 Neighborhood level, but other measures of inequality are acceptable, such as share of USA total annual income by income bracket. Ratio of large to small businesses (including in the Southeast Region, By including the informal economy in this metric, you better capture the Business Size Yes Positive Adapted from Cutter et al. 2010 Neighborhood formal and informal economy) USA experiences of Rio citizens. You should consider here any alternative sources of medical care that Southeast Region, are not captured by simple physical registration records, i.e. informal Health Access Number of physicians per 1000 population Yes Positive Adapted from Cutter et al. 2010 Neighborhood USA clinics, community midwives, or other types of community healers citizens may go to. Volume of solid waste reintroduced in the production Reuse of Solid Waste No Positive RioResiliente Strategy Neighborhood 5.B chain in metric tons Participation in Rio + B Number of companies involved in Rio +B. No Positive RioResiliente Strategy Neighborhood 5.C

BQQFOEJY Expected Disaster Additional Cities Recommended Unit RioResiliente Sub-Index Variable / Indicator How Measured Effect on Justification Additional Notes on Application to RJ Context Related Where Used of Analysis Goal Resilience There can be an investigation of people's awareness of the People's awareness of how easy it is to get communication channels, for example, how they hear about the Adapted from da Silva, 2015; Informability - Awareness information necessary for the journey as measured Yes Positive Sheffield, UK Neighborhood 3.C smartphone app/Facebook page/other social media pages, how they Nicolas et al., 2003; Litman, 2017 via an ordinal scale in a survey/scorecard evaluate the information channels, etc., to better distribute resources that promote these communication channels. Density of transit information boards per Adapted from da Silva et al, 2015; Informability - Boards Yes Positive Sheffield, UK Neighborhood 3.C neighborhood Nicolas et al., 2003; Litman, 2017 Adapted from da Silva et al, 2015; Informability - Apps Number of transportation apps for smartphones Yes Positive Sheffield, UK Neighborhood 3.C Nicolas et al., 2003; Litman, 2017 Frequency transportation apps are updated for Adapted from da Silva et al, 2015; Informability - Updating Yes Positive Sheffield, UK Neighborhood 3.C smartphones Nicolas et al., 2003; Litman, 2017 da Silva et al, 2015; Nicolas et al. Rio could also do statistical analysis on buffer time, for example, counting Reliability Punctuality rate of all transit types Yes Positive Sheffield, UK Neighborhood 3.C 2003 how many delays occur in 5 min, 10 min, 30 min, and 1 hour time-period. Adapted from da Silva et al, 2015; Time required to get to the destination (in real time Original destination (OD) and route information can be obtained from Reachability - Stations Yes Negative Nicolas et al. 2003; Wells & Raad, Haia, Netherlands Neighborhood 3.C or time as perceived by users) map apps on people's phones. 2007 Adapted from da Silva et al, 2015; Reachability - Waiting Waiting time perceived by users Yes Negative Nicolas et al. 2003; Wells & Raad, Haia, Netherlands Neighborhood 3.C 2007 Adapted from da Silva et al, 2015; Reachability - Transfers Transfer times per person Yes Negative Nicolas et al. 2003; Wells & Raad, Haia, Netherlands Neighborhood 3.C 2007 Adapted from da Silva et al, 2015; Low-income communities usually have fewer transportation mode Variety of transportation modes to allow enough Los Angeles, USA; Availability Yes Positive Nicolas et al. 2003; Wells & Raad, Neighborhood 3.C alternatives, so the neighborhood level allows a clearer picture about who alternatives Curitiba 2007 in the city has access. Adapted from da Silva et al, 2015; Los Angeles; Transport Usage - Trips Number of trips per inhabitant per time period Yes Positive Nicolas et al. 2003; Wells & Raad, Neighborhood 3.C Could instead be measured in kilometrage. Curitiba, Brazil 2007 Adapted from da Silva et al, 2015; Los Angeles; Transport Usage - People/Trip Number of people transported per trip Yes Positive Nicolas et al. 2003; Wells & Raad, Neighborhood 3.C Curitiba, Brazil 2007 Adapted from da Silva et al, 2015; Number of people transported in a certain amount of Los Angeles; Mobility Transport Usage - People/Time Yes Positive Nicolas et al. 2003; Wells & Raad, Neighborhood 3.C time Curitiba, Brazil 2007 Adapted from da Silva et al, 2015; Proportion of travelers using public transportation in Los Angeles; Modal Split Yes Positive Mobility and Exposure Indicators City 3.C a given time period Curitiba, Brazil Guidebook As low-income communities have limited access to public transport Adapted from da Silva et al, 2015; especially rail services, they might use bus services or other modes to Los Angeles; Intermodal Integration - Number Number of intermodal connectors Yes Positive Mobility and Exposure Indicators City 3.C reach the nearest rail station. In this case, it's important to measure the Curitiba, Brazil Guidebook intermodal connectivity/integration to evaluate the equity between neighborhoods. As low-income communities have limited access to public transport Adapted from da Silva et al, 2015; especially rail services, they might use bus services or other modes to Los Angeles; Intermodal Integration - Capacity Capacity of intermodal connectors Yes Positive Mobility and Exposure Indicators City 3.C reach the nearest rail station. In this case, it's important to measure the Curitiba, Brazil Guidebook intermodal connectivity/integration to evaluate the equity between neighborhoods. Adapted from da Silva et al, 2015; Los Angeles; Congestion - Bottlenecks Number and length of bottlenecks Yes Negative Mobility and Exposure Indicators Neighborhood 3.C Curitiba, Brazil Guidebook Adapted from da Silva et al, 2015; Los Angeles; Congestion - Speed Average speed of road vehicles Yes Negative Mobility and Exposure Indicators Neighborhood 3.C Curitiba, Brazil Guidebook Adapted from da Silva et al, 2015; Total daily/monthly/yearly delay time, delay time = Los Angeles; Delay Yes Negative Mobility and Exposure Indicators Neighborhood 3.C actual trip time - planning trip time Curitiba, Brazil Guidebook Adapted from da Silva et al, 2015; Los Angeles; Traffic Volume Number of vehicles across all modes Yes Positive Mobility and Exposure Indicators Neighborhood 3.C Curitiba, Brazil Guidebook Adapted from da Silva et al, 2015; Transit Accessibility - Vehicle Los Angeles; This metric helps identify the equity of communications regarding access Number of public transport vehicles Yes Positive Mobility and Exposure Indicators Neighborhood 3.C Volume Curitiba, Brazil to public transport. Guidebook Adapted from da Silva et al, 2015; Los Angeles; Transit Accessibility - Length Length of public transport networks in meters Yes Positive Mobility and Exposure Indicators Neighborhood 3.C Curitiba, Brazil Guidebook

BQQFOEJY Expected Disaster Additional Cities Recommended Unit RioResiliente Sub-Index Variable / Indicator How Measured Effect on Justification Additional Notes on Application to RJ Context Related Where Used of Analysis Goal Resilience Adapted from da Silva et al, 2015; Density of public transport stations per Los Angeles; Transit Accessibility - Density Yes Positive Nicolas et al., 2003; Litman, 2017; Neighborhood 3.C neighborhood Curitiba, Brazil CRI 2017 Adapted from da Silva et al, 2015; Los Angeles; Transit Accessibility - Access Area/population coverage per station Yes Positive Nicolas et al., 2003; Litman, 2017; Neighborhood 3.C Mobility Curitiba, Brazil CRI 2017 Adapted from da Silva et al, 2015; Los Angeles; Affordability People's perception of transit pricing Yes Negative Nicolas et al., 2003; Litman, 2017; Neighborhood 3.C Curitiba, Brazil CRI 2017 Landslide Vulnerability See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex RioResiliente Strategy / San Flood Vulnerability See subindex Yes Negative Francisco Community Resilience San Francisco, USA Neighborhood See subindex Indicator System Strong Winds See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex RioResiliente Strategy / San Heat Vulnerability See subindex Yes Negative Francisco Community Resilience San Francisco, USA Neighborhood See subindex Indicator System Sea Level Rise See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Hazard Epidemics and Pandemics See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Droughts See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Traffic See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Accidents with Urban See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Infrastructure Agglomeration of People w/ See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Impact in Normalcy Criminal Acts in Urban Spaces See subindex Yes Negative RioResiliente Strategy Neighborhood See subindex Sanitation See subindex Yes Positive RioResiliente Strategy Neighborhood See subindex

BQQFOEJY Expected Use for Prevention, RioResiliente Goal / Recommended Unit Sub-Index Variable / Indicator How Measured Effect on Justification Efficiency, and/or Section of IDB Additional Notes on Application to RJ Context of Analysis Resilience Predictions Report Challenge is the ability for data sharing between different entities Current Project Opportunities Number of current COR programs and partnerships Positive ISO/IEC, 2015 Prediction/ Prevention Block Operations Center (dependent on COR partnership agreements). Challenge is the ability for data sharing between different entities New Project Opportunities Number of future COR programs and partnerships Positive ISO/IEC, 2015 Prediction Block Operations Center Technology Innovation (dependent on COR partnership agreements). Keeping track of high-tech enterprises can help the city identify private Share of Knowledge-Intensive Proportion of high-tech enterprises/companies (both Positive ISO/IEC, 2015 Efficiency City Operations Center sectors that they can collaborate with, especially for reducing their Enterprises within the formal and informal gig economy) workload regarding data cleaning and analysis In addition to increasing the efficiency of traffic management, network- Percentage of traffic lights connected to real-time 3C / Access to Real-Time Information Positive Cohen, 2014 Efficiency City connected infrastructure can also be helpful for the efficient maintenance traffic management system Monitoring and Control and monitoring of the city infrastructure Having the information on Wifi coverage within the city can help inform Number of Wifi hotspots per sq.km. (comparing the Wifi Coverage - Normal Days Positive Cohen, 2014 Prevention Block Monitoring and Control COR of the infrastructure capacity they could use for monitoring and formal and informal neighborhood) on normal days prevention on a normal day Having the information on Wifi coverage within the city can help inform Number of Wifi hotspots per sq.km. (comparing the Wifi Coverage - Post-Disaster Positive Cohen, 2014 Prevention Block Monitoring and Control COR of the infrastructure capacity they could deploy during and after a formal and informal neighborhood) post-disaster Technology disaster strikes In addition to increasing monitoring capacity, network-connected Infrastructure Number of infrastructure components with installed Sensor Coverage Positive Cohen, 2014 Prevention Block 3C infrastructure can also be helpful for the efficient maintenance and sensors monitoring of the city infrastructure Up to COR to define both 'urban' and 'infrastructure' such as which of their Share of Network Infrastructure in Amount of urban infrastructure investments in BRL (for Positive ISO/IEC, 2015 Prevention Block Monitoring and Control investments are contributing towards 'smart city' infrastructures and in Total Investment both formal and informal neighborhood) which part of the city Average time used for recovering from Recovery Times telecommunication congestion per resident Positive ISO/IEC, 2015 Efficiency Neighborhood Operations Center Rio should build a recovery time measurement instrument

Refer to the percentage of the government Percentage of Open Government Encouraging an open data infrastructure within the City will increase unclassified documents open on public networks Positive ISO/IEC, 2015 Prediction City Smart Services Information transparency (citizen, journalist, communities) Government Sector Electronic Number of electronic devices used in public sector Monitoring and Control Positive Batagan, 2011 Efficiency City Devices (computers, cell phones, etc...) Operations Center Government Sector Internet Percentage of government institutions with Internet Monitoring and Control Positive Batagan, 2011 Efficiency City Data integration will require an Internet-connected infrastructure for the city Governance Connectivity connectivity Operations Center Number of new systems, hardware being Operations Center This variable will allow COR to justify the added value of new investment System Construction Positive Hara et al., 2016 Prevention City constructed/added to COR's capabilities Field Systems on infrastructure Knowing the BRL spent for operation and maintenance of the ICT system Monitoring and Control System Cost Performance Operation cost of ICT systems Positive Hara et al., 2016 Efficiency Neighborhood can help COR identify the best use of resources, especially if they can Operations Center compare it to another identical system in another city such as Madrid City Video Surveillance Penetration Number of video cameras per capita Positive ISO/IEC, 2015 Prevention Block Field Systems Video camera locations (diffuse or concentrated in different parts of Rio) Video camera locations (diffuse or concentrated in different informal City Video Surveillance Penetration Number of video cameras per informal community Positive ISO/IEC, 2015 Prevention Block Field Systems communities) Ratio of all kinds of accidents predicted by ICT 3C / Operations Knowing the ratio of incidents COR prevents, COR can better quantify how Accident Ratio measures in a period of time including aspects such as Positive Hara et al., 2016 Prediction Block Center much it has saved the city in terms of recovery and relief operations victims, damaged projects, etc. Field Systems ICT Penetration for Disaster Number of sensing terminals in disaster-prone areas This variable will allow COR to justify the prevention measurement taken Positive Hara et al., 2016 Prediction Neighborhood Operations Center Prevention - Formal per formal community for the vulnerable community ICT Penetration for Disaster Number of sensing terminals in disaster-prone areas in This variable will allow COR to justify the prevention measurement taken Positive ISO/IEC, 2015 Prevention/Prediction Neighborhood Operations Center Safety and Security Prevention - Informal informal community for the vulnerable community The publication rate of timely alerts for natural 2C / Smart Services Publication rate can inform COR of the efficiency and accuracy of the Disaster Alert Publication Rate Positive ISO/IEC, 2015 Efficiency Neighborhood disasters (storms, flooding, etc…) Operations Center current system Time saved with using COR (hours, minutes. etc...) Depends on different disaster types and steps needed to evacuate people Decrease in Evacuation Time Positive Hara et al., 2016 Prediction/Efficiency Block 2C / Smart Services especially in dense informal neighborhoods to safety during disaster events COR must review if it is capable of alternative communication methods. It Information Distribution Post- Preventable incidents of network congestion (via Positive GSMA, 2013 Efficiency Block 2C / Smart Services should predict/determine network congestion areas and plan/deploy Disaster - Congestion Prevention satellite phones or wifi network antenna) network congestion solutions accordingly Information Distribution Post- Post-disaster Incidents communicated via Positive GSMA, 2013 Prevention City 2C / Smart Services Disaster - Incident Communication email/internet versus phone call to public COR has to know their outreach capacity, especially the smartphone Smartphone Penetration Percentage of residents with smartphone access Positive Cohen, 2014 Prevention/ Efficiency Neighborhood Smart Services where most engagement happens In addition to the smartphone user, knowing the overall number of people Smart Services Cell Phone Connections - City Number of cell phone connections per 100,000 people Positive Cohen, 2014 Prevention/ Efficiency City with mobile phones is also important as one of the main outlets of COR Monitoring and Control messaging is through SMS Knowing the number of people with mobile phones in informal Number of cell phone connections per 100,000 people Smart Services User Capacity Cell Phone Connections - Informal Positive Cohen, 2014 Prevention/ Efficiency Neighborhood neighborhood is important because most of the people living there do not in informal neighborhoods Monitoring and Control necessarily have access to data even if they have a smartphone Monitoring and Control Number of users inputting information can inform COR of the level of Number of Users Percentage of users inputting information into COR Positive Cohen, 2014 Efficiency Neighborhood Operations Center engagement and number of active users How often residents send crowdsourced information to Number of users inputting information can inform COR of the level of Online Civic Engagement Positive ISO/IEC, 2015 Efficiency Neighborhood Smart Services COR via civic apps engagement and how active users are within the platform Public satisfaction level with COR network-based Smart Services One way for COR to evaluate the performance of their network-based Satisfaction Level Positive ISO/IEC, 2015 Efficiency City services from a 1-5 scale (1 is low satisfaction) Operations Center service is by using a rating system Convenience of Government Public rating of the convenience of public services Smart Services The City can use a rating system to gain insight on the quality of their Public Convenience and Positive ISO/IEC, 2015 Efficiency City Services from a 1-5 scale (1 is low satisfaction) Operations Center service delivery Comfort Convenience of Smart Traffic Public rating of the convenience of obtaining traffic Smart Services Information Administration and information via smart terminals from a 1-5 scale (1 is Positive ISO/IEC, 2015 Efficiency City Operations Center Service low satisfaction)

BQQFOEJY Expected Use for Prevention, RioResiliente Goal / Recommended Unit Sub-Index Variable / Indicator How Measured Effect on Justification Efficiency, and/or Section of IDB Additional Notes on Application to RJ Context of Analysis Resilience Predictions Report If possible, all social media indicators should be measured on a neighborhood level if any sort of geolocation information is available through the platform. In terms of Community Size, examples from some Smart Services Breadth - Community Size Number of social media followers per platform Positive Herman, 2013 Prevention / Efficiency Neighborhood platforms include: Facebook fans - number of people who like your page, Operations Center or number of unique people who have seen any conect associated with the page). Twitter followers - number of accounts subscribed to your Twitter feed. Difference between the number of current users from Smart Services Need to also potentially adjust for higher number of followers after an Breadth - Community Growth Positive Herman, 2013 Prevention / Efficiency Neighborhood users in the previous months per platform Operations Center emergency Smart Services Depth - Conversions Number of desired actions/click-throughs Positive Herman, 2013 Efficiency Neighborhood Operations Center Smart Services Depth - Views As measured in number of unique number of views Positive Herman, 2013 Efficiency Neighborhood Operations Center Need to consider which city zones have low access internet access, which Smart Services Depth - Minutes Watched Measured in number of minutes watched Positive Herman, 2013 Efficiency Neighborhood will affect streaming ability and speeds that may reduce the minutes Operations Center watched in some communities Engagement Responsiveness - Measured by the number of questions answered Smart Services Positive Herman, 2013 Efficiency Neighborhood Questioned Answered through social media Operations Center Engagement Responsiveness - Average time it takes for the City to respond to a social Smart Services Negative Herman, 2013 Efficiency Neighborhood Response Time media request Operations Center Engagement Volume - Total Number of total mentions, likes and comments per Smart Services Social Media Positive Herman, 2013 Efficiency Neighborhood Mentions platforms Operations Center Engagement Volume - Unique Smart Services Number of unique mentions per platform Positive Herman, 2013 Efficiency Neighborhood Mentions Operations Center Smart Services Loyalty - Regular Visitors Percentage of users who have multiple visits Positive Herman, 2013 Efficiency Neighborhood Operations Center Percentage of positive comments about specific Smart Services Customer Experience - Sentiment content as determined by a textual analysis of positive, Positive Herman, 2013 Efficiency Neighborhood Operations Center negative or neutral comments Percentage of positive comments about your overall Customer Experience - Top Smart Services social media content as determined by a textual Positive Herman, 2013 Efficiency Neighborhood Keywords Operations Center analysis of positive, negative or neutral comments Percentage of positive hashtags about your overall Customer Experience - Top Smart Services social media content as determined by a textual Positive Herman, 2013 Efficiency Neighborhood Hashtags Operations Center analysis of positive, negative or neutral comments As measured through a survey on the social media Smart Services Feedback - Satisfaction Positive Herman, 2013 Efficiency Neighborhood platform from a 1-5 scale (1 is low satisfaction) Operations Center The number of demographic categories represented amongst users, as measured through nominal Smart Services It would be beneficial to ask for participants Codigo de Enderecamento Feedback - Diversity of Users Positive Herman, 2013 Efficiency Neighborhood categories users can fill in capturing demographic data Operations Center Postal (CEP) to determine their location such as ethnicity, age, socioeconomic status, etc.

BQQFOEJY Expected Additional Cities Recommended Sub-Index Variable / Indicator How Measured Effect on Justification RioResiliente Goal Additional Notes on Application to RJ Context Where Used Unit of Analysis Resilience This is data already captured by GeoRio, but by reducing the unit of analysis, it will better show which portions of a single Percentage of area in landslide susceptibility map RioResiliente Strategy / Landslide Vulnerability Negative Neighborhood neighborhood are vulnerable to landslides, rather than the city high risk zone based on soil tests GeoRio data point overall, to better prioritize resilience efforts and focus on communities which have a high percentage of vulnerable land. RioResiliente Strategy / This will better show which portions of a single neighborhood are Percentage of the land‐area in the 100‐year storm San Francisco Community vulnerable to flooding, rather than the city overall, to better Flood Vulnerability Negative San Francisco, USA Neighborhood floodplain Resilience Indicator prioritize resilience efforts and focus on communities which have a System high chance of flooding. Impervious surfaces increase the possibility of and volume of flooding, which is a critical metric to have on even the San Francisco Community Percentage of surfaces that are impervious in terms neighborhood block level, given that impervious surfaces combined Impervious Surfaces Negative Resilience Indicator San Francisco, USA Block 3.B of area with steep slopes will exacerbate the effects of floodings. For System example, a house at the bottom of a steep slope is vulnerable to a higher volume of flooding than the top of the slope. Precipitation Centimeters Negative AlertaRio data point Block Humidity Percentage Negative AlertaRio data point Block Temperature Degrees in Celsius Negative AlertaRio data point Block Atmospheric Pressure hPa Negative AlertaRio data point Block Intense Rains Wind Direction Degrees Negative AlertaRio data point Block Wind Speed Km/hour Negative AlertaRio data point Block River Levels Centimeters Negative RioAguas data point Neighborhood This is to deal with potential fissures within mountains and hills that Geological Studies Availability of geological risk assessment maps Positive Site Visits Neighborhood would not be captured by soil tests but still can still lead to landslides. This attempts to capture not just the area of land affected but also Number of people living in the floodplain the number of people living in that area. Given low-income and Floodplain Population Negative Adapted from Tucci, 2002 Neighborhood (population/sq.km.) informal neighborhoods are more densely packed, this will better capture how many individuals are affected. This attempts to capture not just the area of land affected but also Number of people living in landslide zone the number of people living in that area. Given low-income and Landslide Zone Population Negative Adapted from Tucci, 2002 Neighborhood (population/sq.km.) informal neighborhoods are more densely packed, this will better capture how many individuals are affected. Flood Frequency Number of flood incidents per year Negative Tucci, 2002 Curitiba, Brazil Neighborhood When individuals believe the specific vulnerability is a problem for Percentage of community residents who identify their community, they are more likely to take steps to prepare for its Community Perception Positive Jamieson, 2016 Neighborhood "intense rains" as an important issue effects including supporting policy and institutional resilience efforts. Beijing bans high-emission vehicles in the anti-haze movement; Greenhouse Gas Emission - Citywide GHG emissions level (tons of GHG Negative Zhu et al, 2015 Beijing, China City 3.C Rio can adjust the standard to judge whether the vehicle emission Total produced in a certain period) is high enough to ban Greenhouse Gas Emission - Percentage of high-emission vehicles among all Negative Zhu et al, 2015 Beijing, China City Vehicles metropolitan vehicles Hourly pollutant concentrations at a single point. Vehicle Emissions Impact - Air Pollutants analysed include ozone, nitrogen oxides, Negative Wang et al, 2014 Beijing, China Neighborhood 3.C Quality sulphur dioxide, carbon monoxide and particulates. Beijing uses how many meters can be seen to measure air quality; Vehicle Emissions Impact - How far in meters people can see in the air Positive Wang et al, 2014 Beijing, China Neighborhood 3.C however, Rio usually has heavy smog which can affect the visibility Visibility test result (smog versus haze) Vehicle Emissions Impact - Density of vehicles in the measured area Negative Zannin, et al 2002 Curitiba, Brazil Neighborhood 3.C Noise Beijing Public Security Traffic accident fatalities (across all transportation Pedestrian fatality and injury rate can be considered together with Traffic Security - Fatalities Negative Traffic Management Beijing, China Neighborhood 3.C modes) walkability for transportation planning Yearbook 2009 Beijing Public Security Traffic accident injury rate (across all transportation Pedestrian fatality and injury rate can be considered together with Traffic Security - Injuries Negative Traffic Management Beijing, China Neighborhood 3.C modes) walkability for transportation planning Yearbook 2009 Pedestrian fatality and injury rate can be considered together with Pedestrian density in terms of walkway length (how Kansas City Walkability walkability for transportation planning. In Rio's context, the Walkability - Length Positive Kansas City, USA Neighborhood 3.C many meters of walkways in a 400m. radius circle) Plan measurement could also include pedestrian width, connectivity Saturation of Road between intersections, and quality of pavements. Ratio of population with access to diverse-use Pedestrian fatality and injury rate can be considered together with Infrastructure Walkability - Population Positive Rattan et al, 2012 Halton, Canada Neighborhood 3.C places like groceries walkability for transportation planning Adapted from Burningham Rio could also track the time and efficiency of the road Road Infrastructure Quality Percentage of well-maintained road segments Positive Lima, Peru Neighborhood 3.C and Stankevich, 2005 maintenance projects Road Infrastructure Quality - Adapted from Burningham Rio could also track the time and efficiency of the road Number of road construction/maintenance projects Positive Lima, Peru Neighborhood 3.C Construction Projects and Stankevich, 2005 maintenance projects This captures the ability of road infrastructure to react to heavy rains (permeate/absorb/recycle rainwater), and is related to the concept of a "sponge city" which was implemented in two series of Adapted from The Permeability of Road Amount of rainfall diverted from estuarine systems in pilot cities in China. The key is to combine the rainfall treatment Positive Embassy of the Kingdom Beijing, China Neighborhood Infrastructure liters of water per sq.m. of road system with the road system. What's most important to Rio is to of Netherlands, 2016 incorporate the idea of becoming a "sponge city" in order to have infrastructure systems that are able to react to sudden rains and floods. BQQFOEJY Saturation of Road Infrastructure

Expected Additional Cities Recommended Sub-Index Variable / Indicator How Measured Effect on Justification RioResiliente Goal Additional Notes on Application to RJ Context Where Used Unit of Analysis Resilience Average commuting time per person/transport Rio can use this metric to track the efficiency of different modes for Commuting Time Negative RioResiliente Strategy Rome, Italy Neighborhood 3.C mode/trip further transportation planning resource distribution. Total economic loss caused by maintenance, repair, In the context of Rio, economic loss can be calculated by temporal Economic Loss and construction of transportation systems to Negative RioResiliente Strategy Beijing, China City 3.C episodes or disaster type. prevent and react to natural disasters EU RISER Program When individuals believe the specific vulnerability is a problem for People's satisfaction with the whole transportation Vita, & Marolda, 2008; (Roadside their community, they are more likely to take steps to prepare for its Community Perception Positive Neighborhood 3.C system Jamieson, 2016 Infrastructure for effects including supporting policy and institutional resilience Safer Roads) efforts. Additional Shocks and Stresses* Strong Winds To be determined RioResiliente Strategy Heat Vulnerability To be determined RioResiliente Strategy Sea Level Rise To be determined RioResiliente Strategy Epidemics and Pandemics To be determined RioResiliente Strategy Droughts To be determined RioResiliente Strategy Accidents with Urban Infrastructure To be determined RioResiliente Strategy Agglomeration of People with Impact on To be determined RioResiliente Strategy Normalcy Criminal Acts in Urban Spaces To be determined RioResiliente Strategy Sanitation To be determined RioResiliente Strategy * The same process should be carried out in concert with academic partners for the additional nine shocks and chronic stresses identified in the RioResiliente Strategy.

BQQFOEJY