MAPPING OF NATIONAL ACTORS NATIONAL OF MAPPING

DATA AND INDICATORS ON SOCIAL SCIENCE RESEARCH

DOING RESEARCH IN BOLIVIA Country Report Center for the Studies of Social and Economic Realities & The Global Development Network October 2020 ASSESSMENT OF THE CONTEXT THE OF ASSESSMENT DOING RESEARCH IN BOLIVIA Country Report

DISCLAIMER

This report is produced with support from Global Development Network. The views expressed in are not necessarily GDN's views. The Global Development Network is a public international organization that supports high-quality, policy-oriented social science research in developing and transition countries to promote better lives. www.gdn.int

2 Doing Research in BOLIVIA and Cooperation. In 2017, GDN conducted THE DOING a synthesis of the pilot studies2 and RESEARCH PROGRAM developed a standard methodology for studying social science research systems in Bridging the research gap and improving developing countries,3 the ‘Doing Research development policies Assessment’. Since 2018, GDN has been implementing Doing Research Assessments Today, governments and donors alike in partnership with competitively selected have little systematic information about national research institutions, with the the state of social science research, except aim of generating evidence on research for in a few developed countries. Yet, the systems. The program also aims to support implementation of the global agenda for the emergence of a network of research sustainable development requires local institutions in the Global South dedicated to research capacities to ensure that the informing national research policies, using scientific community is equipped to critically new research-based, comparative evidence. analyze development and policy challenges, and to accompany actions and reforms Doing Research National Focal Points – with contextualized knowledge of the local A Southern network of local ‘research environment. on research’ expertise An in-depth analysis of research systems is Through the collaboration between GDN and key to understanding how to bridge this gap these local institutions, the program aims and raise the profile of research generated to inspire research policies, map research in developing countries. Research systems strengths, support research capacity-building analysis can help policymakers, donors efforts and enhance the quality of research and academics answer the question: What that can be used for policy decisions and can be done to further generate and local democratic debate in developing mainstream local research as a key input countries. Social science research provides to public debate and sustainable human a critical analysis of societies and human development policies? behavior and contributes to a better Assessing and benchmarking social understanding of development challenges science research systems – which is fundamental to realizing national and global development agendas. Country Doing Research (launched in 2014) is an reports, comparative global reports and initiative of the Global Development Network data will inform actors from research, (GDN) that aims to systematically assess how development and policy communities about the features of a national research system1 their policy-oriented research environment impact the capacity to produce, diffuse and and how it can be improved. use quality social science research to the benefit of social and economic development. A pilot phase (2014-2017) in 13 countries was supported by the Agence Française de 1 In this document, the terms ‘research system’ and ‘social Développement, the Bill & Melinda Gates science research system’ are used interchangeably. Foundation, the French Ministry of Foreign 2 http://www.gdn.int/sites/default/files/GDN-2017-DR-pilot- Affairs and International Development, synthesis.pdf and the Swiss Agency for Development 3 http://www.gdn.int/sites/default/files/GDN%20-%20 Theoretical%20Framework.pdf

Doing Research in BOLIVIA 3 Doing Research Assessment: to Doing Research Framework: the core of understand, map and assess research the assessment systems1 The Doing Research Framework is a mixed- A unique feature of the Doing Research method research module that allows a Assessment4 is the equal importance the contextualized comparative enquiry into methodology gives to production, diffusion a national research system, looking at key and uptake factors and actors in the analysis factors that determine the production, of systemic barriers and opportunities for diffusion and uptake of social science. It social science development. would typically serve as a magnifying glass to identify aspects that need the attention It involves three steps for analyzing the of the regulator, or to provide a baseline factors that impact the social science for strategizing investments in capacity- research system in a given country or region, building for research production, its which will lead to several knowledge outputs diffusion or its use. and awareness-raising efforts. The Framework acts as the basis for Steps and activities for implementing a comparing and benchmarking research Doing Research Assessment systems in different countries and includes 54 indicators. These indicators are populated according to the national Context analysis context framed by the National Focal Points Mapping of research actors (NFP); these follow the project guidelines while adapting them to their national Doing Research Framework environment. Therefore, each country follows the same framework and general Collection of new data at country level guidelines, allowing for comparisons between different reports of the Publication of the Doing Research indicators that define the Doing Research Assessment Assessments (DRA). The same is true for the Country Reports, which follow a similar National seminar and dissemination structure.

1. Production 2. Diffusion 3. Policy uptake Inputs 1.1 Research inputs 2.1 Actors & networks 3.1 Policy-friendly research Activities 1.2 Research culture 2.2 Research 3.2 Research-based and support services communication practices policymaking Outputs 1.3 Research output 2.3 Research 3.3 Research-based policy & training communication products tools Outcomes 1.4 Opportunities & 2.4 Popularization of 3.4 Research for better sustainability science policies

4 http://www.gdn.int/doing-research-assessment

4 Doing Research in BOLIVIA ACKNOWLEDGMENTS This research was supported by the Global The authors gratefully acknowledge the Development Network (GDN) through the research team and collaborators from Doing Research Program. Our special thanks CERES for their assistance, opinions, go to the supervising team at GDN for their discussions, comments and data. Their extraordinary work in supporting our team; contributions improved this report and to our colleagues from participating significantly. countries for sharing their expertise for this research. Finally, we would also like to express our gratitude to the numerous actors and We would also like to thank our mentor, Dr. institutions that participated in this project Hebe Vessuri, for her ongoing support and for sharing their experiences, perceptions valuable input in guiding our research from and concerns during the course of this the very beginning of this endeavor. research.

The Research Team (Authors) In collaboration with in Bolivia Pedro Badran Luis Pablo Cuba Gilda Jauregui Roberto Laserna Andrés Cuba Sharim Ribera Nelson Gironas Manuel Gómez Humberto Moya Santiago Laserna

Doing Research in BOLIVIA 5 Table of Contents

EXECUTIVE SUMMARY...... 12 Main findings...... 14 Levers of Change...... 14 INTRODUCTION...... 16 Highlights...... 16 CONTEXT ANALYSIS...... 18 Highlights...... 18 Political Context...... 18 Economic Context...... 22 International Context...... 28 Historical and Cultural Context...... 30 Research–Policy Nexus...... 32 The Polishing Model...... 32 The Spotlight Model...... 33 The Toolkit Model...... 33 Project Limitations...... 34 Access...... 34 Sample size...... 34 Lack of available and/or up-to-date data...... 34 Lack of prior research studies in this area...... 35 Application of the methodology in practice...... 35 STAKEHOLDER MAPPING...... 36 Highlights...... 36 Characteristics of The Main Categories of Stakeholders...... 36 Higher education institutions...... 36 Funding agencies...... 37 Private sector (for-profit and private research institutions)...... 37 Civil society...... 38 Stakeholder Listing...... 38 Selection criteria...... 38 Exclusion criteria...... 38 Stakeholder Validation and Analysis...... 39 Methodology...... 39 Relationship among Stakeholders...... 39 Power, interest and influence in social science research...... 49

6 Doing Research in BOLIVIA SAMPLING...... 50 Sampling – first attempts...... 50 Criteria for the selection of subgroups...... 52 Representativeness of the selected sample...... 53 Representativeness of the surveyed sample...... 54 DRA FRAMEWORK...... 56 Highlights...... 56 Production...... 57 Research inputs...... 58 Research culture and services...... 61 Research output and training...... 64 Learning and sustainability...... 67 Diffusion...... 68 Actors and networks...... 69 Research communication...... 72 Research communication products...... 72 Popularization of science...... 73 Uptake...... 75 Policy-friendly research materials...... 76 Research-based policymaking...... 78 Research-based policy products...... 80 The use of research for better policies...... 81 DRA Framework highlights...... 83 Ethical Considerations...... 86 CONCLUSIONS...... 88 Highlights...... 88 Recommendations...... 89 REFERENCES...... 93 Stakeholder Mapping...... 94 Dra Framework...... 98 ANNEXES ...... 101 Annex 1: Context Analysis: List of Actors/Institutions Consulted...... 101 Annex 2: Codification of Interviews Consulted for Context Analysis and DRA Framework...... ���103 Annex 3: Stakeholder Mapping /Selected Sample...... 106 Annex 4: Distribution of Selected Sample...... 112 Annex 5: Stakeholder Mapping – List of Universities in Bolivia and Academic Staff Members...... ����113

Doing Research in BOLIVIA 7 List of Tables

Table 1: Proportion of Researchers per Level of Academic Degree...... 24 Table 2: Researchers per Scientific Discipline in Bolivia...... 24 Table 3: Researchers per Employment Sector in Bolivia...... 25 Table 4: Indicators for Government Expenditure on R&D...... 27 Table 5: Higher Education Institutions...... 40 Table 6: Private Sector...... 41 Table 7: Civil Society...... 43 Table 8: Government and Funding Agencies...... 45 Table 9: Sampling Criteria...... 51 Table 10: Final Sampling Process: Subgroups Constructed Based on Size and Share...... 51 Table 11: Example of Calculation of the Final Number of Respondents...... 52 Table 12: Final Sampling Process: Institutions Selected Based on Size and Share...... 53 Table 13: Final Sampling Process: Subgroups Based on Location and Share...... 53 Table 14: Bolivia: Number of Researchers with Ph.D...... 58 Table 15: Researchers: Number of Publications in the Last Three Years, per Type of Document...... 65 Table 16: Researchers: Accessibility of Research Discussions for Minority Groups, Policymakers, Community Groups and Individual Community Members, per Type of Institution (Percentage)...... 71 Table 17: Researchers: Levels of Satisfaction with Media Coverage, per Type of Institution (Percentage)...... 74 Table 18: Researchers and Administrators: Grants Received from Policymakers, Per Type of Institution (Percentage)...... 77 Table 19: Researchers: Having Held a Policymaker Position, per Type of Institution (Percentage)...... 78 Table 20: Researchers: Membership of Bodies Advising Policymakers, per Type of Institution (Percentage)...... 79 Table 21: DRA Framework Highlights...... 83

8 Doing Research in BOLIVIA List of Figures

Figure 1: Human Flight and Brain Drain Index 2019...... 25 Figure 2: Research and Development Expenditure in Bolivia (% of GDP)...... 26 Figure 3: Group Discussion on Stakeholder Inter-relationships – Group 1...... 47 Figure 4: Group Discussion on Stakeholder Inter-relationships – Group 2...... 48 Figure 5: Group Discussion on Stakeholder Inter-relationships – Group 3...... 48 Figure 6: Group Discussion on Stakeholder Inter-relationships – Group 4...... 49 Figure 7: Classification of Four Main Stakeholders – Mendelow Matrix...... 50 Figure 8: Representativeness of the Sample: Share of Stakeholders in the Initial List and Final Sample, per Type of Institution (In Percentage)...... 54 Figure 9: Representativeness of the Sample: Share of Stakeholders in the Initial List and Final Sample, per Location (Percentage)...... 55 Figure 10: Researchers: Time Allocated to Research per Type of Institution...... 60 Figure 11: Researchers: Existence of a Research Body and a National Policy Related to Social Science Research, per Type of Institution...... 61 Figure 12: Access to Research Mentors, per Type of Institution (Percentage)...... 63 Figure 13: Researchers: Levels of Satisfaction with Available Administrative Support, per Type of Institution...... 64 Figure 14: Administrators: Proportion of Staff with PhD in Social Science per Type of Institution (Percentage)...... 66 Figure 15: Researchers: Duration of Research Training (in Weeks) per Type of Institution (Percentage)...... 66 Figure 16: Researchers: Perceptions of Attractive Career Opportunities for Researchers, per Type of Institution (In Percentage)...... 67 Figure 17: Researchers: Satisfaction with Overall Incentives Related to a Research Career, per Type of Institution (Percentage)...... 68 Figure 18: Researchers: Interactions Between Actors, per Type of Institution (Percentage)...... 69 Figure 19: Researchers: Accessibility of Research Discussions for University Affiliates, Non-University Researchers and Women, per Type of Institution (Percentage)...... 70 Figure 20: Researchers: Number of Communication Training Sessions, by Type of Institution (Percentage)...... 72

Doing Research in BOLIVIA 9 Figure 21: Researchers: Ability to Conduct Research without the Undue Influence of Policymakers, per Type of Institution (Percentage)...... 76 Figure 22: Policymakers: Requests for Research on Policy-related Topics (Percentage)...... 77 Figure 23: Researchers: Participation In the Formulation of Policies, per Type of Institution (Percentage)...... 80 Figure 24: Administrators: Perceived Influence of their Institutions on Policies, per Type of Institution (Percentage)...... 81 Figure 25: Policymakers: Perception of The Usefulness of Social Science Research...... 82

10 Doing Research in BOLIVIA List of Abbreviations and Acronyms CENDA The Andean Communication and Development Center CESU Center for Higher Education Studies CEUB Executive Committee of the Bolivian University CIS Center for Social Research CLACSO Latin American Council of Social Sciences COMIBOL Mining Corporation of Bolivia (Corporación Minera de Bolivia) DICYT Directorate of Scientific and Technological Research DRA Doing Research Assessment ENDE National Electricity Company (Empresa Nacional de Electricidad) FACSO School of Social Sciences GDN Global Development Network GDP Gross Domestic Product IESE Institute of Social and Economic Studies IISEC Institute for Socio-Economic Research INCISO Institute of Research in Social Sciences INE National Statistics Institute MEFP Ministry of Education and Professional Training MPD-VIPFE Ministry of Development Planning - Vice Ministry of Public Investment and External Financing NGO Non-Governmental Organizations OECD Organization for Economic Co-operation and Development PDES Economic and Social Development Plan PDN National Development Plan PIEB Program for Strategic Research in Bolivia (Fundación para la Investigación Estratégica en Bolivia) R&D Research and Development Red ADA National Network of Information and Communication Workers (Red Nacional de Trabajadoras/es de la Información y Comunicación) RICYT Ibero-American Network of Science and Technology Indicators (Red Iberoamericana de Indicadores de Ciencia y Tecnología) SAREC Department for Research Cooperation SIBICYT System for Scientific and Technological Information SIDA Swedish International Development Cooperation Agency UDAPE Unit for Analysis of Social and Economic Policies UMSS Universidad Mayor de San Simon UNESCO United Nations Educational, Scientific and Cultural Organization UNITAS National Union of Institutions for Social Action Work YPFB Bolivian Oil and Natural Gas State-owned Enterprise (Yacimientos Petrolíferos Fiscales Bolivianos)

Doing Research in BOLIVIA 11 (CERES). It constitutes the first systematic Executive Summary analysis toward providing comprehensive In a global knowledge economy and in the and comparable information on local context of the Sustainable Development research in the country, in an effort to better Goals, there is a growing recognition understand current research practices and among governments and international policies. organizations of the importance of The DRA employs a mixed-methods research mobilizing local research as part of wider design that combines the collection and strategies for socioeconomic development. analyses of qualitative and quantitative However, the current state of research data as well as rigorous desk research. The systems in developing countries is a cause methodology involves three specific stages. of concern, since it often does not enable Firstly, an overall assessment of the context local researchers to carry out useful quality that shapes the structure, challenges and research that can feed into public debate opportunities for social science research and policy discourse. In this context, an in- in the country. Secondly, a mapping of the depth analysis of research systems is key to national research landscape to provide an understanding how to bridge the research- overview of the macro categories of actors policy gap and raise the profile of research that have influence, power, an interest in that is being generated. and/or the capacity to conduct social science The social science research system in Bolivia research. Finally, the generation of data from involves only a few institutions that have key informants (policymakers, researchers, an interest in creating in-depth empirical research administrators) through a series of evidence. Research dissemination and interviews and surveys, alongside an analysis research–policy linkages are also limited, of documents and a desk review. This informs helping to create an environment that the Doing Research Framework, which lacks an appreciation of evidence-based interprets the findings based on a set of knowledge generated within and for indicators for the three main functions of the society. Despite the significant effort of research system: production, diffusion and several institutions, Bolivia continues to uptake. lag behind other countries in the region in Main findings terms of research practices. As the country moves rapidly toward a more open and There has been a substantial increase transparent political environment, new in the production of research in social public policies must be imagined and sciences in Bolivia over the last decade. designed. The challenge is to find ways There are a number of factors that explain to make use of available and emerging this improvement. First, research facilities research. As such, there is an urgent need and workspaces, although subject to further to assess the social science research system improvement, have been enhanced. Second, in Bolivia, to identify the opportunities and the increase in the number of private structural barriers to doing research, and organizations dedicated to the generation highlight pathways for action. of ideas for development, together with an important flow of resources from The Doing Research Assessment (DRA) in international cooperation during the 1990s Bolivia was implemented by the Center for – for example, the cooperation agreement the Studies of Social and Economic Realities between Sweden (Sida-SAREC) and the

12 Doing Research in BOLIVIA public universities of La Paz and Cochabamba confirm that the peer-review culture – and the role played by the Fundación para introduced by international cooperation la Investigación Estrategica en Bolivia. in the 1990s, disappeared after the exit of international actors, contributing to the The production of knowledge in the social deterioration of the social science research sciences remains key for understanding system in recent years. A lack of resources, the national reality and improving public such as specific software for research and policy. Social research still plays an important data analysis, was also identified as one of the role in informing the government’s agenda, most evident limitations. as demonstrated by the creation of the Vice-Presidency’s Social Research Center There is no national research policy for (CIS) and the priority granted to the output social sciences nor a national body that generated by its Unit of Analysis of Social articulates research activities in Bolivia. and Economic Policies (UDAPE). However, Therefore, institutionalized practices for economic concerns and a lack of interest academic actors involved in social science in joint and transparent data collection research are not properly designated at the continue to undermine the relationship national level. However, at a university level, between researchers, institutions and those there are institutions, such as the Directorate responsible for public policymaking. of Scientific and Technological Research (DICYT), that, to some extent, promote There has been an increase in the number scientific research. Still, this does not ensure of researchers with a PhD as well as social the quality of research but rather focuses science researchers in the last decade in on the administrative and bureaucratic Bolivia. The total number of active social parameters of resource management science researchers has increased from 67 within the public university system, leaving per million of inhabitants in 2012 to 77 per questions around quality and ethics million in 2014; and, of the 96 surveyed unaddressed. researchers as part of the representative sample of this study, 17 percent hold a There was a clear public policy toward PhD and a further 10 percent are currently the recovery of the ancestral knowledge working toward one. of the indigenous peoples of Bolivia; however, due to excessive ideologization There is considerable independence for and political confrontation, it became a researchers to generate data free from mechanism for capture and discrediting political pressure. The research culture in of scientific processes of knowledge social science organizations provides ample construction. scope for carrying out different types of social research: from diagnoses and/or baseline There is a limited amount of full-time studies conducted by non-governmental research in Bolivia: just 17 percent of the organizations, to more analytical research in surveyed researchers claim to dedicate higher education centers – each with their between 80 and 100 percent of their time own regulations and procedures for the to research. The regulations of the Executive production and handling of data. Committee of the Bolivian University (CEUB), as well as the universities themselves, allocate Currently, training is being promoted in few hours for research – with the exception public universities to improve skills for of public universities that host a large research production. However, findings number of research centers.

Doing Research in BOLIVIA 13 In the absence of an entity that regulates Levers of Change and qualifies research, or a unifying policy Most research activities within academic that promotes the production of scientific institutions in Bolivia are conducted in knowledge, research activities tend to be isolation, without the proper channels to carried out in isolation. share findings and/or sources, which makes There is limited participation of it harder to influence policy. There is a need researchers in international collaborations to introduce career advancement policies and research projects, resulting in a loss and incentive mechanisms in higher of global presence and influence in the education that encourage competition social sciences. Moreover, more than half of (performance-based research funding), the surveyed researchers report not being transparency, collaboration, and respect affiliated to any international network of for the visions of other researchers and researchers or registered in an international methodological plurality. repository. There are very few institutions that have inter-institutional agreements with Create a national network to coordinate universities and institutes abroad. between universities, governments, research institutes, the private sector and There is little incentive for researchers other relevant stakeholders. This involves to participate in the design of public building institutional consensus in the social policies, reflected in their reduced sciences that includes all stakeholders in participation in government institutions the Bolivian research system. The current responsible for policymaking. Over 66 silo-based production, budgeting and percent of the surveyed researchers management structures in research entities claimed that they have never participated make it difficult to promote an effective in the development of policy, while those transfer of knowledge from researchers to who have, have only been involved in the policymakers. Data are being generated formulation of laws, strategies and programs, in partial isolation, which means that the and not in their implementation, monitoring different actors have little understanding of or, more importantly, their evaluation. what other institutions and individuals are There is a systematic disconnect between doing. those who produce research and those Introduce a national research policy and who need to use it. This limits the diffusion a national research body to articulate of research and means that its influence research activities in Bolivia. Having both on the elaboration of public policy is likely a policy and body to regulate, promote and to be minimal. More traditional forms of certify research will enhance the production, dissemination (such as books and reports) dissemination and uptake of quality research tend to be favored by institutions, whereas output, including though national research other forms of communication such as policies and standards. workshops, conferences and seminars, or online platforms are less common. At least Set up a national data focal point – a 25 percent of research institutions do not viable mechanism for the regular have a webpage to help communicate their collection of data and information to research activities. support research and policy formulation.

14 Doing Research in BOLIVIA This should include institutions in charge of efforts and capacity toward operating as an generating nationwide databases, such as interface between research and public policy, the National Institute of Statistics (INE), in testing a number of tools and strategies that cooperation with all government entities at could be replicated in the current context. municipal and departmental levels. These include sharing research results and proposals in workshops, identifying the Given that the Internet (especially social research needs of public entities, supporting networking platforms) is the most popular the planning of research processes, and medium for publicizing research (in training researchers on designing projects comparison with newspapers, television and that impact public policies. radio), higher education researchers and researchers from other institutions need While private and civil society institutions to leverage the use of social media to offer little or no capacity-building for communicate and instigate discussions researchers, public universities provide on their research findings. continuous research training. This has led to a significant gap in research capacity Establish a peer-review system to raise the between university actors and those from standard of social science research in Bolivia. other institutions. In this context, there is a The inclusion of peer-review mechanisms need for policies that promote capacity- in every research project will also help building across all institutions. to promote researchers’ participation in international collaborations and research Strengthen the role of international projects. cooperation in facilitating the creation of research networks and international Adopt a diffusion model similar to the exposure. Collaborative research/thematic one established by the Fundación para networks constitute the most effective means la Investigación Estrategica en Bolivia of sharing results, and are considered a space (PIEB). PIEB, which ran between 1994-2014, for mutual feedback among institutions of dedicated a large part of its institutional similar nature or with shared interests.

Doing Research in BOLIVIA 15 policies to address export decline, fiscal INTRODUCTION deficits, political stress, social upheaval, market adaptation, technological inclusion Highlights and institutional reforms across the whole system. Therefore, it is more important than • The main motivation for this study is to generate first-hand evidence of the ever to mobilize research capacities, to production, diffusion and use of social map research institutions, and assess the research in Bolivia in order to advance ability of public policymakers to project future debate on the development of the their needs and to absorb and make use of research culture. evidence in public debates. • This assessment constitutes the first Social scientists in Bolivia have been unable attempt at providing systematic and to make the case for, and leverage, their comparable information on local research work as a distinct field – with the exception in Bolivia in an effort to better understand of a few and somewhat isolated efforts current research practices and policies. to generate empirical evidence. Research • The Doing Research Assessment (DRA) in dissemination and the research–policy Bolivia was implemented by the Center interactions are also limited. The current for the Studies of Social and Economic system is not effective in generating an Realities (CERES) using a mixed-methods appreciation of evidence within and for research design that combines the collection and analyses of qualitative society in public and policy debates. and quantitative data with rigorous desk By taking a broad approach, this study research. highlights that all those involved in the practice of social science research play a role in shaping the structure of the national After more than a decade of booming research system, and partake in building a growth based on commodity exports culture that values high-quality, ethically and the implementation of grandiose conducted and societally relevant research. infrastructure and industrialization projects The main motivation for this study is by a populist government, the coming to generate first-hand evidence of the years are likely to see profound changes. production, diffusion and use of social Natural gas and mineral reserves, the main research in Bolivia in order to advance drivers of the export boom and economic future debate on the development of the growth, are in decline (at the time of country’s research culture and system. writing). Bolivia will need sound policies to This assessment constitutes the first face the challenges in this new period in systematic analysis carried out at country order to reorganize its economy and adapt level to better understand current research its economic structure to fast moving practices and policies. international markets, while at the same The Doing Research Assessment (DRA) in time keeping up with the expectations Bolivia was implemented by the Center of the Bolivian people: linked to the for the Studies of Social and Economic expansion of market relationships, the Realities (CERES) using a mixed-methods middle class has expanded because of the research design that combines the general increase in social mobility. collection and analyses of qualitative In the coming years, Bolivia will need to and quantitative data with rigorous design, implement, monitor and evaluate desk research – using evidence from the

16 Doing Research in BOLIVIA literature and key informants (policymakers, provides an overview of the macro categories researchers and research administrators). of actors that influence, have an interest in, or Data was generated for this report in three have the capacity to conduct social science main stages. First, a context analysis that research. Finally, the DRA framework, which examines the trajectory, structure, challenges is used to present the findings based on the and opportunities for social science research established indicators for the three main in the country across different dimensions. functions of the research system: production, Second, a stakeholder mapping exercise that diffusion and uptake.

Doing Research in BOLIVIA 17 four dimensions: the political, economic, CONTEXT ANALYSIS international and historical/cultural context.

Highlights This process enabled a systematic analysis of the strengths, weaknesses, challenges • The political context has a strong and bottlenecks related to doing quality influence on Bolivia’s capacity to generate autonomous, free and independent social and policy-relevant research in Bolivia – in science research and the extent to which particular, the relationship between social/ it can be projected into the public arena economic research and public policies. free of government vetting. • The private sector has been economically Political Context dependent on international cooperation, The political context has a strong influence having assumed the role of ‘data lifters’; on a country’s capacity to generate however, it has no say in defining the autonomous, free and independent social research topics and, in many cases, does science research and the extent to which it not even have access to the information it generates. can be projected into the public arena free of government vetting. According to Carden • Nowadays, social science research in (2009), development research interacts with Bolivia is conducted by a few isolated institutions that have an interest in the policy/political context, and vice versa. creating in-depth empirical evidence. The transition to democracy in Bolivia began Research dissemination and research– in October 1982, after three national elections policy linkages remain limited. and several coups; the consolidation process • Although there is more research being has undergone a number of different carried out today than ten years ago, there is, as yet, no fully consolidated national stages. Until the beginning of the 1990s, research system. research initiatives were limited and most of these disappeared or were weakened as a • The lack of attractive opportunities and incentives for career advancement, consequence of the dictatorships (PIEB, 1994). research, and academic employment During the early 1990s – according to reports has led to the emigration (brain drain) by the Fundación para la Investigación of professionals to more developed Estratégica en Bolivia (PIEB, 2004) – research countries. in Bolivia was on the increase but still • The low levels of English language relatively scarce; it was concentrated among proficiency directly affect the ability a few groups and marked by the absence of to produce research, which limits the state policies (Sandoval, 2015). opportunities for projects, scholarships, networks and exchanges. At the The democratic transition, however, international level, research excellence is stimulated a dramatic increase in the number usually associated with English-language of non-governmental organizations (NGOs) publications. in the country: from 530 in 1992 to about 1,000 by 2000 (Ardaya, 2008). Since then, new The context analysis has been compiled social movements have emerged, with their based on the trends identified from key own ideologies and demands; NGOs have informant interviews. The key factors played a key role in mediating between the impacting the social science research government and these new actors (Ardaya, system in Bolivia have been analyzed across 2008).

18 Doing Research in BOLIVIA During this period, research centers There has been no substantial change in the interacted directly with social movements levels of institutional instability (PIEB, 1996) and other segments of society, as well as with and other weaknesses in the research system international cooperation agencies and the identified 20 years ago (PIEB, 2015). The last State. NGOs and similar entities contributed decade has certainly been a challenging to supporting the formulation and/or time for linking research and public policies. execution of some aspects of public policy During the period of the Evo Morales and, to some extent, to the construction of Government, institutions were captured by the public agenda (Ardaya, 2008). militants and subject to the power and needs of the State, eroding their credibility. The Along with NGOs, research centers State lost the capacity to produce specialized also began operating as part of public knowledge that enabled the formulation of universities, located mainly in La Paz and pertinent public policies. In most cases, it Cochabamba (Ardaya, 2008). However, delegated the elaboration and execution of universities faced serious economic public policies to other actors (Ardaya, 2008). difficulties as a result of budgetary restrictions imposed by the neoliberal The National Statistics Institute (INE) and policies at the time. As a consequence, the Unit for Analysis of Social and Economic many began to prioritize the ‘hard sciences’. Policies (UDAPE) – State bodies that support Most social science initiatives depended the National Council for Economic and Social on the conditions (funding, infrastructure, Policy – were particularly important in this access to information, etc.) created by regard. In addition, the Center for Social local government authorities or university Research (CIS), a unit created under the vice- faculties – which, in any case, were presidency, began replicating what research minimal and focused predominantly on NGOs used to do, including the capture of postgraduate studies (Sandoval, 2015). resources from international cooperation. This process has undermined the independent A notable exception was the creation of the structure of non-governmental research Institute of Social and Economic Studies institutions in the private, civil society and (IESE) as part of the School of Economic university sectors. As we will see in detail and Financial Sciences at Universidad in this report, universities and research Mayor de San Simon in Cochabamba. IESE NGOs have had to limit their work due to demonstrated a willingness to promote a reduction in resources for field work and research linked to academic training. It conferences. More importantly, they are now published an academic journal that reached further removed from policy design and about 12 issues and, in the early 1960s, the debate than under previous governments. Institute led a broad research initiative and As several interviews highlighted, the link public debate on regional development, between social researchers and policymakers with the intention of linking research to remains weak – with a very small number of policy. This was replicated by other schools non-influential exceptions. Overcoming these at the university – it became almost the deficiencies is the main challenge for the norm for each school to create its own coming years. However, the transition to a research institution. Unfortunately, these new, more democratic government provides initiatives were unable to survive the wider some hope for the future. trends within the university sector – most notably, student overcrowding and the This analysis of the political context also aims corporatization of university management. to establish the existence (or non-existence)

Doing Research in BOLIVIA 19 of policies that support social research as knowledge for society; the State, which has an input for public policymaking as well as the capacity to support and facilitate the assess the balance between the State and transfer of new knowledge; and the private private research agendas. Likewise, it aims sector and civil society, which contribute to identify the extent of political freedoms to and benefit from this relationship. This (within a legal framework) that allow and synergy can contribute to the strategic foster broad and critical debate as well as the development and promotion of research transparent use of all types of research. throughout the country (Camacho et al., 2015). Nowadays, the social science research system in Bolivia comprises a few isolated institutions The production of local, regional and national that have an interest in creating in-depth data does not appear to be for the purpose empirical evidence; research dissemination of elaborating on ‘grand discourses’ in social and research–policy linkages remain limited. science but rather to provide a diversity of One of the main problems is the excessive data and information that supports these centralization of decision-making processes intellectual constructs (Tórrez, Yuri F., 2013). in government entities – the main actors In other words, the interdisciplinary work that in the formulation and implementation is generated through research promoted of public policies (Pereira, 2016; Peres, by non-governmental institutions or think 2012; Zurita, 2012). This leaves little room thanks is not characterized by theoretical or for interaction between government ideological interpretations but by the priority departments and other relevant actors such that is given to research problems and local as universities or civil society organizations inquiries. While the participation of groups (Camacho et al., 2015; Zurita, 2012). The of diverse professionals contributes to the system is not effective in generating an development of interdisciplinarity, there is a appreciation of evidence-based knowledge need for a more in-depth, analytical approach (both within and for society) and, even to research and methodologies. though there is an apparent demand from There are opposing views on current policymakers, research is used mainly by government policies to support the international cooperation agencies (Peres, production and use of research. On the one 2012). hand, according to reports from the Bolivian Despite the significant efforts of some Ministry of Education (2011, 2018) – and in institutions, Bolivia continues to lag behind compliance with the 2011 edition of the other countries in the region (such as Peru) National Development Plan (PDN) and the in terms of research activities. (Tórrez, Yuri F., National Plan for Science, Technology and 2013). There are numerous gaps, as well as Innovation – the Vice Ministry of Science and limited inter-institutional engagement and Technology has successfully implemented coordination between the main stakeholders 14 ‘National Networks of Scientific and of the research system, which affect the way Technological Research’ since 2007, with the that research is undertaken and discussed aim of gathering, articulating, promoting, (Peres, 2012; Zurita, 2012). disseminating and socializing technological research and development for the benefit of Dealing with the complexities of the socio-productive sectors. As a result of these current context requires the collaboration collaborative networks, the links between and support of a range of social actors: government sectors, production partners universities, which study and produce and knowledge generators have improved,

20 Doing Research in BOLIVIA leading to the generation of government hand, highlight the importance of the policies in all the aforementioned areas. distribution of resources from the natural gas tax, which has enabled them to maintain In contrast, authors such as Camacho et al. their independence from foreign cooperation (2015), Pereira (2016) and Peres (2012) argue or from the official thematic agenda. They that these policies are rhetorical, short term are now one of the only spaces for public (with elections in mind) and partial (in terms academic debate. of addressing the realities of the country). They are aimed only at promoting research The general consensus is that there is still in the productive sectors, they have limited freedom to debate. However, some actors strategic impact, and are not based on highlight the interventionist role of the State, evidence or reliable statistical information. which has actively refuted and contradicted They are also considered ineffective in the results of some studies. Others note the solving the structural needs of the country, obstructive role of the press, which often and promoting the development and exaggerates statements and aggravates consolidation of science, technology and tensions. The government perspective, as innovation. reported by Rene Orellana (former Minister) The different private actors recognize that and María Félix Delgadillo (Executive Director the State is responsible for the promotion at UDAPE), asserts that there are spaces for and development of research, including free and critical public debate. Some actors, the appropriate channels for cooperation. however, argue that these are restricted, as However, the State has demonstrated a highlighted by the response below: chronic inability to integrate research in the "If the spaces for debating research promoted development of public social policies (Ardaya, by the Vice Presidency are reviewed, there are 2008). issues linked to promoting policies from the Much emphasis is placed on the fact that State, without giving rise to critical research within the framework for the development debates or questioning current policies. and implementation of research policies, Therefore, there is no balance. The research the State must maintain free access to centers are at a disadvantage compared to information and ensure the participation of the State, which has a whole apparatus that different actors, including social organizations mobilizes and analyzes not only resources to and the business sector. While the State has facilitate research, but also promotes spaces developed a research agenda for the social for socialization. Researchers who are critical sciences through its own think tanks, there is of the government's state policy receive some no common development platform in which criticism, but in no way are they promoted development actors are involved (Ardaya, or put to public debate, much less in spaces 2008). where the government has absolute control" (S. Vasquez, CENDA, 2018). The private sector is economically dependent on international cooperation, having It is important to note that in recent years, assumed the role of ‘data lifters’; however, public universities have remained as they have no influence in defining the autonomous research spaces, where teachers research topics and, in many cases, do not and researchers function in an environment even have access to the information they of academic and political freedom (Ardaya, generate. Public universities, on the other 2008).

Doing Research in BOLIVIA 21 However, some interviewees argued "... from the State, there is no real policy to that political factors cannot be ignored provide information, under the premise that in academic production and that, it is confidential and cannot be disseminated. often, this leads to criminalization and/ The right to information for any citizen who or stigmatization that limits research is interested in deepening their knowledge of production. The private sector argues that certain topics is restricted " the allocation of funding for academic The availability and management of research is based on favoritism and information is generally deficient (Sandoval, clientelism (CESU, 2020), especially when PIEB, 2015). The spaces for academic project funding is channeled through the interaction are scarce and lack continuity. State. Representatives from government These limitations have contributed to entities, however, maintain that there is no a research culture characterized by the clientelism in the production of knowledge production of social science essays without (Orellana, 2020), although they are partly the use of proper research that makes use of responsible for setting out the research primary data (PIEB, 1996). agenda – particular topics of interest to the government at the time. Social research in Bolivia has its own idiosyncrasies and characteristics inherent Some interviewees claim that while the to the national context and government country has a long history of conflict, the policy. Researchers, for example, tend to most recent hostilities have not affected the avoid certain topics in order to avoid being ability to produce academic knowledge. subject to criticism. They also perceive a In fact, many noted the emergence of high level of ‘ideologization’ of research, new areas of analysis such as indigenous where much of the research is carried out studies, the structural causes of poverty, around topics that tow the political line. This social cohesion, good governance, public conditions intellectual production and limits engagement and representation, the role interactions with State institutions. However, of civil society, the informal economy, the most actors agree that there is more research plurinational nature of society, the new being carried out today than ten years territorial configurations, and constitutional ago. Nevertheless, there is, as yet, no fully reform, among others (Ardaya, 2008). consolidated national research system. In some ways, the aforementioned problems constitute the country's national Economic Context agenda; areas for which different social For the past decade, the Bolivian economy and institutional actors (national and has experienced trade and fiscal surpluses, international) are partially or wholly and has performed well against most responsible, and in which there has been economic indicators. The flow of money some progress. However, there is no expanded the domestic market, reducing common platform for development actors poverty and promoting upward mobility to 5 working to address these issues (Ardaya, the middle classes as well as creating new 2008). strata of wealthy elites. Most actors emphasized the difficulty of accessing public information – the basis of 5 CERES published a book on the expansion of the middle any critical or analytical research. As Sergio classes entitled Chicha y Limonada – Las clases medias en Vasquez, Director of CENDA, explains: Bolivia, Ed. Plural, 2018

22 Doing Research in BOLIVIA Since most of the fiscal revenues came from productive and environmental sovereignty; international trade, particularly natural gas to name a few (PDES, 2016-2020). and mineral exports, surpluses were regular during the export bonanza. However, the Although efforts have been made to deficit started to increase in 2013 and has promote technological development based continued to grow since. on ancestral knowledge, and strengthen both innovation and applied research, little During the period 1998–2005, the extractive has been achieved (PDES, 2016-2020). sector sustained economic growth (PDES, 2016-2020). The government invested Human development in infrastructure, particularly roads and There is a lack of highly skilled professionals transportation, created a wide variety of and opportunities in the private sector. These public industries, and expanded a cash two elements are critical when analyzing transfer policy that had started in the how the economic context affects social 1990s. However, the ‘rentier state’ model science research in Bolivia. adopted by the country at the time is not Deficiencies in human resources and research conducive to the development of policies for capacity were identified as early as 1995 in strengthening public institutions – even less programs promoted by institutions like PIEB, so when its main features are exacerbated by both at the national and regional levels. As a commodity boom.6 From 2006, domestic mentioned before, research activities were demand was reactivated and became of one scarce at the time and were characterized by the main drivers of the Bolivian economy, an undergraduate university training model mainly due to greater public investment; that focused on teaching rather than research social programs in the form of bonds for (Mollis, 2003 in Yapu, 2015). There were children, mothers and the elderly; the also a limited number of graduate training increase in wages; the strengthening of programs in the public university sector. strategic companies such as YPFB, ENDE and As a result, the system failed to produce COMIBOL; and the creation of new public a critical mass of researchers. By 1997, the companies (PDES, 2016-2020). number of graduate study programs in public These and other national policies were set universities had increased, but they were still out in the Economic and Social Development deficient in terms of research training (Yapu, Plan, which articulates the medium- and PIEB, 2015). To date, research degrees are not short-term plans for the country. The included as an official major in the national Economic and Social Development Plan of university system. the Plurinational State of Bolivia, to give On the subject of human development it its full name, constitutes the strategic – the supply of a highly-specialized framework and prioritization of goals, results workforce – most of the actors that were and actions, and is elaborated on the basis of the 2025 Patriotic Agenda and the 2015-2020 Government Program (PDES, 2016-2020). The 6 The government established a policy think tank, UDAPE, 2025 Patriotic Agenda is based on thirteen solely dedicated to advising on policy design, but it pillars that aim to enhance progress on is not independent nor open to public debate. Major social policies for the eradication of extreme institutions, like the Central Bank and the National Institute for Statistics, have lost their independence. This has poverty; socialization and universalization of eroded the government´s ability to include informed, basic services; health; education; scientific independent data in its decision-making processes. and technological sovereignty; and financial, 7 http://www.planificacion.gob.bo/pdes/pdes2016-2020.pdf

Doing Research in BOLIVIA 23 interviewed stated that there are not enough career progression has led to a ‘brain drain’, professionals with graduate research degrees. with many professionals migrating to more However, the proportion of professionals developed countries in search of better with Masters and PhD degrees has increased opportunities (Los Tiempos, 2019). (Table 1), especially in the universities of the central axis: La Paz, Cochabamba and The private sector in Bolivia remains Santa Cruz. This means that there is already a underdeveloped compared to other significant amount of new social capital with private sectors in the region with different expertise in research that could make up a productive dynamics, such as Brazil or Chile. sizable academic community of researchers The country has a high concentration of 6 (PIEB, 2015). wealth as a result of its adherence to statism, which does not allow for the development However, the perception is that not enough of a dynamic private sector. The proportion professionals are interested in pursuing a of researchers employed in public or more specialized academic degree. While private business enterprises (Table 3) is low there has been encouraging progress in terms compared to other sectors. And, although the of the number of researchers in general and private sector could promote and support the more active participation of researchers academic research, there is limited demand in the social sciences in Bolivia (Table 2), the for knowledge/information, and a lack of lack of attractive opportunities and incentives incentives to work in Bolivia. In the case of for research, academic employment and higher education institutions, professors from

Table 1. Proportion of Researchers per Level of Academic Degree 2010 2011 2012 2013 2014 Ph.D. 11.2% 10.1% 15.0% 13.9% 16.9% Master 31.0% 29.0% 34.5% 32.8% 34.6% Bachelor 37.4% 37.5% 43.9% 44.8% 42.0% Technical/non-university 8.2% 9.3% 1.7% 1.7% 2.4% Others 12.2% 14.1% 5.0% 6.8% 4.1% Source: Ricyt, 2019

Table 2. Researchers per Scientific Discipline in Bolivia 2009 2010 2011 2012 2013 2014 Natural sciences 44.9% 25.4% 21.9% 19.6% 19.1% 17.3% Engineering and Technology 20.4% 21.3% 25.5% 20.3% 23.9% 22.8% Medical and Health sciences 12.8% 15.8% 12.5% 13.8% 13.8% 15.9% Agricultural sciences 8.0% 15.2% 14.6% 17.3% 17.7% 17.8% Social Sciences 11.8% 16.5% 20.6% 24.3% 21.2% 22.3% Humanities 2.1% 5.7% 4.8% 4.7% 4.3% 4.0% Source: Ricyt, 2019

8 The principle of concentrating extensive political and economic controls in the hands of a highly centralized government.

24 Doing Research in BOLIVIA Table 3. Researchers per Employment Sector in Bolivia 2009 2010 2011 2012 2013 2014 Government 6.7% 6.5% 4.0% 3.8% 4.4% 7.3% Business enterprise 2.2% 0.3% 1.7% 1.6% 1.4% (Public and Private) Higher education 85.0% 82.5% 84.4% 88.0% 88.5% 87.3% Private NGOs 6.2% 10.7% 11.6% 6.5% 5.6% 4.1% Source: Ricyt, 2019 public universities are leaving academia to Republic, Ecuador, Chile, Paraguay and Bolivia. engage in consultancies or work in private As much as 90 percent of this group migrates companies, weakening the quality of higher to wealthier OECD countries in search of more education in the country (CEUB, 2018). favorable opportunities for employment (World Bank, 2012). The most beneficial approach would be to increase career advancement incentives and The human flight and brain drain indicator generate research opportunities, to reduce considers the economic impact of human the initial loss from the brain drain as well as displacement (for economic or political encourage highly skilled professionals outside reasons) and the consequences this may the country to return to Bolivia. According have on a country’s development. The higher to information from the World Bank, factors the index, the greater the level of human such as the lack of professional recognition, displacement. If we consider the indices for unemployment or a lack of research support human flight and brain drain available for are major ‘push factors’. The countries with the South America, the average for 2019 was 5.52 largest percentage of migrating professionals (0 being the lowest and 10 the highest value). (all categories) in the region are Venezuela, The highest value was for Guyana (8.8) and Mexico, Brazil, Costa Rica, the Dominican the lowest was for Argentina (3).

Figure 1. Human Flight and Brain Drain Index 2019

1. Guyana 8.80 2. Bolivia 6.80 3. Peru 6.80 4. Suriname 6.20 5. Venezuela 6.10 6. Colombia 5.60 7. Paraguay 5.60 8. Ecuador 5.20 9. Brazil 4.50 10. Chile 3.80 11. Uruguay 3.80 12. Argentina 3.00 0 2.2 4.4 6.6 8.8 Source: TheGlobalEconomy.com, Fund for Peace, 2019

Doing Research in BOLIVIA 25 While there are a significant number of and health (among others) will allocate a research institutions in Latin America percentage of their resources to scientific (Lemarchand, 2010), the facilities are often research and technology development; and inadequate, grants are relatively low and b) public companies, centers of national salaries are not at an international level. technological innovation and autonomous Many young researchers and post-doctoral (municipal/regional) governments engage students find it difficult to get into the professionals with a high degree of scientific system and the only research positions they and technological training (PDES, 2016-2020). can access have little job security (Ciocca & Delgado, 2017). Although efforts have been made since 2006 to consolidate science and technology Investment in research and development as the basis for national development, a The priorities for science and technology set more consistent and systematic approach is out in the Economic and Social Development required to strengthen the national research Plan 2020 are centered around the effective system. There are still challenges in terms of development of production and public institutional development, coordination and companies in strategic sectors, developing articulation, and public and private budget incentives for a creative economy and the allocations for the sector (PDES, 2016-2020). construction of a knowledge society (PDES, According to the UNESCO Science Report: 2016-2020). Towards 2030 (2015), there is a growing One of the goals set out under the pillar for public policy focus on research and ‘scientific and technological sovereignty of innovation in Latin American countries, with the national agenda’ focuses on ‘professional the region leading efforts to promote the scientific training and specialization’. The role of indigenous knowledge systems for expected results are that a) all entities and development. However, with the exception companies related to the productive sector, of Brazil, no Latin American country has water, the environment, telecommunications invested significantly in R&D.

Figure 2. Research and Development Expenditure in Bolivia (% of GDP) 1.0

0.9

0.8

0.7

0.6

0.5

0.4 0,325 0,295 0,287 0,277 0.3 0,316 0,298 0,284 0.2 BOLIVIA

0.1 0,157 (2009) 0.0 1996 1998 2000 2002 2004 2006 2008

Source: UNESCO Institute for Statistics (uis.unesco.org), 2020.

26 Doing Research in BOLIVIA Gross domestic expenditure on R&D of Purchasing Power Parity (PPP) according for Bolivia, expressed as a percent of to the World Bank’s conversion rates (RICYT, GDP, includes both capital and current 2019). Further indicators are included in Table expenditures (public and private) for the 4 below. following sectors: business enterprise, government, higher education and private In terms of access to modern technology, non-profit. R&D covers basic research, applied most of the key actors that were interviewed research and experimental development for this analysis believed that this is not really (World Bank, 2020), and includes all work to an issue when it comes to the social sciences. systematically increase knowledge. However, some argued that researchers need more than just access to computers and a Available data for Bolivia for this indicator reliable Internet connection; many research (Figure 2) shows values from 1996 to 2009. institutions have limited access to academic The average value for Bolivia during this databases or licensed software. While some period was 0.28 percent, with a minimum of institutions enjoy access to and funding for 0.16 percent in 2009 and a maximum of 0.33 engineering laboratories, particularly those percent in 1996. The economic downturn in public universities, many social science had a significant impact on investment in research centers are not able to secure R&D, with a notable reduction in resources adequate funding to properly execute dedicated to science and technology. The research programs. last available value for 2009 (0.16% of GDP) corresponds to a government expenditure The Bolivian Government, through the of 70.88 million dollars – expressed in terms Vice Ministry of Public Investment and

Table 4. Indicators for Government Expenditure on R&D GOVERNMENT EXPENDITURE ON R&D / BOLIVIA (Latest year available: 2009) PER RESEARCHER Physical 47,92 Expressed in millions Full-time equivalent (FTE) 65,63 of dollars (PPP) Basic research 70.4% PER TYPE OF ACTIVITY Applied research 23.4% Experimental development 6.1% Government 58.9% Business enterprise (public and private) 6.0% PER SECTOR Higher education 30.6% Private NGOs 2.4% Abroad 2.1% Natural sciences 24.1% Engineering and technology 32.9% Medical and health sciences 1.2% PER SCIENTIFIC DISCIPLINE Agricultural sciences 40.8% Social sciences 1.0% Humanities 0.0% Source: Own compilation based on RICYT, 2019

Doing Research in BOLIVIA 27 External Funding, has instituted a Financing an agreement is signed. Then, once all Management process2 to execute programs the technical and legal conditions for the and/or projects with internal (local funding) use of external resources established in or external (credit and/or donations) the Financing Agreement (approval law, resources (Ministry of Development Planning, subsidiary agreement, budget registration, 2020). However, in order to access funding opening of passbooks, etc.) are met, the through these channels, projects must be requesting entity can use the resources to aligned with the National Development execute the project (Ministry of Development Plan and the priorities in Departmental and Planning, 2020). Municipal Development Plans. Moreover, there are significant bottlenecks in the Reducing and simplifying bureaucratic bureaucratic procedures for accessing procedures will be critical for facilitating government funding. interactions and consolidating mechanisms for policy influence. To date, there is no institution in Bolivia in charge of supervising and managing the International context registration of research organizations (La The international dimension has an influence Razón, 2016). However, certain regulatory on the development and standing of policies, such as Law 351 on the granting research systems. The integration of national of legal personality, limit entities such as research systems into wider networks can NGOs by strictly prohibiting the use of cash foster academic exchange and collaboration, donations that entail political and ideological increasing work opportunities for researchers. conditions that infringe the country's Globalization entails elements of academic sovereignty. The use of external resources collaboration and can be measured by or donations from multilateral financial the degree of openness and the extent of organizations or international cooperation international partnerships or international agencies vetoed by the Bolivian State is one mobility (GDN, 2017). of the main reasons for the closure of NGOs. The importance of the international context Only entities that are recognized (by the is recognized by the actors interviewed for State) as an ‘active’ organization can submit this research. International collaboration their project proposals to the ministry in is essential for developing activities and charge of the relevant field of study. The programs that facilitate the formation of corresponding ministry will then send the a research community and complement submission to the Ministry of Development national capacities, for acquiring innovation Planning–Vice Ministry of Public Investment capacities, and for developing the and External Financing (MPD-VIPFE). The investigative competitiveness of the region. MPD-VIPFE analyzes the proposal against the framework of current legal regulations, and Opinion is divided on Bolivia's participation then proceeds to formalize and negotiate in the international community. While many financing (if applicable) for the project. believe that, over the last five years, the Should credit be required, the Ministry of country has made steps toward developing Education and Professional Training (MEFP) a variety of networks that can help visualize also participates in the process. Once the and disseminate research outcomes, others Financing Agreement has been defined, argue that the conditions for a significant level of participation in international research

9 http://www.vipfe.gob.bo/content/2140 organizations have not been met.

28 Doing Research in BOLIVIA To date, around 13 institutions at national currently promoted by networks like CLACSO, level are members of the Latin American and such as new agreements with national and Caribbean Research Network. The Network, international institutions and organizations created in 1991 by the Inter-American to develop academic events and research Development Bank, supports knowledge activities; working groups; training creation and dissemination, and provides scholarships and specializations; courses and grant funding to research centers through virtual seminars; academic meetings; open a competitive bidding process for studies access and evaluation policies; and diversified on current economic and social issues in strategies for seeking cooperation funds. the region (IDB, 2020). The primary aim is to improve the quality of research in the region Capacities for international integration need and contribute to the development policy to be strengthened. In recent years, the agenda. Bolivian institutions such as CERES, country has limited itself to maintaining Fundación ARU, Fundación Milenio, INESAD relationships with countries with a similar Foundation, Universidad Católica Boliviana ideological perspective, which, in many cases, and UDAPE are among nearly 350 research has hindered the development of wider institutes10 that make up the network. networks, work opportunities and potential international partnerships. In addition, 14 organizations11 in Bolivia are full members of the Latin American Council Currently, these networks are concentrated of Social Sciences (CLACSO). This affiliation in cities such as La Paz and Cochabamba. allows researchers to participate in the However, the vast majority of respondents various academic activities and programs feel that there is a need to define effective promoted by the Council. Entities such as CIS, policies to promote the dissemination of part of the Vice-Presidency and a member of knowledge across the whole country. CLACSO since 2017, highlight how being part The general perception is that existing of these networks provides opportunities for networks that support the production, effective academic support, integrates the dissemination and use of research are not country with similar centers in the region, properly socialized, and that new additional and contributes to the institutionalization of networks are required. Respondents management and research processes (CIS, identified the need to establish regional 2020). supervision networks to represent the Although the country is open to the range of different actors and enable policy international community, it is widely proposals on a variety of specific issues. recognized that participation in networks Consultative bodies of this nature would be for production, dissemination and the use able to channel priorities and promote efforts of research needs improvement in order to improve administrative management. to become visible in terms of standard In addition, they could become spaces for bibliometrics-based international indicators. debate, a good source of data, and could Wider participation would allow the research encourage the participation of other entities community to benefit from activities that are in the policy formulation process (OECD, 2009).

10 http://servicesaws.iadb.org/res/files/RED_Miembros_ There is a relatively positive perception of JUL2018_Sources.pdf professional networks, scholarship programs 11 https://www.clacso.org/institucional/centros-asociados- and exchange programs with other countries, 2/?pag=pais&id_pais=7&ct=0

Doing Research in BOLIVIA 29 which can support the production of The low level of English language proficiency research and the training of researchers. directly affects the ability to produce However, this is still incipient and, although research. there is more government support for new scholarships for Masters and Doctorate Although there are no national indicators degrees abroad, public announcements to determine the level of English language are not widely publicized or are restricted proficiency among the Bolivian population, it to certain areas related to the government is widely recognized that working in a foreign or specific groups within it. Some of the language is a barrier for those who to intend respondents stated that applicants have to carry out research – this is not limited to to finance scholarships using their own the social sciences. At the international level, resources, and that, although the different research excellence is usually associated with ministries have promoted scholarships, many English-language publications (Hicks et al., of these have been withdrawn due to the 2015). English is considered to be the lingua limited number of applications – largely due franca of science: a great deal of scientific to the lack of guidance during the application research is published in English. English process. language proficiency also allows researchers to access information and share results Again, strengthening ties with regional in international outlets. However, there is programs within the research community little support for English language training could be highly beneficial for Bolivia. There as a means of promoting or facilitating are a number of current initiatives that can be locally produced research. Consequently, further developed to support the generation opportunities for projects, scholarships, of critical evidence-based knowledge networks and exchanges are missed. to inform public policies and social organizations (CLACSO, 2019). CLACSO, for Historical and Cultural Context example, implements the CLACSO-CONACYT This section aims to provide a general scholarship program, which awards overview of the ways in which Bolivia’s recent postgraduate scholarships to students history can help explain political, economic from Latin America and the Caribbean. and organizational aspects of the research CLACSO provides training for social science environment: how cultural specificities affect researchers, and access to mentoring and the organization of the research system; the publications; it also promotes participation in existence (or non-existence) of an evidence- regional and international events – with the based research culture; or how the transition aim of sharing the views and experiences of that the country is going through generates researchers, public policy actors and social divisions among groups of research actors, activists in the region (CLACSO,2019). affecting the ways in which social studies are It is worth noting that efforts to identify and discussed and applied. apply for professional networks, scholarship According to Sandoval (PIEB, 2015), the programs and exchange programs are often historical and social reality of Bolivia carried out by individuals/institutions rather presents many diverse challenges than collectively through the endorsement of related to indigenous people, poverty a national body. and institutionality. The Law of Popular Finally, one key aspect to analyze is the level Participation (1994) helped to improve levels of English within the research population. of inclusion and political participation, both

30 Doing Research in BOLIVIA in rural and urban areas, which led to a need try and match ancestral knowledge with to generate knowledge of local realities academic study. This has been an ongoing and develop a range of research priorities. discussion since 2009 with the establishment However, recent political changes have, to of the new Political Constitution of the a certain extent, resulted in a devaluation Plurinational State (Camacho, Villegas, of evidence-based knowledge, with little Mendizábal, 2015). government support for the production of All the interviewees for this initial analysis scientific knowledge. agreed that culture should be viewed as Moreover, there has been a growing interest an integral part of the research process. in recovering certain types of ancestral Culture does not operate in isolation knowledge and a conceptualization of from other social influences; it can help ‘living well’, used as a guide to improve social guide our understanding of the world, welfare. However, ultimately, these proposals including the research process. In Bolivia, were used either as a panacea to address, it determines, to a certain extent, research among other issues, the country's research topics. In addition, the promotion of a clearer culture, disregarding universal scientific and and broader understanding of the past technological knowledge (Pereira, 2016), or through a systematic exploration of cultural became a means of furthering the State’s history provides an opportunity for a more ideological objectives (Camacho, et al., 2015). constructive research process. Most of the interviewees confirm that there Some of the most relevant aspects that is a direct relationship between the country's were mentioned are feelings of belonging, recent history and the state of the research national and indigenous identities, and system. Some of the interviewees from the the preservation of ancestral knowledge private and academic sectors noted that and perceptions (worldview). These should social science research in Bolivia has been be seen as valuable resources and not as fixed on issues of economic development limitations within research. In addition, there and poverty, which are no longer as relevant is no cultural rejection of academic research; to the current economic situation in the indigenous communities have been open to country. A large number of interviewees analyzing and assimilating research on issues argued that research should focus more that concern them. on topics related to productivity and/or In terms of an evidence-based research innovation. culture, a large proportion of respondents The importance and proximity of the agreed that, although tangible samples are government to social science research is used, few researchers support research with reflected in statements by M. Delgadillo collected data; instead, due to the lack of (UDAPE), who claimed that "the context has available information, they base their work helped us", and R. Orellana (Former Minister), on secondary data searches. Both Gutiérrez who argued that "if the process of change (UCB) and Vasquez (CENDA) highlight the lack has made any contribution, it has fostered a of in-depth research. Research that involves research agenda". a data collection process, as well as the use of academic research databases that can be Some interviewees also noted the latent accessed to retrieve information, is expensive friction between the Morales Government and time-consuming. Consequently, a large and academia, which arose from efforts to proportion of publications take the form of

Doing Research in BOLIVIA 31 essays. Most are based on observations that Research–Policy Nexus approximate or interpret reality, and due to the lack of up-to-date data, are ineffective in The nexus between policy and research is key. fostering broader academic debate. Policy and its implementation – provided that it is guided by the national interest and not From a political, economic and electoral by the interests of factions – involves, among perspective, it is clear that the country is others, social actors, scientists, researchers undergoing a period of transition – although, and teachers (Pereira, 2016). Policymakers curiously, this is disputed by actors from must have an interest in learning from government institutions. Academics stated research and in using it to enhance their that this transition has created struggles work. They may, however, be drawn to social within academia, generating a chronic research for different reasons, according ‘immediatism’ (a desire to find instant to their position in the political system. We answers) among researchers, preventing a should assume that every politician is a long-term vision through prolonged social potential policymaker. Influencing policies research that effectively addresses structural is their primary aim, but they may require problems (J.P. Benavides, researcher at IISEC). different things from research according to their political standing. The general perception is that the high levels of politicization generated by government Based on the context analysis, this project has actions and policies have a significant identified three (coexisting) models that act impact on the way research is conducted. as potential channels for connecting research Participants also noted that research and policymaking: processes often depend on the vision of each institution, in an environment that is limited The Polishing Model by a lack of strong institutional leadership. In this scenario, politicians want to ‘polish their public image’. This may be the case There is a total lack of coordination between particularly for young or new politicians who actors, impeding the generation of products want to enhance their reputation by being that could have a meaningful societal associated with certain centers that are impact. The lack of clear direction also regarded as serious or of high repute. What hinders the production of ‘serious’ research. matters in this model is the public image The same topics/issues are investigated of the research center or the researchers from many perspectives, but there is no themselves. The quality of the research communication between the different actors may be good, but if it does not come from that produce research. The State does not a well-known center or from an institution facilitate channels of coordination, creating with a good reputation, the politician looking inefficiencies in the investigative process. In to enhance his or her image will not be addition, the promotion of data generated interested in establishing a connection. This by the State means that public policy model was dominant during the first decades processes are based on biased information of the 20th Century in Bolivia, when parties (Camacho, Villegas, Mendizábal, 2015). As S. and universities established themselves as Vasquez (CENDA) comments, "There is no real new political reference points. information that allows us to be certain that data from the State will contribute to critical, The Spotlight Model public debate. This creates ruptures within the In this model, politicians need to improve research topic”. their popularity, and new input from social

32 Doing Research in BOLIVIA research may provide the required ‘spotlight’, The three models suggest that the particularly if the ideas are well presented connection between research and and supported by data and evidence. As policymaking in Bolivia not only depends on argued by Carden (2009), research can the quantity or quality of research, but also improve the intellectual framework for on the prestige of the institution and the crafting policy by putting new ideas on public image of the researchers, as well as on the agenda, and ensuring that information the relevance of the topics, the originality of is presented to policymakers in a format the ideas and projects derived from them, that they can make us of, thus promoting and their usefulness in mobilizing resources. effective interaction between researchers and decision-makers. To a certain extent, this However, when the government does not model was dominant during the period of feel the need for foreign money, none of the National Revolution.13 these models seem to be viable – which appears to have been the case for Bolivia over The Toolkit Model the past 15 years. This model relates to politicians already in The three models respond to the particular executive positions who require resources for political context, but also to the level of specific projects to help them attain results prestige and relevance of social science for their constituencies. Evidence-based institutions. In this sense, none of the research may provide useful tools when models can be seen as desirable. However, applied to projects that support requests when comparing them, it would seem that for funds from international donors. This the toolkit model, despite being the most was in fact the dominant model during influential and apparently most effective the transition to democracy (1985 to 2005), (given that it links research directly to when international organizations acted policy design), accentuates the system's as intermediaries between research and dependence on external resources and may policymaking, providing support to private lead to biases and ethically-objectionable and academic institutions and strengthening academic practices. the research community.14 The other two models, on the other hand, have less impact on the design of policies but rely predominantly on the relevance and 12 Many politicians during this period emerged from the quality of investigation in the country. In the ‘social sciences’, obtaining public relevance through their research work published in books and articles. Bautista long term, this may represent an important Saavedra and Daniel Salamanca – who both became stimulus for research activity, which currently President after writing El Ayllu and La Teoria del Valor respectively – and Jose Antonio Arze, the founding father of Bolivian sociology, are some examples of this model in practice. 14 Some government research institutions, like UDAPE, were 13 Research in this case was channeled through consultancy created during the 1980s and 1990s, when this model reports, some of them funded by international prevailed. One of the most influential efforts was promoted cooperation. Some examples include the Bohan Report by the United Nations through UNDP and its Human (led by Merwin Bohan), which established a territorial Development Reports, largely based on local research integration plan; the Eder Plan for anti-inflationary conducted by private and university organizations. The stabilization (led by George Eder); and the Musgrave World Bank and several cooperation agencies, particularly Report on taxes and fiscal administration (led by Richard from European countries, responded to this model. This Musgrave). In all these cases, teams of Bolivian researchers was a period when comparative indexes were established played an important part in efforts to provide guidance as tools for influencing policymaking. The PIEB experience, for government policies in the period between 1950 and supported by the Netherlands Development Cooperation, 1970. was also part of this process.

Doing Research in BOLIVIA 33 suffers from a chronic shortage of funding. on the purpose of the research, ID cards with institutional affiliations, and interview guides From this perspective, there is no doubt with the topics to be covered – provided an that a more open political system, with the entry point and facilitated further contacts. continual renewal and professionalization of However, two specific challenges were politicians, along with stronger institutions, identified: will offer levers of change that help connect social researchers more closely a. High levels of administrative bureaucracy. and productively with decision-makers and Most of the contact with institutions policy designers. Financing is also a key lever. was marked by uncertainty and delay, Research may be linked to public policy specifically in acknowledging and needs, as shown in the toolkit model, but processing the requests, and scheduling it must maintain quality and relevance, for interviews with key contacts. Given the which the allocation of funding through time constraints, the team often relied on competitive mechanisms is essential. verbal permission to gain access as formal Research conducted by PIEB demonstrates confirmation was never received. This that these mechanisms are readily applicable highlights the importance of taking into in Bolivia. account the different local practices and bureaucratic procedures. Project Limitations b. There was degree of sensitivity toward the A number of challenges were encountered assessment. It was often perceived as a while attempting to understand, map and critical evaluation of research conditions assess the social science research system in and practices and a fear of exposure often Bolivia: hindered access. Access Sample size The assessment involves substantial In order to find significant relationships from interaction with civil society, policymakers and the data, a representative distribution of the academics. Therefore, access to organizations, population was estimated. However, a smaller data, people and documents was vital for sample was considered and adopted, which determining eligibility and estimating the included merging several categories of actors. response rate of institutions considered for While this helped to simplify the logistics of the study. However, gaining access to research data collection, it raises concerns about the participants was a considerable challenge. homogeneity of the groups. While in most countries, researchers are Lack of available and/or up-to-date data required to obtain a permit to conduct As documented by Carden (2009), research, in Bolivia, due to the absence of a developing countries often suffer from a supervising body, access is often granted by shortage of basic statistical data from which individual institutions or actors. This gives rise to draw solid conclusions. Most data sets to administrative informality and excessive from the National Institute of Statistics (INE) red-tape, both of which hindered the research and the Central Bank in Bolivia have not process from the outset. been updated for several years; other public The use of proper documentation – copies institutions were forbidden from sharing of request letters, authorization legitimizing official information that was essential for the the methodology and research team, briefs purposes of this research. Other resources

34 Doing Research in BOLIVIA such as websites are not available or have project to analyze the relevant DRA indicators not been updated. Similarly, there is not in comparison to a baseline diagnosis, but only limited access to municipal libraries no similar studies have been carried out and national online repositories, but a lack in this area. The results of this assessment of available, up-to-date, locally-produced will therefore serve as a starting point for research material, which greatly limited the analyzing structural barriers to doing research literature review and made it difficult to and highlight pathways for action. cross-reference particular material. Application of the methodology in Nevertheless, significant efforts were practice made to ensure triangulation of the The implementation of the DRA available information to increase the methodology differs from one location validity of the findings and present a more to another; the challenges faced by the balanced explanation, where possible. researchers conducting the assessment in Triangulation was used for both qualitative Bolivia also differ. As stated in the Leiden and quantitative data, using the input Manifesto for research metrics (Hicks et al, from researchers and key informants from 2015), the type of assessment and choice different backgrounds. Likewise, different data collection methods – such as interviews of indicators must take into account the and surveys – were used to ensure an in- context in which the study is developed. depth and more nuanced set of findings. An understanding of the social context or local circumstances allows the research Lack of prior research studies in this team to remain sensitive to the cultural area and social settings in which the program is Prior assessments of research systems/ implemented – and adjust the methodology practices in Bolivia would have allowed this accordingly.

Doing Research in BOLIVIA 35 STAKEHOLDER Characteristics of the Main Categories of Stakeholders MAPPING Higher education institutions According to the current regulations (Political Highlights Constitution of the State, and Education Law • According to Ministry of Education No. 070), universities in Bolivia can be either (Ministerio de Educacion Bolivia) statistics public or private: from 2016, there are 11 public universities and 42 private universities in Bolivia. • Public universities belong to the Bolivian • Despite the existence of the Directorate University System; they are autonomous of Scientific and Technological Research and equal in status. Autonomy means that (DICYT), the institution in charge of universities can independently administer the management of scientific activities resources (provided by the State); appoint in universities, efforts to record their own leadership, and teaching research activities remain fragmented, and administrative staff; prepare and undermining the development of a coherent social science research system. approve statutes, study plans and annual budgets; and accept donations and sign • Public/private donors have shifted their focus to fit with the current discourse on contracts to sustain and improve their evidence-based policy. institutes and schools. These institutions are represented by the Committee of the • Currently, NGOs and non-profit think tanks in Bolivia are seen as organizations Bolivian University (CEUB) and have the that strive to provide evidence-based authority to issue academic diplomas and research free from a political agenda. professional titles. The role of the Ministry of Education is limited to coordinating between public universities. The stakeholder mapping exercise aims to identify actors involved at all levels of the • Private Universities are academic/ social science research system in Bolivia. It scientific institutions for professional focuses on institutions that have a major training and research, associated influence on the research system. with business groups or religious denominations recognized by the Four groups of stakeholders are considered: State. They generate knowledge for the • Higher education institutions, including development of science, technology and public and private universities innovation, respond to the needs and social and productive demands of the • Government and funding agencies, regions and the country. Their academic including national ministries, local and and institutional operations are regulated regional governments, and public and by the Ministry of Education. They are private foreign donors authorized to issue academic diplomas, • Private sector, including for-profit think but professional degrees are granted by tanks and consultancies the Ministry of Education. The Executive authorizes the operation of these • Civil society, including NGOs, non-profit universities, their statutes, programs and think tanks and the media curricula.

36 Doing Research in BOLIVIA According to information provided by Much of the information was sought directly the Ministry of Education (Ministerio de from each university. However, many of the Educacion Bolivia, 2016), there are 11 public details provided by the different institutions universities and 42 private universities in through their websites or profiles were either the country (Annex 5). All public universities out-of-date or an overestimation since they were considered as part of the study; included, in many cases, undergraduate however, based on existing information and interns or administrative personnel as part of their relevance to the social sciences, only the research workforce. 28 private universities were selected for The lack of accurate, up-to-date information sampling. illustrates that, in spite of the existence of the Official documents published by the Ministry Directorate of Scientific and Technological of Education and CEUB were used to source Research (DICYT) – the body in charge of data on university staff involved in research the management of scientific activities activities across different years (Annex 5). in universities – efforts to keep a record of research activity remain fragmented According to the Ministry of Education (even more so for research activity related and the Vice Ministry of Science and to the social sciences), undermining the Technology, there were 210 research centers development of a coherent social science in public universities in 2011, of which 36 research system. are associated with the social sciences. In addition, 53 research centers have been Funding agencies identified in private universities, of which 15 Public/private donors have shifted their focus are dedicated to the social sciences. to fit with the current discourse on evidence- based policy. Institutions such as the World There were approximately 1,181 and 450 Bank and the Inter-American Development researchers (covering all disciplines) in Bank used to fund Bolivian think tanks that public and private university research advocated for neoliberal policies, while some centers respectively (Ministerio de Education European donors financed those linked to Bolivia, 2011). The National Plan for Science, ethnic movements. Currently, they look for Technology and Innovation for the Bolivian more ‘neutral’ local partners to carry out their University System 2017-2020, published in activities. Civil society organizations now 2017, provided more up-to-date information produce research based on impartial and on each of the 11 public universities (Annex objective analysis of evidence in order to be 5): it reported that there over 963 individuals in step with donor interests – an important carrying out research across all disciplines shift in a country with limited financial (CEUB, 2017). resources for research. (Moncada, 2013) Nonetheless, it is important to point out Private sector (for-profit and private that there is no available information that research institutions) specifically details the number of staff This sector is comprised of institutions whose members exclusively related to research in activities are driven by profit; this includes social science at the national level. Therefore, consultancies and think tanks. efforts to define the size of a potential sample for the purposes of this study are based on According to Bolivian regulations (Decree estimates from the available information. Law No. 16850, July 19, 1979) a consultancy

Doing Research in BOLIVIA 37 service is any study carried out by a production of different types of scientific consultancy firm or an individual consultant knowledge. to provide specialized technical assistance to a specific user so that he/she has sufficient Currently, NGOs and non-profit think tanks technical and economic information to allow in Bolivia are perceived as organizations that for efficient decision-making. strive to provide evidence-based research free from a political agenda. They produce Over the past decade, the sector has faced research not only in an effort to make an many difficulties, both in terms of influence impact on public policy but also to increase and the economic, political and social the amount of independent research. context, mainly due to a strong divergence However, their relationship with the Morales of opinion with the government in power. Government was fraught with difficulties. As a result of these differences, the sector has largely focused on technological and Civil society institutions are identified as productive innovations that benefit private agents that promote good governance and sector organizations. openness through the analysis of policies – following up on the State's commitments Civil society – to influence policy on matters of public In Bolivia, non-profit associations and interest. foundations are regulated according to the Civil Code, under the constitutional principle Stakeholder Listing of free association. From a legal perspective, Selection criteria shared by the current Bolivian Government, Given the scarcity of public research and hard NGOs are defined as: private institutions or data, the criteria for the selection of the main legal entities, non-profit, national or foreign, stakeholders in the Bolivian social science of a religious or secular nature, who carry research system were based on the following out development activities and/or assistance elements: with State funds and/or external cooperation in the national territory (DS 22409, March 11, • Institutions that have an interest in using 1990). social science research • Institutions that are experienced and NGOs and foundations must contribute to the economic and social development of are actively involved in the production, the country, register their activities, comply diffusion and/or uptake of social science with all legal regulations, and ensure their research. sources of financing and the management of Exclusion criteria their resources are transparent. These types Only one criterion was used to exclude of institutions are advised against receiving institutions/actors from the list of the main funding from agencies that are vetoed stakeholders: by the Bolivian state and that violate its sovereignty. • Research institutions that are no longer active and have ceased to operate within ‘Think tanks’ – also known in the region as the last three years for administrative applied research centers or public policy reasons and/or a lack of funding. research institutes – are organizations that seek to influence political processes, In order to generate a comprehensive particularly public policies, through the sample, the list of institutions was compiled

38 Doing Research in BOLIVIA through publicly available directories, • Private sector: 5 institutional websites and a preliminary desk • Civil society: 66 review. This list was further developed and validated through a live discussion/working Relationship among session held at CERES. Stakeholders Stakeholder Validation And The relationships and interests of the main actors in the social science research system Analysis at the national level were discussed to get an Methodology idea of how the system is structured and how A stakeholder mapping specialist was the relevant actors interact with each other. brought in to carry out a working session to In order to gain a more in-depth identify the main stakeholders in the social understanding of the stakeholders, a two- science research system through the use of a step analysis was carried out. participatory tool. STEP 1: As per the information provided The method entailed a group of ten experts in Tables Table 5 to Table 8, the following selected on the basis of their experience elements were identified for each category of in the field, their association with relevant actors: institutions and/or current work associated with social science research. The group • Type of interest in the production of social was multidisciplinary in order to contribute science research different perspectives and was comprised of • Type of information they provide researchers, former research administrators for the project, and the best way of and professors from the field of political communicating with them science, sociology and economics, as well as • Actors who influence their opinions in a civic and social organization representative general, and their opinions regarding who currently works with policymakers. social science research in particular A preliminary list was provided to the group • Actors who might be influenced by their and an initial brainstorming session was opinions carried out during a plenary session to consider the additional contributions of each • Main motivations and how these may 15 participant. The goal was to build a ‘group affect the level of bias in their responses response’ after several rounds of moderated to the DRA discussion and arrive at something close to an expert consensus. The sessions generated a comprehensive 15 The methodology was open to participant bias as the categories of actors selected for this assessment were list of stakeholders from all the established expected to assess the research system based on their categories. The final list of the main own preconceived opinions, ideologies and experiences. stakeholders in the Bolivian social science Bias was minimized by ensuring that the participants were aware that their responses were confidential. Nevertheless, research system was made up of 169 this kind of bias can be difficult to control for when institutions: participants are expected to inform on sensitive topics and/or may shape their responses in a manner that will • Higher education institutions: 45 be viewed favorably by other actors/institutions. In order to ensure trustworthiness, the data was triangulated and • Government and funding agencies: 53 cross-referenced, where necessary.

Doing Research in BOLIVIA 39 Table 5 - Higher Education Institutions Private Public Interest These institutions have The public university community rejects in the a financial interest in the any form of intervention from central production production of social science authorities, especially any form of of social research. Private universities government interference in public higher science aim to create, adapt and education that does not emerge from the research use knowledge through exercise of University autonomy. According research, transmit it through to their statutes, public universities teaching-learning processes are defined as national, scientific, and disseminate it through democratic and popular institutions, that university undergraduate operate through a dialectical process of and graduate programs. connection and mutual influence between However, most of their universities and society. academic activities are Traditionally, public universities have had geared toward satisfying research centers for the various fields of the needs of the business social sciences. They have been supported sector, with an emphasis with financial resources channeled on training entrepreneurial through an allocation from the Direct leaders committed to the Tax on Hydrocarbons. This has allowed development of the country. them to increase their resources for research. They have the infrastructure and financial resources to conduct studies and academic training. They also have financial resources derived from agreements with public universities in Europe and funds from the United Nations. However, the research centers are not connected with each other and act independently. Main Their motivation is to The identification of specific issues that motivation provide quality professional hinder human, social, economic and education based on scientific political development, in the region and research and ethical and the nation, determines the contents cultural principles, to foster of the curricula, guides their research technical innovation, social activities and facilitates scenarios for transformation and address social interaction. Their main motivation the needs of the country. is to contribute to the socioeconomic These institutions are development of the municipalities, regions committed to teaching rather and departments in close coordination than to the production of with the authorities at different levels of knowledge. the State.

40 Doing Research in BOLIVIA Type of Quantitative and qualitative indicators regarding the: information PRODUCTION to be DIFUSSION provided UPTAKE of social science research. COMMUNICATION: Network of institutional contacts Who They are independent institutions; they are not influenced by any external influences parties to produce research. their They stand on their own merit in their specialized field. opinions? Who Actors in this category have the greatest influence over the student might be population. influenced Both public and private universities have different effects on students. by their Universities offer substantial opportunities for change and perhaps surpass opinions? those of any other social institution. Universities have the potential to influence attitudes, knowledge and beliefs of students (e.g., their political identities) through academic and research activities. There is little to no influence over other actors (such as government institutions) given the lack of interaction on research-related matters. Source: CERES, 2019

Table 6 - Private Sector For-profit think thanks Consultancies Interest in the Less interest in research in Financial interest linked to the production of social sciences. Absence production of social science social science or little development of research. These firms specialize in the research institutions associated with management of the project cycle, the production of specific and focus their work largely on the social science research. following thematic areas: business/ institutional, sectoral, regional and national strategies, productive development, rural development, competitiveness, local economic development, the strengthening of SMEs and new ventures.

Doing Research in BOLIVIA 41 For-profit think thanks Consultancies Main motivation These institutions provide Develop economic and social specific services to business research, as well as analysis of sectors organizations to analyze, and subsectors of the national design and execute economy with a focus on strategic activities, plans and projects analysis, sectoral risk analysis, market for the benefit of the local intelligence and competitiveness. business community. Their motivation is to represent, protect and promote the interests of private activities in terms of collective welfare and the economic and social development of the country, as well as to encourage the cooperation of private business activities with the public sector. Type of Quantitative and qualitative Quantitative and qualitative indicators information to be indicators regarding the: regarding the: provided PRODUCTION PRODUCTION DIFUSSION DIFUSSION UPTAKE UPTAKE of social science research. of social science research. Products of research Products of research specifically aimed specifically aimed at at supporting policymaking related to supporting policymaking their experience with: for the private sector. Financial entities Government organizations COMMUNICATION: Non-governmental organizations institutional contact Cooperation organizations Companies and private organizations. COMMUNICATION: institutional contact Who influences They follow their own lines of work. They respond to needs in line their opinions? with their institutional objectives. Who might be They follow their own lines of work. They respond to needs in line influenced by with each project objective. their opinions?

Source: CERES, 2019

42 Doing Research in BOLIVIA Table 7 - Civil Society NGOs Non-profit Media think thanks Interest They provide public These institutions Their interest is in the services; although they do are created as centered on reporting production not depend on the State or a result of civil relevant events of a of social public entities. They work and popular political, social and science for the benefit of different initiatives and are economic nature. research members of specific usually linked to communities or groups. social, cultural, Consequently, their main development or interest is in contributing other projects. to the strengthening Their interest of development and is centered democracy, offering a space on proposing for diverse political, social effective and institutional actors to solutions toward reflect on the most relevant overcoming the problems for the country, in critical obstacles order to contribute toward to sustainable sustaining a political culture socioeconomic that consolidates Bolivian development. democracy. Main They focus their attention on the production The media aims to offer motivation and dissemination of knowledge regarding informative, explanatory the challenges of development, democratic and didactic content, as construction and globalization. Their motivation well as open spaces for is to conduct research, studies, analyses and citizen interaction and intellectual exchanges in economic, political, deliberation. social and environmental areas as well as promote informed public debate and improve the quality of national public policies. Type of Quantitative and qualitative indicators regarding the: information PRODUCTION to be provided DIFUSSION UPTAKE of social science research. COMMUNICATION: institutional contact

Doing Research in BOLIVIA 43 NGOs Non-profit Media think thanks Who Organizations under this category are The management, both influences predominantly independent institutions; public and private, of their therefore, they are not influenced by external the media must always opinions? parties. adhere to the freedom of expression; therefore, They stand on their own merit, in their no influence of any kind specialized field. should be exerted over media organizations. The media should transmit information they consider relevant, free from external control – other than their own editorial lines. However, in some cases, it is evident that political actors attempt to influence and control the information the media transmits. Who might Their research activities are linked to social, The media is a powerful be influenced cultural, development or other types of projects instrument for by their that foster structural changes in certain spaces, socialization and has opinions? communities, regions or the country as a whole. a great influence on society. It decides on Ideally, these types of institutions should the agenda of issues for establish close links with the government and daily discussion, and has official institutions to implement their activities. even changed ways of For example, they could complement public governing and doing policies in sectors such as health, education and politics. The news is a employment, among others. form of knowledge; in this sense, the media communicates topics designed to influence the political and cultural debate. Actors under this category play an active role, not only in the formation of public opinion, but also in the development of political processes. Source: CERES, 2019

44 Doing Research in BOLIVIA Table 8 - Government and Funding Agencies GOVERNMENT National Ministries Regional Local Research Government Government Councils Interest Their interest is Autonomous Autonomous Bolivia does not in the merely social, since governments municipal have a national production these institutions have an interest governments research council. of social were established of a social have a high However, the science to define and nature. They level of social Social Research research implement policies have political interest, since Center (CIS), to promote, and economic they seek to which is a facilitate, regulate capacity. They improve the Directorate and articulate are generators quality of of the Vice development. and executors of life of local Presidency of the public policies, inhabitants, State, produces promoters generating research in the and managers and executing social and human of economic policies for sciences that development integral contributes to the and social development. strengthening of welfare, They have joint the Bolivian State. integrating responsibilities public and with private actors communities to improve the in managing quality of life in the local the region. territory. Main Their motivation Their activities They provide The Social motivation is linked to the are focused public services Research planning of on public, to improve the Center (CIS) is plurinational public autonomous, quality of life, committed to management, economically and promote the creation of a applying policies, sound integral space for plural strategies and management, development, and proactive instruments for promoting respecting and debate, the comprehensive the integral managing the formation of a State planning, development diversity and new generation public investment of the region interculturality of researchers, and financing, through of local and the strengthening the public policies inhabitants. dissemination of role of the State and and strategic research through the actors of the alliances at the languages ​​and plural economy. regional level. formats adapted to different audiences.

Doing Research in BOLIVIA 45 GOVERNMENT National Ministries Regional Local Research Government Government Councils Type of Quantitative and qualitative indicators regarding the: information PRODUCTION to be DIFUSSION provided UPTAKE of social science research. COMMUNICATION: Formal request Who All government institutions carry out their social science research based on influences the guidelines established by the central government. their opinions? Who The government influences society according to its aspirations and might be tendencies. Social policies are translated into an articulated set of guidelines, influenced decisions, actions and strategic projections implemented by the State for by their benefit of its population. opinions? FUNDING AGENCIES Public Donors Private Donors Interest Interest of a social nature. Their focus These types of institutions in the is on the promotion, management have a financial interest in the production and execution of public policies production of research in the of social for international development social sciences. They play a critical science cooperation, aimed at achieving role in promoting international research sustainable human development. and national efforts to improve lives, working with the country to mobilize the financing and knowledge necessary to advance the development of Bolivia and the region. Main They are motivated by their institutional policies, aligned with the public motivation policies of the government/region. Their activities aim to contribute to accelerating processes of economic and social development. Type of Quantitative and qualitative indicators regarding the: information DIFUSSION to be UPTAKE provided of social science research. COMMUNICATION: Institutional contact

46 Doing Research in BOLIVIA GOVERNMENT National Ministries Regional Local Research Government Government Councils Who They follow their own lines of work. They follow their own lines of influences They respond to needs in accordance work. They respond to needs in their with each project /program objective. accordance with each program/ opinions? project objective. Who Funding agencies directly influence government development strategies. might be However, in Bolivia, there have been significant changes over time in the influenced policies of funding agencies and in their relation to and degree of influence by their over the development policies of the Bolivian Government. opinions? Source: CERES, 2019

STEP TWO: After completing a detailed • The perceived relationship among the characterization of the stakeholders, a second four macro categories of actors was analysis was carried out to identify the characterized through the use of different relationship among the categories of actors. outlines and maps during a roundtable discussion. The different group analyses This analysis was performed through a are included in their original version in collective discussion, with contributions from Figure 3 to Figure 6 - Group Discussion on ten local actors from different institutions. Stakeholder Inter-relationships – Group 4. These were considered qualified informants given their research background and Figure 3 - Group Discussion on Stakeholder Inter- expertise in the social sciences. relationships – Group 1 A Higher Education D2 Civil Society Objective Institutions Organizations To identify the different perceptions of Human Resources the interactions between the four main categories of stakeholders. B1 National-Local Methodology Governments Research The methodology uses a ‘sociogram’, which Instrumental consisted of graphically representing the Obstacle inter-relationships of a group of individuals D1 NGOs- within the social science research system, B2 Funding Foundations through a set of points (actors), connected by Agencies Guidelines one or several lines (inter-relationships). • The participants were presented with the Circumstantial/PunctualAd hoc aims of the session and all the available C Private Sector inputs. (Think Tank-Private Consultancies)

• The participants were grouped into four Source: CERES, 2019 groups to construct a social map.

Doing Research in BOLIVIA 47 This main focus of the first group’s analysis relationship between them is only normative. was on NGOs and their interaction with The relationship between the government other stakeholders. The relationship between and higher education institutions is restricted NGOs and other civil society institutions to the allocation of resources. The interaction is perceived as instrumental, as a means between the private sector and civil society of achieving their objectives. The NGOs’ is perceived as divergent given that each interaction with higher education institutions responds to their own interests. is limited in the sense that the latter are only perceived as generators of qualified In this analysis, the production of research human resources. The relationship with the is hindered by ideological differences. government is presented as an obstacle The roles of the different actors are seen that must be overcome, since they do not as contradictory, there is no interest in see themselves as partners. The relationship interacting because everyone pursues with funding agencies is seen as one of their own interest; they do not seek to subordination because they dictate lines support each other and are more focused of work or provide guidelines to lead their on spending resources rather than making research. Finally, the relationship with the investments. private sector is seen as sporadic – they only Figure 5 - Group Discussion on Stakeholder Inter- interact for specific purposes. relationships – Group 3

Figure 4 - Group Discussion on Stakeholder Inter- 1 relationships – Group 2 Public Private RELATIONSHIP INSTITUTIONS OR ACTORS RESEARCH

Research that has been carried out does not optimize Government Civil capacities or resources. Relationship Higher 2 Funding Society 4 Education Agencies Institutions R E S Government– Private Sector Funding E Agencies A 3 Source: CERES, 2019 R

Private C Sector In the third group’s analysis, the relationship H between public universities and the private sector is presented as weak given that public universities fail to respond to the demands Civil Society of the private sector. The relationship Source: CERES, 2019 between public universities and civil society organizations is perceived as strong, The relationship between the four categories because of their political association. It is of stakeholders in the second group’s worth mentioning that during this analysis, analysis is presented as ruptured and/or very additional actors such as representatives limited since there was no communication of grassroots territorial organizations between them. Even though each category (Organizaciones Territoriales de Base) of actors produces research (blue arrows), any and traditional communal lands (Tierras

48 Doing Research in BOLIVIA Comunitarias de Origen) were considered benefits without any articulation of common important stakeholders in the civil society interests among them, which hinders the category. development or efficient production of social science knowledge. Consequently, the results A strong relationship is perceived between from research activities have been far from public universities and the government and ideal. funding agencies, once again, due to the allocation of resources. However, the group Power, interest and influence in social identified a weak relationship between the science research government and the private sector. The latter Following the first two steps of the has the weakest interactions compared to the stakeholder mapping exercise (categorizing other sectors and has a particularly ruptured stakeholders and mapping the relationships), relationship with civil society. we employed a Mendelow Matrix to gain a Figure 6 - Group Discussion on Stakeholder Inter- deeper understanding of the actors in terms relationships – Group 4 of their level of power and interest.

HEIs Competition Civil For purposes of this classification, interest is (Autonomy) Society understood as the level of effective support toward the production, diffusion or uptake of social research. Power refers to the ability of

Private Government- actors to influence (positively or negatively) Sector Funding Agencies (Resource Magnet) social research through economic, social and/ or political actions. Source: CERES, 2019 Objective Finally, during the last group’s discussion, the The aim of this exercise is to organize the relationship between the government and different stakeholders in terms of interest other categories was seen as significant in and their ability to influence the adoption of view of the amount of resources controlled policy actions. by entities in this category; however, it was noted that this is not always a two-way Methodology relationship. Higher education institutions Based on the results of the social mapping and the government have, in theory, a analysis, a further grouping of the relevant dynamic relationship because of their role stakeholders was carried out using a in developing human resources. Higher Mendelow Matrix to classify, analyze and rank education institutions and the private sector the identified actors in terms of interest and have two-way interactions, whereas higher influence. education institutions do not have a strong relationship with civil society because they The methodology used was as follows: compete for resources. • The participants in the discussion were Conclusions divided into working groups. Although the analyses present different • The participants in each group assigned perspectives on the relationships between a position to each actor, discussing the the different categories of stakeholders, some main reasons that led to their choice of general conclusions can be drawn. appropriate quadrant. The different stakeholders seek their own

Doing Research in BOLIVIA 49 • Once the classification of all relevant reason why government entities were actors was completed, a matrix was also included in quadrant D. The actors prepared to consolidate the results of each placed in this last quadrant will be the main group. allies in carrying out improvements to the research system that impact the capacity Figure 7 - Classification of Four Main Stakeholders – Mendelow Matrix of the country to produce, diffuse and use quality social science research for social and LEVEL OF INTEREST economic development. Low High These conclusions reaffirm the findings in Higher education the context analysis, which highlight how institutions Low the social science research system in Bolivia Civil society Level of A B is characterized by limited inter-institutional Power coordination between categories of Private sector Government and stakeholders – mainly due to the absence of funding agencies High Government an institutional body that manages national and funding research activities The State manages agencies C D financial resources and executes public policies almost unilaterally, establishing its Source: CERES, 2019 own research agenda. This creates conflict with the interests and motivations of other This type of mapping allowed us to relevant actors in the national social science determine the type of approach/strategy that research system. The direction of public could be used with each of the categories policy is associated with the interests of when advising a pathway for action. parliamentary groups, political groups or parties, sectoral dependencies, groups The group of actors placed in quadrant B are of influential intellectuals, and business considered institutions that require further units, among others. In other words, public support to optimize their involvement and policies are developed as a result of pressure become influential players in the social from actors and institutions with a level of science research system. influence within the political system. Quadrant C comprises those actors that Moreover, because policies are designed at a are considered useful sources of opinions central level they do not respond to regional and resources that can help mobilize other demands and, as a consequence, do not actors toward more direct involvement. contribute to the democratic development Government entities have a significant of the country as a whole, nor do they satisfy influence on public policies. Like institutions demands for the common good. In other from the private sector and funding agencies, words, there is a divorce and/or distance they possess essential resources, such as the between those who design policy and those control of information, and direct access to who might benefit from it. funding and professional capacity, which makes them both highly relevant and Sampling powerful. However, their lack of interest in collaboration must be addressed to prevent Sampling – first attempts them from becoming an obstacle to the The sampling process involves the selection adoption of policy action. This is the main of a sample that is both accurate and

50 Doing Research in BOLIVIA representative of the target population, merging categories to reduce the number which would allow us to infer all its of subgroups and using a global share that, characteristics with a measurable and when applied to all subgroups, determined determined error. (Malhotra, 2004; Perez, the number of surveys to be applied. The 2005; Diaz, 2006) considered criteria are shown in Table 9. In this case, since the research institution Table 9 - Sampling Criteria population was independently subdivided Higher education into strata or subgroups according to specific institutions C1 categorizations or criteria, stratified random CATEGORY Private sector C2 sampling was the selected approach. In using (C) this method, it is essential that the elements Civil society C3 Government and within each stratum are as homogeneous as C4 possible, while the elements of the different funding agencies strata are as heterogeneous as possible La Paz L1 (Malhotra, 2004; Perez, 2005). LOCATION Cochabamba L2 The first sampling attempts faced a major (L) Santa Cruz L3 challenge: the large number of identified Rest of Bolivia L4 subgroups (strata). Identifying very Large S1 homogeneous subgroups resulted in a SIZE (S) Medium precise segmentation of the population, S2 which, while interesting for the purposes Small of mapping, made it difficult to manage Source: CERES, 2019 and administer the survey, as well as being detrimental to the representativeness of the In addition, mainly due to their size and share, sample. the private sector institutions were merged into a single group in order to avoid any bias. As a result, we decided to reduce the number The merging process, based on the selected of representative subgroups. While this meant criteria, resulted in 37 subgroups, 19 of which that they became more heterogeneous, they presented values. Their characteristics are remained relatively homogeneous compared detailed in Table 10. With this number of to the overall population. subgroups, the population of researchers was The sampling process for this study successfully organized into a manageable included two fundamental aspects: and representative scheme.

Table 10 - Final Sampling Process: Subgroups Constructed Based on Size and Share Share of No. No. Subgroup Subcategory Location Size total No. of Institutions Researchers Researchers Subgroup 1 C1 L1 S1 1 20 1.54% Subgroup 2 C1 L2 S1 4 62 4.77% Subgroup 9 C3 L1 S1 4 71 5.46% Subgroup 10 C3 L2 S1 2 36 2.77% Subgroup 12 C3 L4 S1 2 28 2.15%

Doing Research in BOLIVIA 51 Share of No. No. Subgroup Subcategory Location Size total No. of Institutions Researchers Researchers Subgroup 13 C4 L1 S1 17 319 24.52% Subgroup 17+33 C1 L1 S2 7 38 2.92% Subgroup 18+34 C1 L2 S2 9 43 3.31% Subgroup 20+36 C1 L4 S2 21 67 5.15% Subgroup 25+41 C3 L1 S2 26 162 12.45% Subgroup 26+42 C3 L2 S2 7 32 2.46% Subgroup 27+43 C3 L3 S2 8 54 4.15% Subgroup 28+44 C3 L4 S2 17 100 7.69% Subgroup 29+45 C4 L1 S2 20 144 11.07% Subgroup 30 C4 L2 S2 2 20 1.54% Subgroup 31 C4 L3 S2 2 14 1.08% Subgroup 32+48 C4 L4 S2 12 65 5.00% Subgroup 35 C1 L3 S2 3 14 1.08% Subgroup C2 L1+L2+L3 S2 5 12 0.92% 37+38+39 Total 169 1301 100% Source: CERES, 2019

Criteria for the selection of subgroups Through the use of this sampling rate, the Given the estimated population of 1,300 number of researchers was calculated as per researchers in Bolivia, a sample size of 300 the example shown in Table 11. researchers was determined for this study. The selection of institutions/researchers to be From this number of potential respondents, surveyed in each subgroup was carried out the sampling rate applied to each subgroup through the following steps: was calculated as follows: • Taking into account the particular n = 300 = 23,06% characteristics of the different categories, N 1301 a specific response rate was estimated,

Table 11 - Example of Calculation of the Final Number of Respondents Share of No. No. Subgroup Subcategory Location Size total No. of Institutions Researchers Researchers Subgroup C1 L1 S2 7 38 2.92% 17+33 Researchers to be surveyed = 23.06% of 38 = 9

Source: CERES, 2019

52 Doing Research in BOLIVIA a priori, for each: 75 percent for higher cases where institutions did not meet the education institutions, the private sector requirement, additional institutions were and civil society organizations, and 50 randomly selected until the number of percent for government and funding researchers was greater than or equal to agencies. As a result, the final number of the number required per subgroup. potential respondents in each subgroup Representativeness of the selected and the final sample was increased to sample cover the number of required responses. The institutions were randomly selected • Institutions from each subgroup were within each subgroup through the use of randomly selected. If the institution met random tables. The characteristics of the the required number of researchers (or final sample are presented in Table 12 and more), only one institution was selected. In Table 13:

Table 12 - Final Sampling Process: Institutions Selected Based on Size and Share Subgroup Sampling Distribution Share in initial list Share in initial list Total number Total number Size % % of Institutions of Researchers Small + Medium 48 28% 274 21% Selected Large 13 8% 251 19% Small + Medium 91 54% 491 38% Not Selected Large 17 10% 285 22%

Source: CERES, 2019

Table 13 - Final Sampling Process: Subgroups Based on Location and Share Subgroup Sampling Share in initial list Share in initial list Characteristic Location Total number of Total number % % Institutions of Researchers La Paz 28 17% 307 24% Cochabamba 10 6% 92 7% Selected Santa Cruz 6 4% 36 3%

Rest of Bolivia 17 10% 90 7%

La Paz 48 28% 448 34% Cochabamba 17 10% 108 8% Not Selected Santa Cruz 8 5% 50 4%

Rest of Bolivia 35 21% 170 13%

Source: CERES, 2019

Doing Research in BOLIVIA 53 The final sample has a proportional Representativeness of the surveyed representation of small, medium and large sample institutions as well as all the identified In order to assess the representativeness of locations, categories and subgroups. At the the resulting sample, two characteristics or same time, this allowed us to simplify the categories were evaluated: type of institution logistics of data collection, thus avoiding the and location. The size of the institution potential challenges of administering a large was excluded from the analysis due to its survey identified in the first sampling attempts. variability throughout the study.

Figure 8 - Representativeness of the Sample: Share of Stakeholders in the Initial List and Final Sample, per Type of Institution (In Percentage) 100%

90% 22% 31% 31% 29% 80% 43% 43% 43% 53% 70%

60% 44% 50% 39% 39% 44%

40% 37% 36% 37% 2% 30% 32% 3% 3% 3% 1% 20% 1% 2% 1% 32% 27% 26% 24% 10% 19% 21% 18% 14% 0% Institutions Researchers Institutions Researchers Institutions Researchers Institutions Researchers Initial List Initial Sample Initial Sample + Replacements Survey Respondents

Higher Education Institutions Private Sector Civil Society Government and funding agencies No. for initial list: institutions = 169, researchers = 1,301; No. for initial sample: institutions = 61, researchers = 525; No. for initial sample + replacements (unresponsive actors where replaced with actors from the same subgroup): institutions = 106, researchers = 932; No. of survey respondents: institutions = 59, researchers = 155. Period of data collection: July–September, 2019 Source: CERES, 2019

The participation/representation of both Despite these difficulties, the final sample researchers and institutions from the higher ensured the participation of all categories education, private and civil society sectors in of actors in satisfactory proportions the survey was proportionally similar to the and, therefore, an acceptable level of initial list. Therefore, we can affirm that there representativeness. were no significant differences between the final sample and the population under study. In terms of location, the proportion of actors from different parts of the country was similar Some of the most significant variations, in to the initial list. The variations are explained by particular for the government and financing two factors: incipient research activity reported agencies, can be attributed both to the in the city of Santa Cruz and the low levels of overestimation of the number of people response in La Paz and the rest of the country. dedicated to research activities and the low response rate of government entities (37 Taking into account the conclusions of both percent for institutions and 7 percent for comparative analyses, we can be confident of researchers). the representativeness of the final sample.

54 Doing Research in BOLIVIA Figure 9 - Representativeness of the Sample: Share of Stakeholders in the Initial List and Final Sample, per Location (Percentage)

100%

90% 20% 17% 16% 22% 26% 25% 31% 28% 4% 80% 7% 7% 3% 12% 70% 6% 7% 10% 18% 8% 15% 21% 60% 12% 17% 16% 16% 50%

40% 68% 30% 58% 58% 56% 54% 51% 46% 20% 45%

10%

0% Institutions Researchers Institutions Researchers Institutions Researchers Institutions Researchers Initial List Initial Sample Initial Sample + Replacements Survey Respondents

La Paz Cochabamba Santa Cruz Rest of Bolivia No. for initial list: institutions = 169, researchers = 1301; No. for initial sample: institutions = 61, researchers = 525; No. for initial sample + replacements: institutions = 106, researchers = 932; No. of survey respondents: institutions = 59; researchers = 155. Period of data collection: July - September, 2019 Source: CERES, 2019

Doing Research in BOLIVIA 55 It is important to recognize the perceived DRA FRAMEWORK disconnect between public policymakers and social science actors when developing Highlights methods and tools for a practical and • Although the production of research has objective implementation of social increased, it still suffers serious deficiencies science research. As discussed throughout in terms of quality, norms and organization. this analysis, the relationship between • There is no national research policy for stakeholders involved at all levels of the social sciences nor a national body that social science research ecosystem was articulates research activities in Bolivia. described by the different actors in terms of a • The limited supply of PhD programs ‘divorce’, reflecting the historical lack of state offered by Bolivian universities indicates support – through policies and funding – to weakness in scientific production. social research. In addition, despite the fact • There is no peer review culture; as a that the data from science and technology result, research production in Bolivia lacks indicators are of vital importance for the parameters to measure quality. definition, construction, prioritization and • The dissemination of research is one of the evaluation of public policies, the government weakest aspects of the Bolivian research has not elaborated indicators for R&D; some system. indicators were developed in 2009, but this • Low levels of participation of Bolivian was done independently (Pereira, 2016). researchers in international research According to the latest available data on projects have resulted in a loss of global government expenditure on R&D for Bolivia, presence and influence in the social State support for research in the social sciences. sciences is still severely lacking. There is • Most institutions continue to prioritize the very little investment in the elements of the written publication of research production research system that can impact the capacity – rather than debates, workshops and to produce, diffuse and use quality social conferences – as the main means of science research as a key element of social disseminating research. and economic development. • Researchers identified the Internet and social networks as the most popular There are no clear policies on social science space for research communication, as research in the private sector and universities opposed to newspaper, television and (Camacho et al., 2015; Peres, 2012), which is radio coverage, which were rated as reflected in the perception of the profound unsatisfactory. dependency of organizations dedicated • There is considerable independence for to academic research on international researchers, who can generate data free of cooperation agencies (Zurita, 2012). A political pressure. common observation is that conventional • There is a general consensus within the censorship is not exercised in Bolivia, but government about the importance of the that there are other means of adapting production of research and the need for or determining lines of research, usually evidence-based public policymaking. associated with financing. In this sense, the level of dependence of research institutions “We need to start taking stronger initiatives because on external financing is problematic. a country cannot run without ideas, without research, without information.” However, although Bolivia has been (J. De la Fuente, 2019) categorized as ‘delayed’ in terms of research

56 Doing Research in BOLIVIA topics and technological developments social sciences and technology, with the (Peres, 2016), the findings from the DRA aim of influencing public policies. Third, we highlight the potential of the country to discuss the role of international cooperation conduct research in relevant areas and be and its imprint on the production of competitive on a global scale, as well as research. International cooperation played the capacity to participate in discussions or a key role by providing funding to NGOs debates with other global institutions (Muriel, during the earlier period and supporting 2019). the development of research centers within public universities. Production During the last decade there has been a The production of research in Bolivia takes substantial increase in the production of place on different levels and through social science research in Bolivia. The total different actors. One of the most important number of active social science researchers levels of research pertains to the work increased from 67 per million inhabitants in conducted by public and private universities; 2012 to 77 per million in 2014.16 the second level comprises the production of research by civil society organizations A report on the production of social science (Torrez, Yuri F., 2013). The importance of each research in three middle- and low-income layer has fluctuated over time. In fact, we can countries in South America, states that “… classify the production of research into two in Bolivia, social research is relatively recent distinct periods (CIPCA and IDIS – Universidad compared to other countries in the region. Mayor de San Andres; La Paz; June 2019). The late appearance of a broad spectrum The first period (the mid-1980s to the mid- of social majors in public universities, and, 1990s) was dominated by the influence of above all, a political context that is not always research generated by NGOs and the support favorable to critical studies on development, of international agencies working in Bolivia. explain why the appearance of such studies The second period, which extends from was incipient in its early stages (late sixties) 2007 to the present day, is characterized by and did not become significant until the mid- the reduction in overall research activities eighties.” (Vera, 2015) in Bolivia, a reduction in the influence of The findings show that even though there research from NGOs and a centering of the has been an increase in the amount of production of research in public and private ‘scientific’ production in social sciences in universities and government agencies. Bolivia, a deterioration in the quality of this In this section we provide an overview of production is evident. The production of these two periods and their impact on the social science research in Bolivia is currently production of social science research in experiencing a period of stagnation, a loss Bolivia. First, we highlight some of the key of identity and, most importantly, a lack of statistics that summarize the increase in impact on public policy (Camacho, Villegas, research. Second, we focus on the role of Mendizábal, 2015) – as corroborated by the an institution that played a key part in the researchers and directors we interviewed. Nonetheless, actors from all four categories production of research during this period, reported participating in social research Fundación para la Investigación Estratégica en Bolivia (PIEB). PIEB was a private, non-profit organization that began working in Bolivia in 1994, promoting strategic research in the 16 UNESCO Institute for Statistics (UIS), 2019

Doing Research in BOLIVIA 57 projects with a degree of impact on knowledge and scientific production. That is public policies. Regardless of the material to say, we are below everyone else. In society, limitations and the lack of incentivizing research is just beginning to emerge. So, policies for scientific production, research is those of us who conduct research are a very, being conducted in history, anthropology, very small elite.” (A. Ramirez, 2019) sociology and political science; however, this production is not supported or sought out by The limited supply of PhD programs offered public policymakers (Peres, 2012). by Bolivian universities indicates weaknesses in scientific production (PIEB, 2015). The rise of the former government party, Nevertheless, there has been an increase in Movement for Socialism (MAS), radically the number of researchers with PhD degrees altered the rules and the context for social (Table 14) and researchers in the social research production, making greater use sciences over the last decade. The pioneering of findings from State-supported research research and data collection carried out centers (Balarin, 2016). According to Balarin, by CERES for the DRA confirms this steady it is evident that this type of social research increase (in the absence of up-to-date official still plays an important role in informing the data on this). For example, of the 96 surveyed government’s agenda, as can be seen with researchers, 17 percent hold a PhD and 10 the creation of the Vice-presidency’s Social percent are currently working toward one. Research Center (CIS) and the priority given Table 14 - Bolivia: Number of Researchers with Ph.D. to the output generated by UDAPE and its Analysis of Social and Economic Policies Unit. 2012 2013 2014 Social science research takes place, above Total No. of researchers all, within NGOs and universities (Camacho (Headcount) 1,303 1,454 1,618 et al., 2015; Zurita, 2012). The latter involves Researchers with a PhD 195 202 274 different research centers that are finding Total No. of social it increasingly difficult to generate social science researchers 317 308 360 science research given the focus of Source: UNESCO Institute for Statistics (UIS), 2019 universities on technical/business majors. Research inputs Several reasons could explain this situation. First, research facilities and workspaces, People, Funding, Infrastructure and Data, Time although in need of further improvement, for research have been enhanced. The increase in the Many of the responses noted that, given the number of private organizations dedicated limited resources (in terms of salaries and to the generation of ideas for development, funding) and the demands of the job (data together with an important flow of resources collection and field work), engaging in social from international cooperation during science research requires a great deal of the 1990s, have also contributed to this dedication and sacrifice. improvement (Vera, 2015). “I believe that those of us dedicated to Second, much of the increase in original research in society are elites. We have the scientific research in recent years has advantage of being able to do it, we are been generated by the increasing a very small group. Moreover, according professionalization of public and private to the world survey of cultural values, we universities (Camacho et al, 2015). As are a country that gives less importance to observed, the number of PhD holders has

58 Doing Research in BOLIVIA increased – although the growth in scientific policy level, the contributions of these production has generally not resulted in investigations remain relevant and continue an increase in publications from the region to generate new knowledge in different areas (Oxhorn, 2015). such as: Third, the majority of research has adopted • Indigenous/territorial issues a critical approach and, at times, has been effective in influencing the process of change • Productive rural development that the country has gone through. In these • Gender equality interesting years of crisis and transformation, a new generation of young researchers (both • Poverty and inequality men and women) has emerged, who are • Public policy design regarding regional using interdisciplinary methods and innovate issues, indigenous communities and conceptual and methodological approaches gender to examine different social and cultural realities (Sandoval, 2019). • Impact evaluations of public policy and academic research PIEB has been one of the main protagonists in this area. Although it has ceased Another aspect that influences how research operations, it was widely renowned for its is conducted is the availability of resources. experience in coordinating and training Most of the respondents were satisfied or researchers across the country – and had moderately satisfied with regard to access to the potential to take on the role of a national infrastructure and equipment for research. research coordinating body. Shortly after the Some pointed out that improvements in institution was created in 1994, the highly the conditions for conducting research intellectual nature of the institution became are partly due to collaborations with evident. Today, PIEB remains a successful European countries, such as the Sida- ‘brand’ of solid research and training. Over SAREC cooperation agreement with public an unprecedented history of 20 years, universities in La Paz and Cochabamba PIEB contributed to reversing the limited (Camacho et al., 2015). However, the lack development of research in the country and of specific resources such as software for overcoming the shortage of professional research and data analysis was clearly resources. It had a strong interest in research identified as one of the most evident linked to public policy and advocated for the limitations. Limited funding and logistical need for research as an engine for progress support are also perceived as a major and development (Sandoval, 2014). obstacle to social science research: Although there are some significant flaws “The latest professional courses provide in the social science research system, the inputs, guidelines and classes; but students changing conditions and new challenges cannot count on office supplies and a space that the country faces mean that the to work” (A. Pinaya, 2019) production of evidence-based knowledge remains critical. The production of social "From what I know, and we are not the science knowledge in particular is key to exception... the university pays salaries to understanding the national reality. Despite researchers who belong to certain institutes, the observed disconnect between social as well as to the faculty. Resources are science research and its use at a public granted, but only for stationery – perhaps

Doing Research in BOLIVIA 59 toner, paper and other resources for more scientific training followed a technical/ administrative purposes. But for research, instrumental approach and the university neither the faculties nor the institutes system did not allow teachers to engage have resources for … field work, surveys in research (PIEB, 2015). A large majority of or workshops, etc.... I once asked, what researchers recognize that the time they resources do we have to carry out research? spend on their research is not adequate, and And someone told me: but where does your the term professor-researcher is often merely salary come from? And, of course, my salary nominal. The regulations of the CEUB as is paid by the university, so that ‘implies’ well as some of the universities themselves, doing research. But doing research entails allocate few hours for research – with the additional operational expenses and the exception of public universities, who can university does not have any specific budget access research funds and resources from to finance research projects.” (J. Ledezma, the direct tax on hydrocarbons, unlike private 2019) higher education establishments.17 “… In fact, the School of Social Sciences is Figure 10 - Researchers: Time Allocated to in a deplorable condition. We do not have Research per Type of Institution highlights our own infrastructure and we have had the low levels of full-time research in the to give classes at a high school; so we fight country: just 17 percent of researchers claim for classrooms, we do not have proper to dedicate between 80 percent and 100 restrooms, … it is very serious but that is percent of their time to research. Moreover, where we stand in the social sciences.” (S.Paz, in the absence of an entity that regulates and 2019) qualifies research, or a policy that promotes the production of scientific knowledge, In addition, time allocated for ‘in-depth’ research activities tend to be carried out in research is insufficient. Until the 1980s, isolation.

Figure 10 - Researchers: Time Allocated to Research per Type of Institution

40% 1-20% (around 1 day/week or 1-2 months per year) 36%

30% 33% 33% 20-40% (around 2 days/week 32% or 3-4 months per year) 29% 29% 26%

26% 26% 40-60% (around 3 days/week 20% or 5-6 months per year) 20%

18% 60-80% (around 4 days/week 17% 17% 16% 10% or 7-8 months per year) 12% 10% 10% 8% 80-100% (around 5 days/ week or 9+ months per year) 0% 3% Higher Private Sector + Government and Total Education Civil Society Funding Agencies Bolivia

N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: Juy-September 2019 Source: CERES, 2019

17 (Spanish acronym, IDH) The revenue that the Bolivian national government earns from the extraction of hydrocarbons and then redistributes to subnational authorities – in this case, universities.

60 Doing Research in BOLIVIA Research culture and services survey (Figure 11). Private and civil society Institutions and policy, peer-review culture, actors stated that there has been an evident capacity-building, research support and deterioration in social science research in administration the country and, in turn, in its impact on public policies – as corroborated by Pereira The concept of a ‘research culture’ can be (2016) and Camacho et al. (2015): research seen as the supportive context in which centers and universities do not meet current research is uniformly expected, discussed, international requirements, dissemination produced and valued. material merely accumulates in libraries, there is an absence of quality assessment or The previous government generated ‘relevant’ statistical information on scientific activity in social research by promoting knowledge the country, and policy formulation is based produced by State-backed institutions (Vera, on ideological and political leanings. 2015). However, the institutional disconnect between the entities producing information As mentioned previously, unlike in other for the State and civil society is evident. The countries, there is no state institution that lack of systematic coordination among the promotes scientific research per se (Ardaya, different sectors – private, university and 2017). Therefore, there is no real form of government institutions – dedicated to institutionalized practice for academic research and the generation of knowledge, actors involved in social science research results in objectives that are unrelated to at country level. However, at the university the country's problems (Pereira, 2016). level, there are institutions, such as the Interestingly, the public sector actors Directorate of Scientific and Technological (executives and former ministers) who took Research (DICYT), that, to a certain extent, part in the in-depth interviews reported the promote scientific research. However, these existence of a national policy on social science do not ensure the quality of research but research – in contrast to the majority of actors instead focus more on the administrative (across all categories) that responded to the and bureaucratic elements of resource

Figure 11 - Researchers: Existence of a Research Body and a National Policy Related to Social Science Research, per Type of Institution

100% 10% 6% 10% 10% 9% 18% 80%

60% 100% 100% 90% 94% 90% 90% 91% 40% 82%

20%

0% Social Science Social Science Social Science Social Science research body research research body research body research body research National Policy National Policy National Policy National Policy Higher Private Sector Government and All Education + Civil Society Funding Agencies Institutions No Yes Source: CERES, 2019

Doing Research in BOLIVIA 61 management within the public university to integrate civil society institutions into the system. government’s 2025 Patriotic Agenda, they tend to condition their work. In fact, as Zurita (2012) and Camacho et al. (2015) have argued, the excess of current For reference purposes, in the period after regulations (DICYT, National Plan for Science Law 351 was introduced (from 2013), there and Technology, National Development Plan were 1,287 NGOs operating nationwide, but for Bolivian Universities and the plans of only 237 fulfilled the requirements of the law research centers and institutes) has meant and were legally entitled to exercise their that university researchers are not clear on powers and functions. the direction they should follow. An analysis by Kiai (2015), in his role as In the absence of a regulatory body or Special Rapporteur to the United Nations, clear policy, the system lacks parameters to affirms that "the restrictions established in assess the quality of knowledge production. the Bolivian norm can be interpreted as an The most urgent need is to define a single attack on the very foundation of the right general reference against which more to freedom of association." More specifically, specific regulations can be developed Kiai highlights the difficulties of civil society according to the needs of different actors, organizations in carrying out their activities in not only for the university system, but for all such a hostile environment. research undertakings (Camacho, et al., 2015). On the contrary, the State should promote an Around 90 percent of civil society environment that facilitates the engagement organizations consulted for this assessment of different actors in contributing to the agree that there is no institution in Bolivia development of the country. This excessive in charge of supervising research activities. regulation of sectors in the research However, there are certain regulatory policies, ecosystem reflects the lack of a conciliatory such as Law 351 on the granting of legal approach (Zurita, 2012). status, that limit the activity of NGOs, strictly prohibiting operations that are funded That said, the research culture in the with donations that come with political social sciences provides ample scope for and ideological conditions that affect the carrying out different types of research, country's sovereignty. This has meant that from diagnoses and/or baseline studies entities that receive external resources carried out by NGOs, to more analytical or donations from multilateral financial studies conducted in higher education organizations or international cooperation centers – each with their own regulations agencies vetoed by the Bolivian State have and procedures on to how to produce and been forced to close. handle data. Currently, training is being promoted in state universities to improve Although centralized coordination and control research production skills. are essential for successful governance (OECD, 2011), and although Law 351 was initially “My term has been characterized by efforts designed for regulatory and supervisory to provide support for research because purposes, they now appear to be used for that is the field I work in; so, the first thing obstructing the work of NGOs/CSOs. These I achieved was to develop regulations for mechanisms do not support the government's researchers, which started with the concern social and economic development platform that we do not generate articles for indexed (Kiai, 2015); rather than providing the tools publications. This is very difficult because,

62 Doing Research in BOLIVIA while indexed publications are starting Figure 12 – Access to Research Mentors, per Type of to gain more relevance, the university Institution (Percentage) cannot ask its researchers to produce these without providing the proper conditions for publishing. We have been asking for pricing 35% 46% – it is very expensive to index a magazine for 54% example. However, we are currently working 65% on that; we have already provided training on research management, bibliographies, how to write a scientific article and we are Higher Education Civil Society + Private Sector trying to approve a degree in research that doesn't currently exist at the university.”

(María E. Pozo, 2019) 33% 40% However, findings confirm that there is no real peer-review culture, in part as a result of 67% 60% the institutional crisis following the exit of international cooperation agencies. Some of the best-practices applied within research Government and Funding Agencies All Institutions institutions are based on the experience with No Yes previous projects funded by international N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for cooperation agencies that proposed research Bolivia = 96. Period of data collection: Juy-September 2019 protocols and guidelines for research design Source: CERES, 2019 and assessment. However, not all practices, including peer-review, have remained a part Some of the responses by actors from research of the dominant research culture. This has institutions suggest that the lack of mentoring led to the continuing deterioration of the is due to the fact that research work tends to social science research system in recent years be carried out on a project-by-project basis; (Torrez, Y., 2013). and that as trained professionals, researchers have the required competencies and skills to “PROEIB started out with financing from carry out their research activities without the the German Technical Cooperation of the need of a mentor. GTZ, 20 years ago. When the GTZ granted resources, there was nothing to do but However, some researchers pointed out the research, so there were many opportunities...” lack of skills in preparing scientific articles and (F. Prada, 2019) the need for greater mentoring/tutoring in academia: In terms of mentoring, 54 percent of the respondents from the higher education “Universities here do not really teach you how survey reported not having access to to write a scientific article – to make a good mentors. In the higher education context, abstract, for example, or respect intellectual mentoring is usually associated with thesis property. If you copy a quote but do not provide guidance at both undergraduate and the source, your professor will not say anything; graduate levels. Respondents from the the same goes for those reviewing thesis work. private sector, civil society, and government The university does not promote scientific and financing agencies where less likely to quality: what makes a good thesis that could seek out mentors. (Figure 12) be considered for publishing” (F. Arteaga, 2019)

Doing Research in BOLIVIA 63 The results of the survey show a very mixed Interviews with representatives from response: the degree of satisfaction with government agencies revealed that there is a mentoring varies a great deal. It is interesting demand for social science research for informing to note that overall levels of satisfaction with public policy. However, concerns over limited research capabilities in Bolivia are relatively funding and resources, as well as a lack of high compared to those of researchers. interest in joint and transparent data collection, continue to undermine the relationship I believe that, in terms of influence, we need to change our academic culture... Given the between researchers, institutions and those complexities and the scarcity of resources responsible for public policy (Pereira, 2016). with which we operate, we fail to qualify in Consequently, non-state social science terms of the indicators that allow us to meet research services often turn to international the standards of international research. That development cooperation agencies given is why the few investigations that are carried their use of scientific evidence; these agencies out with some validity are linked to universities also provide research centers with access to or international academia; it is through them resources. However, this means adopting the that we have managed to enter international research agendas of external agencies. This academia. (R. León, 2019) highlights the fact that in order to develop a In terms of administrative support for locally driven research culture, the coordination research activities – which includes support channels between different actors need to be for the planning and implementation improved (Camacho et al., 2015; Peres, 2012; of research, proposal development and Zurita, 2012). the hiring of research staff – the levels of satisfaction across all institutions appears Research output and training to be very mixed. With the exception of Academic output, Research training government and funding agencies, very few respondents reported high levels of In Bolivia, despite the deterioration in research satisfaction (Figure 13). practices, production has increased: more

Figure 13 – Researchers: Levels of Satisfaction with Available Administrative Support, per Type of Institution

100% 2% 10% Very dissatisfied 16% 17% 21% Somewhat dissatisfied 0% 13% 80% Dissatisfied 10% 24% Satisfied 33% 27% Moderately 60% Very satisfied 31% 0% NA/I don't know 33% 40% 33% 28% 26% 20% 16% 11% 8% 6% 17% 7% 3% 0% 5% 4% Higher Private Sector Government and All Education + Civil Society Funding Agencies Institutions N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: Juy-September 2019 Source: CERES, 2019

64 Doing Research in BOLIVIA documents, reports, studies or evaluations However, the current setting within academic are being produced, although the quality institutions is very different. Most research varies a great deal. activities are conducted in isolation, without the proper channels to share findings and/or It is worth noting that the most relevant sources, making it harder to influence policy research from civil society institutions relates (Torrez, Y., 2013). to that of the PIEB. Established in 1994, PIEB promoted relevant and strategic research The data from the survey illustrates the aimed at informing political, economic and disparity between the large amount of published research and the limited number of social reforms in Bolivia, contributing to papers published in indexed journals (Table policy proposals on a range of national issues: 15). This is despite the fact that Latin American reducing social inequalities, improving social researchers consider indexed publications integration, and strengthening democracy to be one of the highest-ranking forms of in Bolivia (Duran, 2015). Greater competition, research dissemination (Buquet 2013). Bolivia transparency and respect for the views registered one of the lowest numbers of peer- of researchers, as well as respect for the reviewed publications in the region, with an theoretical and methodological plurality average of 300 publications per year in Scopus adopted by institutions such as PIEB, set the for the period between 2008 and 2017 (RICYT, standard for academic research in the country 2019) – compared to Argentina (12,098) Brazil (PIEB, 2015). (61,042) and Peru (1,630), to name a few.

Table 15 - Researchers: Number of Publications in the Last Three Years, per Type of Document Number Minimum Maximum Standard Item of number of number of Mean Median error responses publications publications Peer-reviewed 95 0 11 1.6000 1 2.3036 scientific article published in journals and conference proceedings Non-peer-reviewed 95 0 22 1.7789 0 3.5165 scientific article published Publicly available 94 0 25 3.6489 2 4.4255 working paper Book as the sole 94 0 8 0.5319 0 1.0339 author Book as (one of) the 95 0 6 0.7158 0 1.0883 editor(s) Chapter in book 95 0 15 1.1684 0 2.5250 Report (technical, from 94 0 30 4.5532 3 5.8798 a project/consultancy) Policy brief (a short 94 0 85 2.0638 0 9.0063 paper on policy implications of research) Source: CERES, 2019

Doing Research in BOLIVIA 65 Figure 14 – Administrators: Proportion of Staff with PhD in Social Science per Type of Institution (Percentage)

100%

80% 55% 0-15% 60% 75% 74% 15-30% 100% 30-45% 40% 18% 45-60%

60-75% 20% 9% 10% 10% 5% 5% 18% 5% 5% 3% 0% 5% Higher Private Sector + Government and All Education Civil Society Funding Agencies Institutions N for High Education = 11; N for Private Sector and Civil Society = 20; N for Government and Funding Agencies: 8; N for Bolivia = 39. Period of data collection: Juy-September 2019 Source: CERES, 2019 “… National research has a great diffusion Findings in Figure 14 from research problem; there are very few who can publish. administrator surveys show that the it is not just a case of putting information proportion of staff with a PhD in social on paper or uploading it to the cloud, but of science is still very low across all main actors doing so under certain conditions that are of the social science research system in accepted worldwide. If this is not reinforced Bolivia, which supports the findings from the in Bolivia, we will remain inward looking previous sections on the lack of a specialized and not take part in the great theoretical, workforce in research institutions, even within methodological, epistemological and the higher education sector. political discussions taking place in science today. We cannot expect support only from A closer look at the institutional and legal international cooperation because that framework that enables organizations, support has always been conditioned on institutions and agencies at all levels of the topics, purpose, etc.” (R. Leon, 2019) national research system to enhance their

Figure 15 - Researchers: Duration of Research Training (in Weeks) per Type of Institution (Percentage)

60%

67% 0-2 3-5 6-9 40% 47% 10-15 46% 15+ 41%

20% 31% 27% 23% 23% 17% 17% 14% 8% 8% 8% 7% 6% 6% 0% 5% Higher Education Private Sector + Civil Government and All Institutions Society Funding Agencies N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: Juy-September 2019 Source: CERES, 2019

66 Doing Research in BOLIVIA capacities, shows a clear difference between formally exist in Bolivia) is very difficult, civil society entities and those linked to particularly due to the lack of economic public universities. While private and civil support and local sources of financing society institutions have little or no capacity- (Torrez, Y., 2013). building for researchers, public universities conduct continuous research training (Figure Findings from the surveys reveal that 60 15 - Researchers: Duration of Research percent of respondents were pessimistic Training (in Weeks) per Type of Institution about their future career as a social science (Percentage)). This has led to a significant researcher due to the scarcity of professional gap in terms of research capacity between opportunities (Figure 16). The lack of an university actors and the other categories incentive system for research in the social of stakeholders. In this context, there is an sciences has an impact on the time that urgent need for scientific and technological researchers devote to their research work development policies that guide the training and, consequently, on the quantity and and use of human resources across all quality of research production. sectors, including NGOs (Pereira, 2016). As observed by Ardaya (2008), many Learning and sustainability academic institutions, as well as the State Researcher job market, Research evaluation itself, do not promote or pay adequately for research. In most cases, research activities The overall findings show that there are few are the result of the vocational and personal opportunities for social science researchers interests of individual researchers. in Bolivia. Conducting research and pursuing a ‘career’ as a researcher (which does not Human resources are the most important aspect of research production; developing Figure 16 – Researchers: Perceptions of Attractive Career research capacity and creating opportunities Opportunities for Researchers, per Type of Institution (In for researchers is therefore critical (Camacho Percentage) et al., 2015). In terms of incentives, as shown in Figure 17, there is clear dissatisfaction 29% with the financial rewards associated with a 49% 51% research career in Bolivia – with the exception of government institutions and financing 71% agencies, which have sufficient resources to cover their research activities. Similar Higher Education Private Sector + Civil Society perceptions were reported in an article by Jiménez (2018) in which Bolivian researchers from universities and civil society claimed 40% that research is still considered ad honorem 50% 50% and, in many cases, without assigned hours. 60% Notoriety and social recognition appear to be a clear motivation for actors from Government and Funding Agencies All Institutions universities, civil society and the private

No Yes sector, whereas this is not the case for those

N for High Education = 39; N for Private Sector and Civil from government and funding agencies. Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: Juy-September 2019 Therefore, it is essential to formulate Source: CERES, 2019 government policies that set out the

Doing Research in BOLIVIA 67 Figure 17 – Researchers: Satisfaction with Overall Incentives Related to a Research Career, per Type of Institution (Percentage)

100% 2% 4% 2% 1% 2% 2% 17% 20% 33% 33% 29% 80% 41% 41% 39% 50% 59% 62% 60% 67%

83% 40% 78% 67% 67% 69% 59% 59% 58% 50% 20% 41% 37% 29%

0% Financial Notoriety/ Job Financial Notoriety/ Job Financial Notoriety/ Job Financial Notoriety/ Job Rewards Social Security Rewards Social Security Rewards Social Security Rewards Social Security Recognition Recognition Recognition Recognition Higher Education Private Sector + Civil Society Government and All Institutions Funding Agencies

Dissatisfied Satisfied NA/I don't know Source: CERES, 2019 priorities for mobilizing resources and in Bolivia. Although many research improving the incentives (financial and projects allocate a specific amount for the otherwise) for a career in science, technology dissemination of project results, typically in and innovation, in order to attract and retain the form of a printed publication, there is the brightest talent in Bolivia (Pereira, 2012). very little diffusion outside of the close circle of associates related to the project. The lack Diffusion of (or limited) reading habit in the country Although the production of social science means that publications are often only research in Latin America has increased distributed among specialists or colleagues exponentially over the last two decades, (PIEB, 2015). Moreover, research published in much of it suffers from low visibility and is not books or other forms of printed material fails highly regarded within the academic world, to reach key actors such as policymakers – an largely due to the publication of research issue that has hindered the use of evidence in journals of lesser repute (according to for policy formulation (Peres, 2012). Often, international rankings) or in local journals these publications do not even make it into in the countries of origin (Buquet, 2013). public university libraries, which tend to According to data published by SCImago accumulate obsolete material rather than Journal & Country Rank (2011), Latin America acquire and disseminate publications on the produces only 4 percent of global scientific latest scientific and technological advances production, of which Bolivia contributes (Peres, 2012). The general experience of only 0.3 percent. However, as this calculation respondents is that there is a systematic does not take into account local journals, disconnect between those that produce but only the research work of Bolivian research and those that need to use it. institutions published in indexed journals, it In this section, we discuss the actors and does not provide a full picture of scientific networks that produce and consume dissemination in Bolivia (Erostegui et al., 2011). research. First, we show that both activities The diffusion of research is one of the are concentrated in a few big cities – and that weakest aspects of the research system even within each city the production and

68 Doing Research in BOLIVIA diffusion of research varies greatly. Second, knowledge production (Sandoval, 2019). we document the role of international This has led to an increase in researchers and cooperation in facilitating the development institutions interested in producing scientific of research networks and international knowledge and promoting debate on issues exposure. Our interviews suggest that as specific to regional contexts. However, the financial support from international despite these initiatives, researchers remain cooperation wound down, the exposure of concentrated in the three main cities, La Paz, local researchers to international events and Cochabamba and Santa Cruz. networks of peers decreased significantly. Third, we provide evidence that shows And just as Bolivia is a deeply heterogeneous that the majority of research products country, the types of actors involved in are disseminated in the form of printed processes of knowledge generation and materials, mainly books and reports, whereas research in social sciences is equally diverse other forms of communication such as (Torrez, Yuri F., 2013). workshops, conferences and seminars are Although there is no coordinating body to less common. Finally, we highlight the challenges for the popularization of scientific facilitate cooperation between entities that knowledge, in particular the ways in which generate State policies and civil society, there the current political context has impeded the is some evidence of interactions between participation of NGOs in the production and the different types of actors (public entities, dissemination of knowledge. international cooperation agencies, civil society organizations dedicated to research Actors and networks and knowledge generation, and public and National geography of research, diversity private universities) – albeit fairly limited of actors and collaboration, research (Camacho et al., 2015; Pereira, 2016; Peres, communication skills 2012; Zurita, 2012). In correlation with the relative progress in When looking at the interactions of social science, Bolivia has also experienced a researchers with the different institutional gradual regional decentralization of scientific actors, we can see a closer relationship

Figure 18 - Researchers: Interactions Between Actors, per Type of Institution (Percentage)

100% National Nonprofits

Government 80% International Agencies 84% 83% 83% 60% National Universities 72% 72% 67% 63%

62% International Universities 59% 40% 51% 49% 49% International Nonprofits 45% 44% 43% 38% 35% 36% 33% 33% 20% 33% 27% 26% 17% 0% Higher Education Private Sector + Civil Government and All Institutions Society Funding Agencies

N for High Education = 39; N for Private Sector = 1; N for Civil Society = 50; N for Government and Funding Agencies: 6; N for Bolivia = 96 Source: CERES, 2019

Doing Research in BOLIVIA 69 with non-profit organizations and national Table 16 shows that research discussions universities than with the government. are less accessible to minority groups, In addition, there has been a gradual policymakers, and community groups and reduction in interactions with international associations. This is because, in some cases, organizations (Figure 18). these groups are less well organized or research discussions are somewhat abstract Figure 19 illustrates the surveyed researchers’ – research is not communicated in a format perceptions of the extent to which research that is accessible to a wider non-specialist discussions are accessible to different groups audience – or a lack of information exchange of stakeholders: academics, non-university researchers and women. The degree of between actors (Pereira, 2016; Peres, 2012) accessibility for the first group (universities It is also worth noting the emergence of new affiliates of all academic levels) is higher civil society movements. These include: when the discussions involve actors such as universities, government agencies and • Collective action and social movements international cooperation organizations but based around issues relating to culture, are less accessible when they relate to civil the environment, political activism, human society. Whereas for the second group (non- rights and gender-based violence university researchers), research discussions • Social communities18 are perceived to be less accessible across all categories of actors. Finally, the participation These groups tend to carry out simple forms of women in research discussions has of research aimed at documenting their increased because research debates are now experiences, or looking for information to more relevant to gender issues. justify their demands.

Figure 19 – Researchers: Accessibility of Research Discussions for University Affiliates, Non-University Researchers and Women, per Type of Institution (Percentage)

100% 3% 3% 5% 8% 10% 12% 14% 9% 11% 33% 33% 33% 80%

47% 60% 69% 59% 55% 77% 72% 59% 66% 63% 33% 33% 40% 50%

20% 41% 33% 33% 35% 28% 23% 31% 27% 26% 26% 21% 17% 0% University Non- Women University Non- Women University Non- Women University Non- Women affiliates university affiliates university affiliates university affiliates university of all researchers of all researchers of all researchers of all researchers academic academic academic academic levels levels levels levels

Higher Education Private Sector + Civil Society Government and All Institutions Funding Agencies

Inaccesibly Accesible NA/I don't know

N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019

Source: CERES, 2019

70 Doing Research in BOLIVIA Table 16 - Researchers: Accessibility of Research Discussions for Minority Groups, Policymakers, Community Groups and Individual Community Members, per Type of Institution (Percentage) Private Government Higher Sector All and Funding Education + Civil Institutions Agencies Society Minority Inaccessible 35.9% 45.1% 66.7% 42.7% Groups Accessible 53.8% 35.3% 0.0% 40.6% NA / I don’t know 10.3% 19.6% 33.3% 16.7% Policymakers Inaccessible 33.3% 25.5% 16.7% 28.1% Accessible 56.4% 43.1% 50.0% 49.0% NA / I don’t know 10.3% 31.4% 33.3% 22.9% Community Inaccessible 28.2% 43.1% 66.7% 38.5% groups and Accessible 64.1% 39.2% 0.0% 46.9% associations NA / I don’t know 7.7% 17.6% 33.3% 14.6% Individual Inaccessible 35.9% 47.1% 50.0% 42.7% community Accessible 56.4% 39.2% 16.7% 44.8% members NA / I don’t know 7.7% 13.7% 33.3% 12.5%

N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019 Source: CERES, 2019

In line with the perception of some of the cooperation agencies, which allowed Bolivia surveyed researchers, we believe that the to establish networks for academic discussion relationship between civil society actors at a global level (Pereira, 2016). and government agencies should be one of mutual exchange that is achieved when After this period, inter-institutional knowledge design and political engagement communication deteriorated, and social is a reflective and continuous process research in Bolivia became increasingly involving a whole range of actors, not just introspective, to the extent that even intellectuals and policymakers. However, government agencies would not share their a dynamic and reflective interaction information with actors who required it between actors in Bolivia requires the broad (Peres, 2012). It is, therefore, no coincidence deployment of economic, human and that communication training in the different academic resources, which has become social science research centers has not been increasingly difficult in recent times. a common practice. With the exception of research centers linked to public and This has not always been the case. In fact, private universities, we identified a lack during the 1980s and 1990s, knowledge of institutional support for developing production was given a great boost, communication skills for researchers in the again with resources from international social sciences: more than 28 percent of respondents reported not having received 18 Legally constituted neighborhood councils created to prioritize local development projects related to health, any form of communication training in the education and infrastructure services, among others. last three years.

Doing Research in BOLIVIA 71 Figure 20 - Researchers: Number of Communication Training Sessions, by Type of Institution (Percentage)

60% 67%

59% 0

1-2 40% 46% 3-4

5+ 33% 31%

29% NA / I don't know 20% 27% 26% 23% 15% 13% 10% 12% 2% 5% 0% 2% Higher Education Private Sector + Civil Government and Funding All Institutions Society Agencies N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019 Fuente: CERES, 2019

The actors and networks involved in to internationally recognized standards dissemination report that the cost of (Buquet, 2013). disseminating data can be a barrier to its use. Budget planning and the type of financing This academic introspection is reflected in determine whether research results are made the data on participation in international public. Most foundations and NGOs have to research: 53 percent of the researchers subsidize dissemination through external surveyed reported participating in between financing; sometimes the dissemination 1 and 2 international research projects in of research is limited merely to internal the last three years; only 25 percent have technical reports. participated in between 3 and 4 projects, and 15.2 percent have not participated in any Networks are the most effective means of international research projects over the same presenting results; they are also considered time period. Consequently, Bolivia’s presence a space for mutual feedback among and influence on the international stage has institutions of a similar nature or with been lost. shared interests. However, according to the interviewees, participation in networks tends Moreover, more than half of the researchers to be informal; in fact, knowledge tends to be surveyed are not affiliated to any circulated through unofficial channels rather international network of researchers or than institutionalized networks. registered in an international repository. There are also very few institutions that Research communication have inter-institutional agreements with Local journals, International exposure universities and institutes abroad. Over the years, scientific articles have Research communication products become an essential source of knowledge Conferences and debates, Online visibility of dissemination (Hicks, 2004). In the case research, Media and advocacy of Bolivia, there has been no increase in the number and quality of publications in Written publications of research production journals, largely due to the lack of adherence remain the main form of dissemination

72 Doing Research in BOLIVIA for most institutions; debates, workshops would improve access to evidence that could and conferences take second place. This form the basis of public policies. corroborates the findings of Buquet (2013) in his analysis of the community of social Despite the fact that a high percentage science researchers in the region: he of researchers recognize the potential of observed that the community is divided promoting online visibility, websites or other into two groups: those who give more virtual academic spaces remain outdated importance to articles in peer-reviewed and are not always linked to the activities of journals, following global trends in evaluation other institutions through online social media of academic production, and those who channels. consider books as the highest-ranking form of “… Our website is quite poor because the publication, a more national or regional trend. Internet is also really slow at the university. Many researchers produce books and reports Our unit relies on half a gigabyte, which that have limited reach. Their influence doesn’t even let you load your emails on public policies is therefore likely to be properly. I have to ask the only IT person at minimal. the school to upload a file and then find out that I can’t do it because it’s too large. So, we The other thing that we have to take into are limited in what we can do. We could take account as academics, after so many years, more advantage of social media but we are is whether our striking reports, our beautiful not doing it.” (J. Ledezma, 2019) publications are enough to influence policies … we continue to pass on important Popularization of science information to technicians, not knowing if Social appreciation and media coverage of it will remain within the administration of research State institutions for two or three months, The popularization of science involves assuming that the information is going to the important task of translating scientific be read and/or discussed. I believe that there knowledge into a format that is more is an exercise that we are missing, and that accessible to the general public (Scharrer, is the ability to reflect and establish other 2017). types of relationship, because delivering reports is not enough. For years, we have In Bolivia, there are ethical, political, social been delivering reports to the State and and cultural understandings of science that international organizations, but this remains need to be taken into account when publicly a mere formality and fails to establish a true communicating social science research. In relationship. (R. León, 2019) this context, actors such as public universities or national newspapers should articulate There is a fixation with doing things in a academic research for the benefit of public more traditional way, which is also reflected policymakers and civil society, but often fail in the number of institutions that have an to do so (Torrez, Yuri F., 2013). active website. Surprisingly, 25 percent of the institutions visited during this project Rennie and Stocklmayer (2003) note that do not have a website for communicating “people selectively filter and re-structure their research activities. This significant gap scientific information into a form they find in dissemination was also reported by Peres personally meaningful and useful…the (2012), who argued that improvements in ‘public’ simply do not understand science information and communication technology on science’s terms, but on their own terms.

Doing Research in BOLIVIA 73 This includes understanding scientific or interviews. So, although there is a State ideas…but extends much further into initiative to popularize science, it is not issues of understanding risk, pride in local recognized by social science researchers. understandings, and cultural and societal values” (p. 765). The role of the media is seen, ideally, as providing valuable insight into the perceived During the search for information for this needs and priorities of the community, and section we discovered the existence of an disseminating policy-related information, agency under the Vice Ministry of Science especially where the aim is to effect action, and Technology, the System for Scientific a change of policy or to alter the public's and Technological Information (SIBICYT), view of an issue. As shown in Table 17, which “is a set of strategies and tools for researchers identified the Internet and information and scientific and technological social media as the most popular space for communication in support of the State research dissemination, giving it a satisfactory Science and Technology System. Its aim is rating. On the contrary, the coverage in to develop a knowledge culture in Bolivia, newspapers, and on television and radio based on access, exchange and generation was seen as unsatisfactory due, above all, of scientific, technological and innovation to the lack of interest from media outlets information”. Unfortunately, this agency and the sensationalist/tabloid editorial lines. was not mentioned in any of the surveys These findings reflect the recent emergence

Table 17 - Researchers: Levels of Satisfaction with Media Coverage, per Type of Institution (Percentage)

Private Government Higher All Sector + and Funding Education Institutions Civil Society Agencies Newspapers Dissatisfied 46.2% 49.0% 83.3% 50.0% coverage Satisfied 51.3% 45.1% 16.7% 45.8% NA / I don’t know 2.6% 5.9% 0.0% 4.2% Total 100.0% 100.0% 100.0% 100.0% Television Dissatisfied 56.4% 66.7% 83.3% 63.5% Coverage Satisfied 38.5% 31.4% 0.0% 32.3% NA / I don’t know 5.1% 2.0% 16.7% 4.2% Total 100.0% 100.0% 100.0% 100.0% Internet/ Dissatisfied 30.8% 31.4% 66.7% 33.3% Website Satisfied 66.7% 66.7% 33.3% 64.6% coverage NA / I don’t know 2.6% 2.0% 0.0% 2.1% Radio Total 100.0% 100.0% 100.0% 100.0% coverage Dissatisfied 51.3% 52.9% 83.3% 54.2% Satisfied 43.6% 43.1% 0.0% 40.6% NA / I don’t know 5.1% 3.9% 16.7% 5.2% Total 100.0% 100.0% 100.0% 100.0%

N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019 Source: CERES, 2019

74 Doing Research in BOLIVIA of social media through which researchers more actors in the design of public policies, not only convey their research projects and but this has not been the case. In addition, findings, but also receive a substantial flow of the political climate in recent years has been almost instant feedback. particularly critical of the work of NGOs, including those that were dedicated to the In summary, although there has been a production of research. considerable increase in scientific production, the dissemination of research at the national The government continues to demand and regional levels has failed to reach research from government institutions such an international audience and has had a as the National Statistics Institute (INE) and limited impact on public policies. This is UDAPE. However, the research produced by partly because researchers tend to publish these organizations is often kept for internal in local indexed journals of little relevance use only and has relatively low rates of or in books or book chapters because of diffusion. As Zurita (2012) explains, there is the ease of publication (Buquet, 2013). As a lack of coordination mechanisms to align Oxhorn (2015) explains, scientific research themes, resources, operations, results and needs to reach and be read by legislators and emerging interactions between the various politicians if it is to achieve effective change. research centers. As a result, the political and economic measures taken by the previous A diffusion model that could be considered national government were based on the for application in the future is the one interests and ideologies of the State, rather established by PIEB (1994-2016). This is based than on studies by research centers. on strategic research, which seeks to produce and publicize research that has a social utility Despite these considerations, there is a and that engages public policymakers, in general consensus within the government addition to academics and civil society actors about the importance of the production (Gutiérrez, 2007). Communication was an of research and the need for evidence- integral part of all stages of the research based public policymaking. However, cycle; in other words, actors (including those while government agencies claim that involved in implementing/socializing the they regularly generate research and results) where engaged throughout the have a responsibility to use the findings project, not just presented with the results at in developing policies – as noted in the the end (Sandoval, Toranzo, Yapu, Franco & reports by the Ministry of Education on Aillón, PIEB, 2015). research networks (2011, 2019) – much of this research is discredited by civil society Uptake organizations. The political climate in Bolivia is not conducive to scientific debate, mainly The overall view is that the influence of social because of the excessive ‘ideologization’ that science research on the design of public has polarized society and kept the different policies has been in decline and that the actors in constant confrontation for almost use of evidence as an input for public policy twenty years. formulation is minimal (Peres, 2012). This finding is somewhat paradoxical given that However, from the interviews carried out for the constitution opened up opportunities this study, we were able to identify particular for civil society to have a direct role in cases in which a local initiative had an impact elaborating bill proposals. This initiative on the demand for research, and how this should have increased the participation of was used to inform the design of public

Doing Research in BOLIVIA 75 policies. For example, the director of INCISO- take into account demographic dynamics in FACTO-UMSS, explained how two of their a structured and scientific manner. researchers were able to use their findings to encourage their municipality to reach out Policy-friendly research materials to local communities and teach techniques Political value of research, policy-relevant for self-diagnosing cervical cancer. The research, Research-policy nexus municipality is now considering taking a In general, researchers have sufficient more active role and pushing for legislation. independence to generate information free Experiences such as this show that research from political pressure. However, in Bolivia, can have an impact on the design of public the lack of available data makes it difficult policies in Bolivia. However, the impact is to carry out in-depth research; this does not limited to very specific contexts. While there encourage the long-term development of is evidence of research from universities scientific knowledge supported by viable reaching the population and grassroots empirical evidence (Camacho et al., 2015; organizations and, at times, permeating Pereira, 2016). This translates into a level sub-national levels of government, there is of indifference from policy makers toward still a disconnect between the production of academia and international cooperation research, and policies and initiatives at the (Pereira, 2016; Zurita, 2012), rather than policy national level. that promotes the independent production of scientific knowledge. Within this study, it was reported that national data relating to population Findings in Figure 21 show that there is demographics (age and population size) little evidence of explicit censorship across has yet to be updated, hindering the design all categories of institutions: 35 percent of of effective public policies in Bolivia in researchers believe that, over the last three recent years. We were unable to identify years, there has been no political interference any education, health, safety, employment, from policymakers in their research, while 31 housing or poverty reduction policies that percent perceive only a little.

Figure 21 - Researchers: Ability to Conduct Research without the Undue Influence of Policymakers, per Type of Institution (Percentage)

50% 50% 40% A lot of Interference Some Interference 41% Little Interference

30% 35% 35% 33% 31% 31% No Interference 28% 20% I don't know 20% 18% 10% 17% 15% 14% 10% 8% 5% 5% 0% 4% Higher Education Private Sector + Civil Government and All Institutions Society Funding Agencies N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019 Source: CERES, 2019

76 Doing Research in BOLIVIA In general, as verified by the survey, the Figure 22 - Policymakers: Requests for Research on current environment does not encourage Policy-related Topics (Percentage) collaboration between academia and state agencies, which is clearly reflected in the 60% 65% limited number (or absence) of interactions between these actors during the past decade (Camacho et al., 2015; Pereira, 2016; Zurita, 40% 2012). 35% 20% In terms of requests for inputs for public policy, 67 percent of the researchers surveyed 0% reported that they had not received any, No Yes while 33 percent had. Of the latter, 49 percent N for Policymakers = 20 Source: CERES, 2019 had received one request per year and only 9 percent had more than five requests per disseminate their findings to all the relevant year. Likewise, only 50 percent of surveyed private sector and government stakeholders research administrators reported that their that will be affected by the policies as a institution had worked directly with public means of avoiding any tension during policymakers over the last three years; of implementation – rather than in an effort to these, 55.6 percent, two or three times, 22 seek their input (Banco Central de Bolivia, percent, only once, and merely 11 percent, 2015). more than five times over the same period. This perception of ‘self-reliance’ was also On the other hand, 65 percent of observed in the surveys. A significant policymakers reported that they had proportion of policymakers reported requested research on particular issues in requesting research on specific topics, the last three years (Figure 22). Policymaking whereas the private sector reported the is essentially a government-led exercise. opposite: very few requests for research on The government uses state-run research topics of interest to policymakers as well as centers such as INE, UDAPE and the Central limited participation in policymaking and Bank of Bolivia to design economic policies. only occasional interaction with actors in the The latter, in a 2015 document entitled ‘The public sector. role of scientific research in the Central Bank of Bolivia’ reports that the public sector An analysis of funding from public research entities responsible for the design policymakers for social science research in and implementation of economic policies the last three years (Table 18) shows that,

Table 18 - Researchers and Administrators: Grants Received from Policymakers, Per Type of Institution (Percentage)

Higher Private Sector Government and All Education + Civil Society Funding Agencies Institutions No 89.7% 80.39% 66.7% 83.3% Researchers Yes 10.3% 19.61% 33.3% 16.7% No 72.7% 80.0% 62.5% 74.4% Administrators Yes 27.3% 20.0% 37.5% 25.6%

Source: CERES, 2019

Doing Research in BOLIVIA 77 Table 19 - Researchers: Having Held A Policymaker Position, per Type of Institution (Percentage)

Government Higher Private Sector All and Funding Education + Civil Society Institutions Agencies A policymaker No 92.3% 92.2% 100.0% 92.7% position, at central level Yes 7.7% 7.8% 0.0% 7.3% A policymaker No 97.4% 90.2% 100.0% 93.8% position, at decentralized level Yes 2.6% 9.8% 0.0% 6.3%

N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019

Source: CERES, 2019

for the most part, neither administrators across the developed world. It is a process nor researchers (in both public and private enhanced by data generated within the institutions) received any state financing, social sciences, which enables policymakers which again reflects the lack of interaction to evaluate the impact of policies more between researchers and policymakers. precisely. “…the Government has always been very One of the main functions of public policies reluctant to [collaborate with] NGOs, is to benefit the public good. This is achieved foundations and international cooperation, by promoting the formal and/or informal which in the end led to the cessation of collaboration of a range of actors (besides the financing.” (A. Uzeda, 2019) government) in the development of policies (Quisbert, 2018). However, 71.4 percent of policymakers say that they benefit, both personally and Evidence must be a fundamental part through their institution, from the products of public policymaking since it requires of researchers, and 47.6 percent have used knowledge of the interests, motivations, aims these to produce material related to policies. and perceptions of actors across the whole country (Peres, 2012) The number of researchers that have held policymaker positions at a central or “I believe there was a period that, in decentralized level (Table 19) is minimal time, will be valued as the golden age of across all institutional sectors. This highlights [collaboration]… the period between 1993 the lack of opportunities for social science and 1998, the first government of Sánchez de researchers to work with institutions engaged Lozada, when academic actors participated in policy design and implementation. directly in the development of public policies.” (L. Baptista,2019) Research-based policymaking Formal and Informal collaboration Several interviewees highlighted the ongoing use of state agencies to generate research Applying scientific standards of proof to for public policy, along with the excessive policymaking is a recent phenomenon ideologization and regulation of academia

78 Doing Research in BOLIVIA Table 20 - Researchers: Membership of Bodies Advising Policymakers, per Type of Institution (Percentage)

Private Government Higher All Sector + and Funding Education Institutions Civil Society Agencies A member of a policy No 84.6% 90.2% 50.0% 85.4% advisory body, at central level Yes 15.4% 9.8% 50.0% 14.6% A member of a policy No 92.3% 84.3% 66.7% 86.5% advisory body, at decentralized level Yes 7.7% 15.7% 33.3% 13.5%

N for High Education = 39; N for Private Sector and Civil Society = 51; N for Government and Funding Agencies: 6; N for Bolivia = 96. Period of data collection: July - September 2019

Source: CERES, 2019

(as corroborated by Camacho et al., 2015; 2012). This, in turn, can contribute to the Pereira, 2016), both of which have been development of public policies that promote counterproductive for research in general. sustainable economic development (Pereira, 2016) Policymakers in Bolivia are influenced by a wide range of powerful actors and “Saying that legislation is based on research regulations, as well as party lines and is an overstatement; it doesn't happen now, ideological beliefs. In general, when it didn't happen before, and I don't know designing and implementing public policies, if one day it will. UDAPE and other state political interests prevail over the evidence research institutes already produce a lot supported by research (Pereira, 2016; Peres, of information, which is not exactly bad. 2012). This is reflected in the fact that Back in the 1980s, the Ministry of Planning only around 14 percent of the surveyed produced a lot of social information. In researchers have held a position on a council/ fact, people from CERES at the time worked body that advises policymakers (Table 20). at the ministry. So, there is influence, but The dominance of political interests means ultimately the decisions are strategic, and that any change in administration can strategic means political. Although [research] radically shift the direction of policy. is taken into account in planning, in policy Often, according to an analysis by Quiroga design, we know that the discussion is not (2012), weaknesses in public policies do not only about them listening to us, taking us relate to a lack of information or knowledge, into account within the design; the issue but to political interests or social pressures is between the design, the promulgation that generate bias in their design and and the execution – that is where the gap implementation. Consequently, there is a is. When an implementation strategy is need to strengthen institutions and existing going to be carried out, that is when the mechanisms that can systematically promote philosophy or the approach are no longer interactions between researchers and taken into account... This happened before policymakers, as well as other stakeholders and it happens now; this is when real politics who can influence the uptake of research appears and begins to get in the way. The findings without exclusions (Camacho et political actors who have to execute the al., 2015; Pereira, 2016; Peres, 2012; Zurita, policies, the ones that respond to the public,

Doing Research in BOLIVIA 79 to the opposition – that's where the gap is unit; all the diagnoses, prior evaluations and generated between science and politics.” (R. implementation mechanisms were designed León, 2019) in coordination with the sectoral ministry and put forward to the executive authorities for In contrast to opinion-based policy, research- consideration.” (UDAPE,2019) based policy requires an evidence base at all stages of the policy cycle – to shape However, as observed in the work of Peres agendas, define priority issues, decide (2012), public officials often report that they on actions and monitor their impact and use research "to make a good impression" outcomes (Peres, 2012). According to the and that, in reality, the demand for research survey, this is not the case in Bolivia: over products for informing public policy is in 65 percent of respondents report that they name only. have never participated in the development Over 66 percent of the researchers reported of policy and that the State (as well as the that they have never participated in policy private sector) does not welcome input from development (Figure 23); those who scientific professionals (Rodríguez and Weise, had, claimed to have participated in the 2006 in PIEB, 2015). formulation of laws, strategies and programs, Nevertheless, some of the interviewees have and not their implementation, monitoring participated as political advisors or become or, importantly, their evaluation. Researchers opinion leaders. who work closely with municipal authorities and/or higher-level public authorities “We have participated, for example, in the were either from public universities in Scientific Citadel project, which is currently Cochabamba or civil society institutions/ being developed. We have responded to all government agencies in La Paz. the projects of the local government that sends over their requests, and we are also Figure 23 – Researchers: Participation in the Formulation participating through our BA programs, of Policies, per Type of Institution (Percentage) according to each of their lines of work. For example, [the departments of] social 33% 31% psychology, pedagogy, and the school of law, have agreements with the government, 69% with the legal aid office, depending on the 67% institution that is required.” (M. Guardia, 2019) Higher Education Private Sector + Civil Society Research-based policy products Instrumental utilization 33% 34% Government agencies and related institutions claim that all their policies are the result of 67% reflection and scientific research. 66%

“…This unit [UDAPE] is dedicated to the Government and Funding Agencies All Institutions production of research. When the Juana No Yes Azurduy Bonus [a bond scheme for uninsured N for High Education = 39; N for Private Sector and Civil pregnant women and children under the age Society = 51; N for Government and Funding Agencies: 6; N for of two] was designed, all the economic and Bolivia = 96. Period of data collection: Juy-September 2019 social research was developed within this Source: CERES, 2019

80 Doing Research in BOLIVIA Acknowledging the absence of a functioning In order to improve the use of knowledge relationship between research and public in policymaking, alignment between policy – a recognition that it is rare for the researchers and policymakers throughout State (at any level) to use research to inform the country during knowledge production regulatory and management policy, and that is essential (Pereira, 2016). However, this is the design and implementation channels for difficult to maintain, particularly given that public policy ignore (most often deliberately) the use of evidence is not an established the production of social knowledge practice in Bolivia and that the flow of (PIEB,2015) – the PIEB decided to dedicate information between actors is often a large part of their institutional efforts and restricted, especially from government capacity toward operating as an interface sources (Peres, 2012). Nonetheless, as the between the two. The numerous tools findings in Figure 24 show, government and strategies that were employed for this entities acknowledge the usefulness of social purpose could be replicated in the current science in the design and implementation context. These include sharing research results of public policies – which bodes well for the future. and proposals in workshops, identifying the research needs of public entities “I believe that Bolivia requires very important and supporting the planning of research and structural support to conduct research. processes. They also involve providing Aside from the State, the support must researchers with an insight into how public not necessarily come from international policymaking processes operate, the cooperation, but from civil society. I believe regulations governing public administration, that, in order for this relationship between and how to prepare project proposals – so academia and public policymakers to exist that their research is produced/disseminated and be renewed, the State has to invest in in a way that is more suited to the needs of research; and not only invest but create policymakers (PIEB, 2015). facilities for research, create more institutes, give room for the expansion of knowledge; The use of research for better policies and not only fund research, but also use it.” Influence of research on policy outcomes (R. León, 2019)

Figure 24 – Administrators: Perceived Influence of their Institutions on Policies, per Type of Institution (Percentage)

100% 100%

85% 82% 80% 80% No Yes 60%

40%

20% 20% 18% 15%

0% Higher Education Private Sector + Government and All Institutions Civil Society Funding Agencies N for High Education = 11; N for Private Sector and Civil Society = 20; N for Government and Funding Agencies: 8; N for Bolivia = 39

Source: CERES, 2019

Doing Research in BOLIVIA 81 Figure 25 – Policymakers: Perception of The Usefulness of Social Science Research

We've had in fluence in policies 13

It is with in the functions of my institution 8

We have made some contributions 4

We can contribute to policymaking with... 3

No reply 3

We've worked with communities 1

We generate research oriented towards... 1

It is a potential function of universities 1

Source: CERES, 2019

The importance of research for improving Nonetheless, reforms by the Morales’ public policy is undeniable. However, the government have allowed communities common perception is that social science to put forward their own bill proposals, as research is used to further the interests of well as enabled the wider participation of the government party and to validate their different sectors of society (including private public policies. The current government’s research institutions and NGOs) – although, policymaking processes and development as yet, there has been no consolidated model is based on its own research agenda. effort to encourage more collaborative Respondents from government agencies participation in policy design processes. As confirm that most of the research used PIEB previously stipulated in their Research to inform policymaking is developed and conducted within their own institutions Management Model (2015), it is essential that (Figure 25). This reaffirms the State’s public policymaking is not exclusive to the ‘impermeability’ to wider research as a source State, but involves and relates to different of evidence and enrichment for public policy actors in society. The findings from the DRA (PIEB, 2015). Government entities, however, illustrate that the use of research results can argue that the source of research is irrelevant, have an influence on policymaking, but it as long as it is based on evidence: is often unclear which types of approach and the channels they can use to influence “Any research that serves as input for the definition of public policies is very important, policymaking more effectively. Some of the regardless of whether it comes from respondents noted that regional government institutions in the public or private sector; if it entities/local authorities are more accessible is based on evidence, logically, it constitutes and can therefore act as an intermediary an important input for the definition of between national entities and non- public policies.” (UDAPE,2019) governmental actors.

82 Doing Research in BOLIVIA DRA Framework highlights Table 21 - DRA Framework Highlights

Research Production Diffusion Uptake System Functions Research Although the production The dissemination of There are opposing system of research has increased, research is one of the views on how research is processes it still suffers serious weakest aspects of the used. While government deficiencies in terms Bolivian research system. agencies assert that it of quality, norms and is common practice to organization. In the formulate public policies absence of a law or based on scientific agency responsible for evidence, NGOs, civil coordinating research society and the private activities, they remain sector were unaware isolated and limited of this work or simply due to budgetary and discredited it. political constraints. Inputs 1.1 Research inputs 2.1 Actors & Networks 3.1 Policy-friendly • Relevant research • Attempts at regional Research is produced in decentralization of • There is considerable different areas such the production of independence for as indigenous and scientific knowledge researchers since they territorial issues; are incipient. can generate data free rural-productive • The linkages of political pressures. development; gender; between categories However, this has led to poverty and inequality; of actors are weak. a level of indifference the design of regional Researchers work toward academia public policies, among more with non-profit rather than a policy of others. organizations and promoting independent • Respondents reported national universities knowledge production. moderate satisfaction than with government • The structure of the with respect to access and international research system does not to infrastructure and organizations. encourage joint efforts research equipment. • Access to policy between academia and • Specific resources such discussions for government agencies; as software for research community a situation that is clearly and data analysis are associations is limited, reflected in the lack or absence of interaction lacking. despite the emergence between research actors of new civil society • There are a limited on specific topics. number of full-time actors: collective action researchers. groups and social movements.

Doing Research in BOLIVIA 83 Research Production Diffusion Uptake System Functions • Regardless of the • Budget planning and • There is little demand material limitations the type of financing from the private sector and lack of determine whether the for research on topics of incentivizing results of an investigation interest to policymakers, policies for are made public. limited participation in scientific • Networks (largely informal) policy formulation, and only production, of institutions of a similar occasional interaction with actors from the public sector. research is nature or shared interests being carried are the best spaces for • Administrators and out in history, presenting results and researchers from a variety of anthropology, receiving feedback. public and private institutions sociology and lament the lack of state political science; funding. however, • There is little incentive for production is researchers to participate not supported in the design of public or sought policies, an issue reflected out by public in their lack of participation policymakers. in government institutions responsible for policy design. Activities 1.2 Research 2.2 Research 3.2 Research-based Culture and communication practices policymaking Support services • The limited participation • In many cases, political • Despite of researchers in interests prevail over interviewees international research evidence-based research. from government projects, has resulted in • The perception among agencies claim the the loss of presence and researchers is that policies opposite, there influence of Bolivia in the are not necessarily linked is no national field of social sciences. to an analysis of research research policy • Half of the researchers results. for social sciences report they are not • A large majority of in place nor a affiliated with any researchers claim that they national body that international network of have not participated in the articulates research researchers or registered development of policy. activities in Bolivia. in an international • There is no peer- repository. A similar review culture. As scenario was identified a result, research at an institutional level: production in few inter-institutional Bolivia lacks agreements with parameters to universities and institutes measure quality. abroad were identified.

84 Doing Research in BOLIVIA Research Production Diffusion Uptake System Functions Outputs 1.3 Research Output 2.3 Research 3.3 Research-based &Training Communication Products policy tools • There has been a • The written publication • Some researchers quantitative increase of research production (from public in production (reports, continues to be the universities in documents, studies or priority for most Cochabamba, civil assessments) but with institutions, while society institutions varying degrees of debates, workshops and or government quality. conferences are rare. agencies in La Paz) • The publication of • There is a fixation stated that they have, articles in indexed with doing things in a in fact, been part journals is limited. more traditional way; of the formulation of laws, strategies • In contrast to public reflected, for example, and programs – in universities, private and in the limited number of collaboration with civil society institutions research institutions that municipal authorities have little or no have active, up-to-date and/or higher-level continuous research websites. authorities. capacity development. Outcomes 1.4 Opportunities & 2.4 Popularization of 3.4 Research for Sustainability Science Better policies • There is a lack • There has been a clear • Administrators have of substantial public policy for the a positive perception opportunities for Social recovery of the ancestral of their influence on Science researchers in knowledge of the public policies. Bolivia. indigenous peoples of • The interviews • Notoriety and social Bolivia. However, due highlighted the lack recognition appear to excessive ideologization of evidence-based be the main motivation and political research (particularly for researchers from confrontation, it has non-government universities, civil become a mechanism research) in the society and the private for discrediting scientific formulation and sector. In contrast, processes of knowledge execution of public financial incentives are construction. policies. more important for • Researchers identified the government actors and Internet and social media financing agencies. as the most popular • Only researchers in spaces for research state institutions have a dissemination – as reasonable level of job opposed to newspaper, security. television and radio coverage, which were rated as unsatisfactory.

Source: CERES, 2019

Doing Research in BOLIVIA 85 Ethical Considerations work at all levels. Private universities, such as Universidad Católica Boliviana, rely on There is no national committee/commission the Regional Research Coordination Unit to for research ethics to validate social science articulate research activities and to monitor research activities in Bolivia. All approval the research processes supported by the processes for research findings are carried Regional Strategic Research Plan – prepared out at an institutional level. Each individual under the supervision of the Regional entity implements its own set of ethical Research Council (UCB, 2020). guidelines, whether this is for basic, applied or commissioned research. Current codes It is important to note that current codes of of ethics are not specific to research. They ethics and guidelines do not have a judicial promote an ethical culture based on respect, function or the power to impose sanctions compliance and transparency, and seek to or grant approval for research projects. Under regulate the behavior of members of both this self-regulation model, the provisions public and private institutions. While they do stipulate areas that researchers should take not serve the same function as legislation, into consideration to ensure that research they must be consistent with current legal is responsible, both in terms of the use of regulations. data and the relationship with research subjects, as well as the interaction with other Public entities such as government ministries researchers. (Ministry of Development Planning,19 Ministry of Labor, Employment and Social Most guidelines for local research projects Security20), the Federation of Press Workers, are based on globally recognized norms for the Central Bank of Bolivia,21 and other actors research ethics (NESH, 2016): we interacted with throughout the course 1) norms that constitute good scientific of this project, operate under approved practice, related to the quest for accurate, codes of professional ethics, which serve adequate and relevant knowledge an advisory, guiding and preventative (academic freedom, trustworthiness, etc.) function. Universities, on the other hand, 2) norms that regulate the research have a statutory responsibility for ensuring community (impartiality, peer-review, etc.) that research, education and academic development are of high quality and 3) the relationship to people who take part conducted in accordance with recognized in the research (anonymity, free and scientific, pedagogical and ethical principles. informed consent, etc.) Their guidelines for research ethics mainly 4) the relationship to the rest of society cover research, but they also deal with (independence, conflicts of interest, social other research-related activities such as responsibility, dissemination of research, teaching, dissemination of research results, etc.) and the production of student’s academic Nevertheless, there are obvious ethical concerns relating to the link between research and politics. The problem lies not 19 http://www.planificacion.gob.bo/uploads/administrativa/ in the design of public policies, but in the reglamentos/CODIGO-DE-ETICA.pdf nature of political debate in general. Research 20 http://190.129.70.147/Descargas/Transparencia/Codigo_ has a social responsibility to provide critical de_Etica_MTEPS.pdf 21 https://www.bcb.gob.bo/webdocs/normativa/ analysis and alternative choices of action, resoluciones/2001/090.01.PDF and/or evidence-based knowledge to the

86 Doing Research in BOLIVIA public discourse (NESH, 2016). As such, the cases, the most widespread criticism has most serious problem seems to lay in the been directed toward those who carry out idea that the social sciences, due to their rigorous evidence-based research – often ‘social’ nature, must be committed to a labeled as ‘empiricists’ and ‘unscientific’ particular political project. Public universities (Laserna, 2020). and some international organizations, Furthermore, certain components of research such as CLACSO, have promoted the idea functions may not necessarily follow strict that social sciences and social researchers norms. Peer-review practices, for example, should direct their work toward meeting are uncommon in academia. When there are social transformation and nation-building evaluations, these are often associated with objectives. Although this may not raise projects with international funding, and they any ethical concerns, in practice it usually focus primarily on the fulfillment of goals leads to the formulation of methods, tools and objectives rather than procedural ethics and conclusions that pre-select theoretical (Laserna, 2020). perspectives, hypotheses, methods and even data (Laserna, 2020). Researchers must In some cases (such as for this particular be able to justify their choice of questions, research project), researchers seek to methods and analytical perspectives, as well validate their research through discussions as the quality of the documentation used to and sharing findings among third-parties: support conclusions, so that preconceived other researchers, research administrators, notions and opinions have minimal influence policymakers and, sometimes, research on the research (NESH, 2016). In this sense, participants. Openness and wider the methodological requirements established engagement/participation are often integral by the research community with regards parts of research processes. Different academic to argumentation or documentation may approaches and positions allow for varied, serve as a model for other segments of but nonetheless reasonable, interpretations of society for how to deal with disagreement research outputs, thus, ensuring consistency or bias (NESH, 2016). However, a significant and impartiality in argumentation, while amount of research with a ‘social and political still maintaining the independence of the commitment’ in Bolivia lacks empirical institution when reporting results and support or is heavily biased in tone. In some conclusions (NESH, 2016).

Doing Research in BOLIVIA 87 debate on the production and use of social CONCLUSIONS science research for the good of society.

Highlights It is evident that support for scientific • The findings from the data collected research in Bolivia has decreased in recent during 2019 for the Doing Research years. The support that has been provided Assessment are intended to contribute through the redistribution of revenues to a national debate on social science from the tax on hydrocarbons (IDH), in the research and the benefits it can bring to case of public universities, and financing society. assigned to research within different civil • Support for scientific research in Bolivia has society institutions, has not been sufficient decreased in recent years. Furthermore, to strengthen scientific research in the the resources provided through the various fields related to the social sciences. redistribution of revenue from the tax on Furthermore, social science researchers hydrocarbons (IDH) in the case of public do not engage in areas prioritized universities, and financing assigned to research within different civil society by policymakers, nor are they part of institutions, have not been sufficient interdisciplinary teams that may contribute to to strengthen scientific research in the policy development. various fields related to the social sciences. Nevertheless, it is important to note that over • A national research coordinating body for the past decade, there has been a significant the social sciences in Bolivia is required in increase in the number of people devoted order to consolidate a sustainable research system. to research, particularly in universities, as well as the number of scholars with PhDs. In • Some research centers are part of regional networks such as the Latin American contrast, there has been a reduction in the Council of Social Sciences (CLACSO); number and size of private research centers, however initiatives of this nature need to NGOs and government-funded regional be more efficiently consolidated in order research institutes. And, although research to stimulate the action for change that the production has undergone a quantitative national context requires. increase, this and other research system • Based on an interpretation of the functions such as diffusion and uptake still collected data, and learning from the DRA suffer serious deficiencies in terms of quality, implementation, it is clear that challenges norms and organization. and opportunities differ across the range of components and actors. There are some research centers that are • Multiple approaches are needed to part of regional networks such as the exert leverage and encourage the use of Latin American Council of Social Sciences effective practices throughout the system. (CLACSO), but initiatives of this nature need to be more efficiently consolidated in order to stimulate the action for change that the This assessment analyses the research national context requires. system in Bolivia based on the methodology developed under the Doing Research To address these deficiencies and ensure the Program, an initiative of the Global sustainability of the research system, many Development Network (GDN). The results stakeholders identified the need to establish obtained from the data collected during a national coordinating body for social 2019 are intended to contribute to a national science research in Bolivia. In the absence

88 Doing Research in BOLIVIA of a law or agency responsible for these gain a better understanding of the context activities, the different actors will continue to for the production, diffusion and use of social carry out their activities in isolation and suffer research across different actors. There are a from the limitations imposed by budgetary number of fundamental elements that need and political constraints. to be considered when identifying effective pathways for action. As part of this collaborative framework, it is important to acknowledge the heterogeneity Balance Reinstate a balance of institutions in among actors. As such, priorities and decision-making processes and build broad incentives will differ, along with the needs for capacity for the development of the social quality data to guide the variety of types of sciences in Bolivia. research required. Standards Develop an enabling environment for research by creating norms One of the main findings of this assessment is and standards for research practices that the lack of collaboration and inter-institutional adapt to the different social paradigms in the commitment, which inhibits the production country. of more relevant research. While the majority Training Enhance higher education of actors agree that regulatory policy is an programs – with more focus on rigorous essential component of the institutional research training – to develop a critical architecture of the country, it is evident mass of creative and productive research that institutions in Bolivia face enormous professionals with a greater awareness of the difficulties in developing an efficient and country’s social and cultural diversity. well-articulated research system given the legal restrictions on their operations – Metrics Adopt a broad range of criteria particularly the law on legal status which in research assessments. Performance limits the capacity of NGOs to operate freely, metrics should take many dimensions into independently and effectively. Based on account and must have clearly defined and our analysis, one of the recommendations effective parameters/standards based on the for the short term is to promote the use of experiences of local scientific social science locally-grounded social science research research. as a key input to sustainable development Research culture Adopt research planning by supporting the establishment competencies as part of comprehensive of a regulatory framework for civil society human capacity training (including in non- organizations, free of excessive regulation and academic institutions) in collaborative appropriate to the local context. educational settings and articulated within the social, economic, political and cultural The institutional strengthening of the social context. science research ecosystem will be critical for promoting the long-term development Capacity Develop capacities through of the Bolivian research system. The need mentoring and training to strengthen for a common agenda is a must, as well research in social sciences at the individual as consolidating strategic partnerships/ and institutional level. coalitions to influence policymaking. Uptake Create demand from decision- makers for quality outputs to inform the Recommendations design of more efficient policies. This assessment of the state of the social Develop a trans-disciplinary research science system in Bolivia was carried out to community to share knowledge and data

Doing Research in BOLIVIA 89 as part of broader efforts towards national the interaction of social networks, public development. and private actors and international organizations, and help to consolidate It is essential to identify key levers for change spaces for debate. that can advance future debate on the culture of research and policymaking, while b) Establish objective criteria for public policy recognizing the complex and multilevel management so that policy managers and nature of the environment in which such operators can resolve priority topics. levers operate. Based on an interpretation of c) Address the lack of institutional the collected data and learning from the DRA coordination between the economic, implementation, it is evident that challenges social, political and environmental sectors and opportunities manifest differently – to ensure the long-term sustainability of across the range of components and actors. development efforts in Bolivia. Consequently, multiple approaches are This implies building an institutional needed to exert leverage and encourage the consensus around the social sciences that use of well-developed practices throughout includes all stakeholders in the Bolivian the system. research system. This requires an inter- Major structural constraints identified institutional body to coordinate between through this study must be addressed. universities, the public sector, the private Hence, the following LEVERS OF CHANGE sector and social actors through councils are considered a priority when defining of local and regional representatives that upcoming reforms. define local research needs and actions in line with priorities under the Sustainable Knowledge transfer Development Goals. The current silo-based production, budgeting Previous initiatives in Bolivia demonstrate and management structures among the willingness of different actors to engage research entities make it difficult to promote in networks. During the 1980s and 1990s, an effective transfer of knowledge from a series of departmental networks were researchers to policymakers – hindering the created in different cities grouped under a contribution of research to policy debates. coordinating body, the National Network Data are being generated in partial isolation, Coordinator. This entity was an initiative of which means that the different actors have the Private Social Development Institutions little understanding of what other institutions (IPDS). Similarly, between 1994 and 2014, the and individuals are doing. Fundación para la Investigación Estratégica In this context, the social sciences in Bolivia en Bolivia (PIEB) supported the development must assume responsibility for sustainable and consolidation of thematic regional and development by promoting a new way of national networks of researchers – providing visualizing and contextualizing the major issues financing and advice, and promoting in the country – taking into consideration the the sharing of accumulated experience need to: in research, training and dissemination. These groups, primarily made up of young a) Re-conceptualize public policies in researchers, became points of reference for relation to health, education, housing, research activity in different regions. employment and leisure to account for the realities in different contexts (local, Based on the experience of these initiatives regional and national). This will strengthen and the findings from this study, a structure

90 Doing Research in BOLIVIA similar to the one used within the PIEB model Health, Education and Sports and Pillar 4: could be implemented to manage and/ Scientific and Technological Sovereignty or strengthen new associations between are particularly relevant to this assessment. different entities that would, ultimately, lead However, research centers, universities and to the institutionalization of social science the private sector had limited involvement research. This process will contribute to in developing these goals. This limits access the growing recognition of the importance to public financing for research, since, in of research in supporting socioeconomic addition to complying with established development – further justifying the need for requirements, researchers need to ensure an autonomous national coordinating body. that all projects are framed within the National Development Plan and priorities of A framework of research focal points could the national agenda. be established to represent and articulate the interests of affiliated institutions, and Establishing a national coordination body promote the generation and timely transfer with a particular role in representing the of interdisciplinary social science knowledge. range of actors and developing a process It would also support the development of that allows recommendations and/or lobbying spaces, the articulation of political proposals for action, would allow different demands (bill proposals, approval of laws) actors to contribute to the development of and greater cooperation with the State, as these goals. A national coordinating body well as training for affiliated members. that can work through regional units will be able to channel priorities and promote efforts Effective governance to secure funding. As highlighted during this study, the Bolivian Access to data It is essential to develop Government must also invest in long-term viable systems for the regular collection of research development plans that are not data and information to support research subject to change as a result of the transition and policy formulation. Such policies should from one political party to another. include institutions in charge of generating A more open and transparent political nationwide databases, such as the National system, with the ongoing renewal and Institute of Statistics (INE), in cooperation professionalization of politicians and greater with all government entities at municipal and government responsiveness, will offer levers departmental levels. of change that can create a demand for Reducing and simplifying bureaucratic research and connect social researchers with procedures This is crucial for facilitating decision-makers and policy designers. more efficient interactions and consolidating mechanisms for policy influence. There are three potential pathways for action under this specific recommendation: The findings from this study illustrate the Financing The social science research bureaucratic difficulties that restrict the environment is resource-constrained. operations of non-profit organizations, Financing is therefore a key lever. As specifically with regard to the registration previously mentioned, Bolivia has a Plan of legal status or the renewal of NGO for Economic and Social Development in registrations, which are processed through place to manage the allocation of resources. national public institutions. The plan consists of thirteen fundamental The first version of a law for the Recognition pillars for development, of which Pillar 3: of Legal Entity Status of Associations and

Doing Research in BOLIVIA 91 Foundations is currently under development. reduction in bureaucracy, but would also This law seeks to generate a clear legal help to minimize the restrictions imposed framework that sets out the rights and by the current regulations, particularly in obligations of NGOs. To this end, meetings terms of accessing the resources required to were held to discuss the conditions operate effectively. conducive to the effective functioning of civil society organizations in Bolivia. This brought Capacity-Building together different social organizations, Establishing comprehensive incentives institutions, and national and international through ongoing, relevant training can NGOs, as well as institutional networks and address the lack of adequate administrative platforms, to debate a new regulatory, legal support and the limited opportunities for and tax framework that recognizes and continuous capacity development and career oversees their activities. advancement. This involves: Spaces for dialogue have been set up with • Developing capacity-building programs public entities such as the National Tax for researchers in the social sciences, Service, the Vice Ministry of Public Investment through sponsorship or the allocation of and External Financing and the former funds from individual institutions. Ministry of Autonomy (currently the Vice • Establishing or reinforcing networks Ministry of Autonomy) to continue identifying to ensure close cooperation between solutions to the problems faced by NGOs in universities, governments, research Bolivia. As part of this new law proposal, it institutes and other relevant stakeholders. was agreed that the following elements are • Seeking funds and/or subsidies to support essential: respect for freedom of association; development programs to strengthen and the need to strengthen the role that social science research capacity in civil these institutions play in development. These society organizations and universities. observations will be compiled and later • Prioritizing the development of skills presented to the Executive and Legislative in writing research proposals, research bodies for consideration. design, data processing and disseminating In this context, the results obtained in this research. initial assessment could contribute evidence on the limitations of the current research Monitoring research activity system. The short-term objective would be Rigorous institutional and policy frameworks to support the establishment of a regulatory that clearly establish the rules of the game are framework for civil society organizations, free essential to support the operationalization from excessive regulation and appropriate of an effective research system and ensure to the local context. This administrative accountability/transparency in research simplification would allow not only a activities at country level.

92 Doing Research in BOLIVIA REFERENCES America;an insider’s perspective" CIS, 2020. https://www.cis.gob.bo/ Context Analysis CLACSO, 2019. Annual report Altman, David. 2012. "Where is knowledge generated? On the productivity and impact of GDN. 2017. Doing Research Assessment. Guide political science departments in Latin America." for Implementation European Political Science 11 (1): 71-87. Gibbons, Michael. 1994. The new production Ardaya, Gloria. 2008. "Cambios y of knowledge: The dynamics of science and fortalecimiento institucionales en los centros research in contemporary societies. Sage. de investigacion bolivianos". Centro Edelstein. Hernández Asensio, Raúl. 2013. ¿ Quién 2008. Río de Janeiro, Brasil. escribe más y sobre qué?: cambios recientes Arnold-Cathalifaud, Marcelo. 2011. "Las en la geopolítica de la producción científica ciencias sociales latinoamericas, sus en América Latina y el Caribe. IEP, Grupo Faro. condiciones y desafíos ante la sociedad del Landry, Réjean, Nabil Amara, and Moktar siglo veintiuno." Revista Sinais-ISSN: 1981-3988 Lamari. 2001. "Climbing the ladder of 1 (09). research utilization: Evidence from social Balarin, María, Fernando Masi, Ignacio science research." Science Communication 22 González, Belén Servín, Miguel Vera, and (4): 396-422. Natalia Peres. 2015. "La producción de Laserna, Roberto.2004. "La democracia en el investigación en ciencias sociales en tres Ch´enko." Ed. Milenio países de ingresos medios y bajos de América del Sur: los casos de Bolivia, Paraguay y Perú." Laserna Roberto, José Gordillo and Jorge Komadina, "La Trampa del Rentismo." Ed Brunner, José Joaquín, and Guillermo Sunkel. Milenio 1993. Conocimiento, sociedad y política. FLACSO, Santiago, CL. Masi, Fernando, Ignacio González, and Belén Servín. 2016. "Haciendo investigación en Buquet, Daniel. 2013. "Producción e impacto ciencias sociales en Paraguay." de las ciencias sociales en América Latina." Documento de Trabajo. Ministerio, de Educación. 2011. Redes Nacionales de Investigación Científica y Camacho Salinas, Roberto, Miriam Villegas, Tecnológica. and Christian Mendizábal. 2015. "Bolivia entre la realidad económica y la utopía ---. 2018. Redes Nacionales de Investigación académica." Revista Cubana de Educación Científica y Tecnológica - Memoria 2012 - Superior 34: 81-106. http://scielo.sld.cu/ 2017. scielo.php?script=sci_arttext&pid=S0257- Navarrete, Julio Mejía. 2015. "La investigación 43142015000100006&nrm=iso. social en América Latina. Posibilidades Carden, Fred. 2009. Knowledge to policy: metodológicas." Revista Latinoamericana de making the most of development research. metodologia de las Ciencias Sociales 5 (1). Sage/IDRC Navarrete, Julio Víctor Mejía. 2009. Sociedad Ciocca, Daniel and Gabriela Delagado, y conocimiento: los desafíos de la sociología 2017."The reality of scientific research in Latin latinoamericana. Fondo Editorial de la

Doing Research in BOLIVIA 93 Facultad de Ciencias Sociales, Universidad Schwartzman, Simon. 2008. "University and Nacional …. development in Latin America." Rotterdam: Sense. OECD, 2009. " Overcoming Barriers to Administrative Simplification Strategies: Tórrez, Yuri F. 2013. "Una mirada a los estudios Guidance for Policy Makers" del PIEB Jóvenes: sujetos y objetos de investigación." Tinkazos 16 (33): 113-128. Orduna, Víctor. 2014. "PIEB 1994-2014: Dos décadas de aportes e incidencia UNESCO, 2010. "Informe sobre las ciencias de la investigación." Tinkazos 17: 133- sociales en el mundo. Las brechas del 156. http://www.scielo.org.bo/scielo. conocimiento." París. php?script=sci_arttext&pid=S1990- Vaccarezza, Leonardo Silvio. 2009. "Las 74512014000200010&nrm=iso. relaciones de utilidad en la investigación Pablo Pinilla, Juan. 2012. "Think Tanks, saber social." Revista mexicana de sociología 71 experto y formación de agenda política en el (SPE): 133-166. Chile actual." Polis (Santiago) 11 (32): 119-140. Valenti Nigrini, Giovanna, and Ulises Flores Pereira, Blithz y Lozada. 2016. Políticas Llanos. 2009. "Ciencias sociales y políticas científicas, tecnológicas y de innovación públicas." Revista mexicana de sociología 71 en Bolivia. La Paz: Instituto de Estudios (SPE): 167-191. Bolivianos. World Bank. Country profile in: Peres, Natalia. 2012. Rol de la evidencia en http://databank.worldbank.org/data/views/ el proceso de políticas públicas: El caso reports/reportwidget.aspx?Report_Name= boliviano. Fundación ARU. CountryProfile&Id=b450fd57&tbar= y&dd=y&inf=n&zm=n&country=BOL Piovani, Juan Ignacio. 2011. "La Metodología de las Ciencias Sociales como campo de Zurita, Mgr Gunnar Zapata. 2012. interés intelectual en América Latina." Revista "Importancia y Situación Investigación latinoamericana de metodología de las Científica y Tecnológica en Bolivia: Desde una Sobreabundancia Normativa hacia una ciencias sociales 1 (1): 1-7. Pobreza Productiva." La Paz. RICYT, 2019. "EL ESTADO DE LA CIENCIA. Principales Indicadores de Ciencia y Tecnología Iberoamericanos / Stakeholder Mapping Interamericanos" (UDAPE), Unidad de Análisis de Políticas Sandoval, Godofredo, Carlos Toranzo, Mario Sociales y Económicas. 2017. Organigrama Yapu, O. Franco, Mabel, and Virginia Aillón. Institucional. http://www.udape.gob.bo/ 2015. "Modelo de gestión de investigación index.php?option=com_content&view=arti- estratégica en Bolivia." La Paz, Bolivia: cle&id=128&Itemid=122#ORGANIGRAMA. Fundación PIEB. Schilirò, Daniele. 2012. "KNOWLEDGE-BASED ---. 2018. Personal dependiente y consul- ECONOMIES AND THE INSTITUTIONAL tores. http://www.udape.gob.bo/index. ENVIRONMENT." Theoretical & Practical php?option=com_content&view=arti- Research in Economic Fields (De Gruyter cle&id=128&Itemid=122#RECURSOS_HU- Open) 3 (1). MANOS_.

94 Doing Research in BOLIVIA Aguilar Villanueva, Luis F. 2012. "Política Devisscher, Marc. 2013. "Las Oenegedes Pública, una visión panorámica." Observatorio en Tiempos del Vivir Bien: El Caso Bolivia." de Políticas Públicas del Proyecto de Forta- Producido por la ONG alemana Pan Para el lecimiento Democrático del PNUD Bolivia, Mundo y el Centro de Estudios y Proyectos, Embajada de Suecia. Primera Edición, La Paz. La Paz, Bolivia. Versión digital. Díaz, Percy Alberto Bobadilla, and Engelbert Azcona, Maximiliano, Fernando A Manzini, Barreto Huamán. 2000. "Las ONGs y el Estado and Javier Dorati. 2013. "Precisiones met- en torno a las políticas sociales." Revista de odológicas sobre la unidad de análisis y la ciencias sociales 6 (3): 437-461. unidad de observación." IV Congreso Inter- nacional de Investigación de la Facultad de Diaz, Neus. 2009. "Técnicas de muestreo." Psicología de la Universidad Nacional de La Sesgos más frecuentes. Plata (La Plata, Argentina, 2013). Erostegui, Susana. 29 de noviembre de Balarin, María, Fernando Masi, Ignacio 2014. "¿Por qué los gobiernos le temen a las González, Belén Servín, Miguel Vera, and ONG? Reconfiguración de la relación Estado Natalia Peres. 2015. "La producción de inves- – Sociedad Civil." Mesa de Articulación de tigación en ciencias sociales en tres países de Asociaciones Nacionales y Redes de ONGs ingresos medios y bajos de América del Sur: de América Latina y el Caribe http://me- los casos de Bolivia, Paraguay y Perú." sadearticulacion.org/. Baptista, Rosario. "Instituto de Servicios Legal- Escalera, Saul J. 2008. "INTERACCION UNIVER- es e Investigación Jurídica (ISLI)." Legislación SIDAD-GOBIERNO-EMPRESA: UN COMPRO- Vigente para ONG’s en Bolivia. MISO DE PRIORIDAD NACIONAL." Congresso Institucional de UMSS, 2ª. Cochabamba: Belmonte, Alejandro. 2015. "El rol de la Uni- UMSS. versidad en la evaluación de políticas públi- cas. El caso del Área de Políticas Públicas de Espinoza, Ronald, Santiago Cisneros, and Se- la Universidad Nacional de Cuyo, Argentina." lestina Duran. 2014. "Participación ciudadana IV CONFERENCIA INTERNACIONAL ReLAC, “El en la formulación y gestión de las políticas Futuro de la Evaluación en América Latina públicas-caso práctico: municipio de Sucre." y el Caribe. Desarrollo, Equidad y Cultura”, Ciencias Economicas, Administrativas y Finan- Lima. cieras TI. Bolivia, Jica Japan Desk. 2007. Directorio de Exeni, José Luis. 2010. "Mediocracia de alta in- ONG que trabajan en Bolivia. La Paz: NGO tensidad. Bolivia: Medios de comunicación y JICA Japan Desk Bolivia. democracia en contextos de cambio." La Paz: Instituto Internacional para la Democracia y la Cubillos, Monica Castillo. 2017. "El papel de Asistencia Electoral (IDEA). la participación ciudadana en las políticas públicas urbanas, bajo el actual escenario de Freiherr von Freyberg, Daniel. 2011. "Las ONG la gobernanza." Revista CS (23): 157-180. bolivianas:: análisis de su evolución y dimen- sión financiera." Tinkazos 14 (30): 79-1004. Derpic, Espejo, Loayza Ortuño, and Seleme Navia. 2008. Configuraciones políticas en los Gubernamentales, Coordinadora de Orga- departamentos de Bolivia. PNUD - IDEA Inter- nizaciones No. 2012. Competencia y Marco nacional, La Paz. Legal para ONG.

Doing Research in BOLIVIA 95 Las ONG en Bolivia exigen respeto al derecho Ministerio, de Desarrollo Rural y Tierras. 2015. a la asociación y piden regulación precisa. Estructura organizacional del Ministerio de (26 de febrero de 2019). Agencia de Noticias Desarrollo Rural y Tierras. http://www.rura- Fides. Retrieved from https://www.paginasie- lytierras.gob.bo/. te.bo/ ---. 2018b. Nómina de personal de planta. Luna Tamayo, Milton. 2013. "Participación http://www.ruralytierras.gob.bo/. ciudadana, políticas públicas y educación." América Latina y Ecuador, Organización de Ministerio, de Economía y Finanzas Públicas. Estados Iberoamericanos, Quito. 2017b. Organigrama Institucional del Ministe- rio de Economía y Finanzas Públicas. Malhotra, Naresh K. 2004. Investigación de mercados: un enfoque aplicado. Pearson https://www.economiayfinanzas.gob.bo/. educación. ---. 2018c. Listado de Servidoras y Servidores Martínez, María Teresa Villarreal. 2009. "Par- Públicos del Ministerio de Economía y Finan- ticipación ciudadana y políticas públicas." zas Públicas https://www.economiayfinanzas. Décimo certamen de ensayo político: 31-48. gob.bo/. Menardi, Mauricio Andrés, Claudio Alberto Ministerio, de Educación. 2009. Potencial Tecco, and Silvana Raquel López. 2016. "El rol científico y tecnológico Boliviano. de las universidades en la generación de ca- pacidades territoriales para la innovación y el ---. 2011. Potencial científico y tecnológico desarrollo." Administración Pública y Sociedad Boliviano. www.minedu.gob.bo/micrositios/ (APyS) (1): 73-84. biblioteca/disco-3/cienciatecnologia.html. Mendizabal, Enrique, Kristen Sample, and ---. 2011. Redes Nacionales de Investigación Adolfo Garcé. 2009. Dime a quién eschuchas-: Científica y Tecnológica. www.minedu.gob. think tanks y partidos políticos en América bo/micrositios/biblioteca/disco-3/cienciatec- Latina. IDEA Internacional. nologia.html. Milenio, Fundación. 2018. "Informe Nacional ---. 2013. Plan nacional de Ciencia, Tecnología de Coyuntura." Protección social y políticas e innovación. www.minedu.gob.bo/micro- públicas en Bolivia (380): 2. sitios/biblioteca/disco-3/cienciatecnologia. Ministerio, de Desarrollo Productivo y html. Economía Plural. 2016. Organigrama Ministerio ---. 2018. Redes Nacionales de Investigación de Desarrollo Productivo y Economía Plural. Científica y Tecnológica - Memoria 2012 - http://produccion.gob.bo/institucion/organi- 2017. www.minedu.gob.bo/micrositios/biblio- grama-de-la-institucion/. teca/disco-3/cienciatecnologia.html. ---. 2017a. Nómina de autoridades. http://pro- Ministerio, de Medio Ambiente y Agua. 2017c. duccion.gob.bo/transparencia/recursos-hu- Organigrama Ministerio de Medio Ambiente manos/nomina-de-autoridades/. y Agua. ---. 2018a. Nómina de personal dependiente. http://www.mmaya.gob.bo/index.php/infor- http://produccion.gob.bo/transparencia/re- macion_institucional/ORGANIGRAMA,843. cursos-humanos/personal-dependiente/. html.

96 Doing Research in BOLIVIA ---. 2019a. Nómina de autoridades. https://www.mintrabajo.gob.bo. http://www.mmaya.gob.bo/index.php/infor- ---. 2019. Personal Dependiente. macion_institucional/NOMINA-DE-AUTORI- DADES,838.html. https://www.mintrabajo.gob.bo/index.php/ transparencia/personal-dependiente.html. ---. 2019b. Nómina de personal dependiente. Moncada, A. 2013. "Think tanks in Bolivia: an http://www.mmaya.gob.bo/index.php/infor- analysis." macion_institucional/NOMINA-DE-PERSON- AL-DEPENDIENTE,839.html. https://onthinktanks.org/articles/think-tanks- in-bolivia-an-analysis/ Ministerio de Obras Públicas, Servicios y Vivi- enda. 2016. Organigrama Ministerio de Obras Orlansky, Dora. 2007. "Investigación social y Públicas, Servicios y Vivienda. políticas públicas." Sociedad 26: 85-101. Peralta Miranda, Pablo. 20 de agosto de 2015. https://www.oopp.gob.bo/index.php/infor- Las ONG en la Bolivia de hoy, ¿indispensables macion_institucional/ORGANIGRAMA,843. o innecesarias? Página Siete. html. ---. 25 de septiembre de 2017. Las ONG ---. 2018a. Nómina de autoridades. tienen buena relación con distintos niveles https://www.oopp.gob.bo/index.php/infor- del Estado. Página Siete. macion_institucional/NOMINA-DE-AUTORI- Pérez López, César. 2005. Muestreo esta- DADES,838.html. distico. Conceptos y problemas resueltos. ---. 2018b. Nómina de personal dependiente. Universidad Complutense de Madrid, Madrid (España). https://www.oopp.gob.bo/index.php/infor- macion_institucional/NOMINA-DE-PERSON- Pérez, Mamerto. 2017. Sistematización de AL-DEPENDIENTE,839.html. Políticas Públicas en Bolivia relativas al Desar- rollo Rural. Centro de Investigación y Promo- Ministerio, de Planificación del Desarrollo. ción del Campesinado (CIPCA). 2018d. Nómina de autoridades. Revilla, Marisa. 2002. "Zona peatonal. Las ONG http://www.planificacion.gob.bo/con- como mecanismos de participación política." tent/1461. Las ONG y la política: 15-65. ---. 2018e. Nómina de personal. Rosso, Humberto Morales. 2013. Introducción http://www.planificacion.gob.bo/con- a las Políticas Públicas. Impresiones Gráficas. tent/1461. Sampieri, Roberto Hernández, Carlos Fernán- ---. 2018f. Organigrama Institucional Ministe- dez Collado, Pilar Baptista Lucio, and Ma de rio de Planificación del Desarrollo. la Luz Casas Pérez. 1998. Metodología de la investigación. Vol. 6. Mcgraw-hill México. http://www.planificacion.gob.bo/con- tent/1461. Schwarz, Vivian, Jacqueline Cortés Garrido, Daniel Morales Moreno, Daniela Michel Ministerio de Trabajo, Empleo y Seguridad Osorio, Olivia Arnez Román, Gonzalo Villazon Social. 2013. Manual de organización y fun- Vargas, and Hillary Voth. 2014. Intersecciones: ciones. Apuntes para el debate de políticas publicas.

Doing Research in BOLIVIA 97 Comunidad de Estudios Sociales y Acción Dra Framework Pública (CIUDADANIA). Balarin, María, Fernando Masi, Ignacio Sutcliffe, Sophie, and Julius Court. 2006. "A González, Belén Servín, Miguel Vera, and toolkit for progressive policymakers in devel- Natalia Peres. 2015. "La producción de oping countries." investigación en ciencias sociales en tres países de ingresos medios y bajos de América Tapia, Luis. 2009. "Representación, partici- del Sur: los casos de Bolivia, Paraguay y Perú." pación y democratización en las relaciones Estado–sociedad civil en Bolivia." La ‘Nueva Buquet, Daniel. 2013. "Producción e impacto Izquierda’en América Latina: derechos hu- de las ciencias sociales en América Latina." manos, participación política y sociedad civil. CLACSO, Buenos Aires.[En línea] http:// Washington: Woodrow International Center: biblioteca. clacso. edu. ar/gsdl/collect/clacso/ 119-130. index/assoc D 8947. Texeira Carneiro, María José, Laila Sandroni, Bolivia, Jica Japan Desk. 2007. Directorio de and Daniel Delatin. 2015. "DE LA INVESTI- ONG que trabajan en Bolivia. La Paz: NGO GACIÓN A LA POLÍTICA PÚBLICA: PRODUC- JICA Japan Desk Bolivia. CIÓN Y CIRCULACIÓN DE CONOCIMIENTO Camacho Salinas, Roberto, Miriam Villegas, CIENTÍEICO." Nomadas (42): 151-165. and Christian Mendizábal. 2015. "Bolivia TIERRA, Fundación. 2014. "Políticas diferen- entre la realidad económica y la utopía ciadas para los distintos tipos de campesinos académica." Revista Cubana de Educación (anexo 10.5 del informe técnico final)." Pro- Superior 34: 81-106. http://scielo.sld.cu/ puestas para políticas públicas/Fundación scielo.php?script=sci_arttext&pid=S0257- TIERRA; no. 5. 43142015000100006&nrm=iso. Velasco Olivarez, Marco. 2011. "Estudio de Camacho, Catherine. 06 de agosto de 2018. casos bolivianos: las políticas públicas de Alianza y fomento: Claves para impulsar la economía social y el diálogo entre los pode- ciencia y la tecnología. Los Tiempos. res públicos y la sociedad civil." Coarite Huañapaco, Felipe 06 de febrero de Vilchis, Fernando Lámbarry, Luis Arturo Rivas 2016. Investigación científica y tecnológica Tovar, and Mara Maricela Trujillo Flores. 2011. en Bolivia. El Diario. "El papel de las ONG en la formulación de de Bolivia, Estado Plurinacional. 2009. políticas en transporte público en la Ciudad "Constitución Política del Estado." Gaceta de México: El caso del Centro Mario Molina y Oficial de Bolivia 7. el Centro de Transporte Sustentable." Revista Ciencias Estratégicas 18 (24). ---. 2010. "Ley contra el Racismo y toda forma de Discriminación." Gaceta Oficial de Bolivia. Vivanco, Manuel. 2005. Muestreo estadístico. Diseño y aplicaciones. Editorial Universitaria. de Ciencias Sociales, Centro Latinoamericano. 2013. "AVATARES DE LAS CIENCIAS SOCIALES Weyrauch, Vanesa. 2009. Acercando la inves- EN BOLIVIA Juegos de poder y estructura tigación a las políticas públicas en América académica en las carreras de sociología de las Latina: repensando los roles y desafíos para Universidades Públicas." los institutos de investigación de políticas. Centro de Implementación de Políticas Públi- Durán, Nelson Antequera. 2015. "La cas para la Equidad y el crecimiento. contribución del PIEB al conocimiento sobre

98 Doing Research in BOLIVIA espacios urbanos en Bolivia." T'inkazos. ---. 2011. Redes Nacionales de Investigación Revista Boliviana de Ciencias Sociales (38). Científica y Tecnológica. Erostegui, Susana. 29 de noviembre de ---. 2013. Plan nacional de Ciencia, Tecnología 2014. "¿Por qué los gobiernos le temen a e innovación. las ONG? Reconfiguración de la relación Estado – Sociedad Civil." Mesa de Articulación ---. 2018. Plan Operativo Anual. de Asociaciones Nacionales y Redes de ---. 2018. Redes Nacionales de Investigación ONGs de América Latina y el Caribe http:// Científica y Tecnológica - Memoria 2012 - mesadearticulacion.org/. 2017. Gómez Nashiki, Antonio, Sara Aliria Jiménez Mesa, C. 2014. "Breve historia de las politicas García, and Jaime Moreles Vázquez. publicas en Bolivia." Editorial Gisbert y Cia. 2014. "Publicar en revistas científicas, recomendaciones de investigadores de Orduna, Víctor. 2014. "PIEB 1994-2014: ciencias sociales y humanidades." Revista Dos décadas de aportes e incidencia mexicana de investigación educativa 19 (60): de la investigación." Tinkazos 17: 133- 155-185. 156. http://www.scielo.org.bo/scielo. Gutiérrez, Nadia. 2007. Guía para la php?script=sci_arttext&pid=S1990- comunicación y difusión de resultados de 74512014000200010&nrm=iso. investigación. La Paz, Bolivia: Fundación PIEB. NESH, 2016 The National Committee for Hicks, Diana. 2004. "The four literatures of Research Ethics in the Social Sciences and the social science." In Handbook of quantitative Humanities. "Guidelines for Research Ethics science and technology research, 473-496. in the Social Sciences, Humanities, Law and Springer. Theology" Jara-Navarro, María Inés. 2012. "El reto de la OECD, 2011. "Policy framework for investment investigación y la producción científica en user’s toolkit" salud." Revista Gerencia y Políticas de Salud 11 (22): 5-10. Oxhorn, Philip. 2015. "Producción, calidad y difusión de las revistas científicas del siglo Jiménez Landívar, Elizabeth. 8 de abril de XXI." Revista mexicana de sociología 77: 39- 2018. Investigación en las universidades 44. bolivianas: una asignatura pendiente. Página Siete. Peláez, José Antonio Caballero. 2015. El rol de la investigación científica en el Banco Central Latinobarómetro, Cooperación. 2018. de Bolivia. Banco Central de Bolivia. "Informe Latinobarómetro 2018." Santiago de Chile. www.latinobarometro.org. (08/2019). Pereira, Blithz y Lozada. 2016. Políticas científicas, tecnológicas y de innovación Lührmann, A, and SI Lindberg. 2019. en Bolivia. La Paz: Instituto de Estudios Democracy Facing Global Challenges. Bolivianos. V-Dem Annual Democracy Report 2019. Gothenburg: V-Dem Institute. Peres, Natalia. 2012. Rol de la evidencia en el proceso de políticas públicas: El caso Ministerio, de Educación. 2009. Potencial boliviano. Fundación ARU. científico y tecnológico Boliviano. ---. 2011. Potencial científico y tecnológico Quisbert, M., 2018. "Sobre políticas públicas Boliviano. en Bolivia." El Diario. https://www.eldiario.net/

Doing Research in BOLIVIA 99 noticias/2018/2018_01/nt180126/opinion. Understanding of Science 26 (8): 1003-1018. php?n=11&-sobre-politicas-publicas-en- bolivia Sandoval, Godofredo, Carlos Toranzo, Mario Yapu, O. Franco, Mabel, and Virginia Aillón. Quispe, María Eugenia Choque. 2014. "Género 2015. "Modelo de gestión de investigación desde las experiencias de investigación del estratégica en Bolivia." La Paz, Bolivia: PIEB." T'inkazos. Revista Boliviana de Ciencias Fundación PIEB Sociales (35). Tórrez, Yuri F. 2013. "Una mirada a los estudios Rennie, Leonie J. and Susan M. Stocklmayer, del PIEB Jóvenes: sujetos y objetos de 2003. "The Communication of Science investigación." Tinkazos 16 (33): 113-128. and Technology: Past, Presente and Future Agendas." International Journal of Science Vasquez, Ian, and Tanja Porčnik. 2018. Education 25, no. 6:759-773 "The human freedom index 2018." Cato Institute, Fraser Institute, Friedrich Naumann Revilla, Carlos Pedro Eróstegui, Evelin de Foundation for Freedom. Pardo Ghetti, Gustavo A Baumann Pinto, and Eduardo L Suárez Barrientos. 2011. Vesquez, Walter, and Marco Ibañez. 13 de "Evaluación de la difusión de la producción febrero de 2019. Investigación económica en científica en Bolivia." Gaceta Médica boliviana Bolivia está a la par de la del primer mundo. 34 (1): 5-5. La Razon. Sandoval, Godofredo. 06 de julioo de 2014. Villanueva, L. 2012. "Política Pública: Una Nuevos tiempos en la investigación en visión panorámica." Programa de las Naciones Bolivia. La Razon. Unidas para el Desarrollo (PNUD - Bolivia) Scharrer, Lisa, Yvonne Rupieper, Marc Stadtler, Zurita, Mgr Gunnar Zapata. 2012. and Rainer Bromme. 2017. "When science "Importancia y Situación Investigación becomes too easy: Science popularization Científica y Tecnológica en Bolivia: Desde inclines laypeople to underrate their una Sobreabundancia Normativa hacia una dependence on experts." Public Pobreza Productiva." La Paz.

100 Doing Research in BOLIVIA ANNEXES Annex 1: Context Analysis: List of Actors/Institutions Consulted List of Acronyms and Abbreviations The following acronyms pertain to the group of macro actors included in the context analysis: CAINCO : Chamber of Industry and Commerce CDC : Departmental Council of Competitiveness CEDLA : Center for the Studies for Labor and Agrarian Development CEDURE : Center for the Studies for Urban and Regional Development CENDA : The Andean Communication and Development Center CEP : Center for Population Studies CEPAD : Center for Participation and Sustainable Human Development CEPLAG : Center for Planning and Management CERES : Center for the Studies of Social and Economic Realities CESU : Center for Higher Education Studies CIEE : Center for Research in Economics and Management FEPC : Federation of Private Enterprises FEPROCO : Federation of Professionals – Cochabamba IESE : Institute of Social and Economic Studies IIES-JOM : José Ortiz Mercado - Institute for Economic and Social Research IISEC : Institute for Socio Economic Research INESAD : Institute of Advanced Studies in Development PIEB : Foundation for Strategic Research in Bolivia UAGRM : Universidad Autónoma Gabriel Rene Moreno UCB : Universidad Católica Boliviana “San Pablo” UDAPE : Social and Economic Policy Analysis Unit UMSS : Universidad Mayor de San Simon UNIVALLE : Universidad Privada del Valle UPB : Universidad Privada Boliviana UPSA : Universidad Privada de Santa Cruz de la Sierra

Doing Research in BOLIVIA 101 Location and category of institutions consulted for the context analysis:

CITY ACTOR CATEGORY LA PAZ UCB/IISEC Higher Education Institutions Central Bank of Bolivia Government and Funding Agencies Ministry of Productive Government and Funding Agencies Development and Plural Economy Ministry of Environment and Water Government and Funding Agencies UDAPE Government and Funding Agencies INESAD Civil Society CEDLA Civil Society DIAKONIA Civil Society COCHABAMBA UCB Higher Education Institutions UNIVALLE Higher Education Institutions UPB Higher Education Institutions UPB/CIEE Higher Education Institutions UMSS/CEPLAG Higher Education Institutions UMSS/CLAS Higher Education Institutions UMSS/IESE Higher Education Institutions UMSS/CEP Higher Education Institutions UMSS/CESU Higher Education Institutions FEPROCO Industry FEPC Industry CERES Civil Society Cuarto Intermedio Civil Society CENDA Civil Society CDC Civil Society SANTA CRUZ UPSA Higher Education Institutions UAGRM/IIES-JOM Higher Education Institutions CAINCO Industry CEPAD Civil Society CEDURE Civil Society

102 Doing Research in BOLIVIA Annex 2: Codification of Interviews Consulted for Context Analysis and DRA Framework

CONTEXT ANALYSYS NAME INSTITUTION CODE Osvaldo Gutiérrez Universidad Católica Boliviana “San Pablo” UCB:R01 Centro de Comunicación y Desarrollo Andino Sergio Vasquez CCD:RA01 Cochabamba/- Director Ana Maria Bayro Executive Director /Concejo de Competitividad CCP:RA01 Oscar Zurita President/ Federacion de Profesionales Cochabamba FPC:RA01 President/ Federacion de Empresarios Privados Javier Bellot FEP:RA01 Cochabamba Sandro Guerrero President UNIVALLE UNV:RA01 Universidad Mayor de San Simon/ Full-time Professor- Gabriela Canedo USS: R09 Researcher - Anthropology Sergio Aviles Universidad Mayor de San Simon- CLAS USS:R11 Carmen Ledo Universidad Mayor de San Simon – CEPLAG/Director CPL:RA01 Universidad Privada San Andres/Academic Sergio Daga USA:RA01 Vicepresident Universidad Católica Boliviana “San Pablo” – Santa Mariana Santa Cruz UCB:RA02 Cruz/Regional Coordinator Pablo Mendieta Ossi CAINCO CAI:RA01 Fernando Prado CEDURE– Director CDU:RA01 Rubens Barbery CEPAD - Director CPD: RA01 UAGRM – IIES/JOM URM:R01 Carlos Foronda/ Dr. UPB - CIEE/ Director/Vicepresident of Research UPB:RA01 Hugo Rojas Alejandra Ramírez CESU CES:R01 Víctor Hugo Blanco CEP/ Researcher CEP :R01 Javier Gómez CEDLA/Executive Director CED:RA01 María Félix Delgadillo UDAPE//Executive Director UDA:PM01 Jean Paul Benavides IISEC/ Professor/Researcher IIE :R01 Beatriz Muriel INESAD/Executive Director INE:RA01 Ricardo Azogue IESE/Executive Director IES:RA01

Doing Research in BOLIVIA 103 DRA FRAMEWORK RESEARCHERS CODE Researcher at CERES since 1982, member of the board Rosario León CER:R01 at CERES since 1989 Researcher at CESU, Center for higher education Alejandra Ramírez CES:R01 studies Víctor Hugo Blanco Researcher at CEP, Center for population studies CEP :R01 Researcher at the Research Institute of the School of Mireya Sánchez USS:R01 Humanities and Educational Sciences Jean Paul Benavides Sociologist, researcher at IIESE IIE :R01 Andrés Uzeda Sociology professor, Universidad Mayor de San Simon USS:R02 Director a.i. Institute of research in social sciences, Jhony Ledezma USS:R03 School of Social Sciences, UMSS Professor/Researcher at CEP, Center for population Miguel Veizaga CEP:R02 studies Professor/Researcher at Institute of research in social Adolfo Mendoza USS:R04 sciences, School of Social Sciences, UMSS José De la Fuente Independent Researcher IND:R01 PhD Candidate, Directorate of Scientific and Antonio Mayorga USS:R05 Technological Research, UMSS Director, Graduate School, School of Social Sciences, Sarela Paz USS:R06 UMSS Fernando Prada Director PhD program, PREIB-ANDES-UMSS USS:R07 Alvaro Pinaya Director, Sociology, Universidad Mayor de San Simon USS:R08 Professor of the Anthropology Program of Universidad Gabriela Canedo Mayor de San Simon. Postgraduate & PhD professor, USS:R09 Vásquez researcher at CIDES, University of San Andrés. Antonio Bustillos Institute of Economic and Business Research, Faculty USS:R10 Bailey of Economic and Business Sciences Lucila Choque Researcher IND:R02 Felipe Quispe Professor, Researcher IND:R03 Sociologist, researcher, consultant and teacher on Elizabeth Andia different issues of interculturality, gender, political IND:R04 participation and economics. Gumercindo Flores Researcher, Institute for Sociologic Research IDI:R01 Carlos Macusaya Researcher Jicha, Independent Consultant IND:R05

104 Doing Research in BOLIVIA RESEARCH ADMINISTRATORS Beatriz Muriel Executive Director of the INESAD Foundation INE:RA01 Director of IESE, Institute of Social and Economic Ricardo Azogue IES:RA01 Studies Director of CEDLA, Center for Labor and Agrarian Javier Gómez CED:RA01 Development Studies María Esther Pozo VicePresident, Universidad Mayor de San Simon USS:RA01 Director, Center for Business Information and Strategic Roxana Aleman Planning (CIEPLANE), School of Economic and CIE:RA01 Castillo Financial Sciences Director, CEPA, Center of Ecology and Andean Gilberto Etauwels CPA:RA01 Communities Director of the Foundation for Strategic Research in Godofredo Sandoval PIE:RA01 Bolivia for 25 years Regional Research Coordinator of the Universidad Marcelo Guardia UCB:RA01 Católica Boliviana

POLICYMAKERS Director of UDAPE, Unit of Analysis of Social and María Félix Delgadillo UDA:PM01 Economic Policies Claudia Mallon National Deputy for Unidad Democrata UDE:PM01

KEY INFORMANTS Former state minister, currently Bolivia's ambassador René Orellana KIN:01 to Uruguay Former director of Los Tiempos, a national newspaper, Juan Cristóbal Soruco KIN:02 retired journalist. Anthropologist, columnist for Opinion, a national María Esther Mercado KIN:03 newspaper Director of Puntos de vista, editor and short-term Luis René Baptista KIN:04 director of Los Tiempos, a national newspaper Frank Arteaga Director Mano Diversa KIN:05 Former director of Agroecology (AGRUCO)/University Frank Delgado KIN:06 center Pedro Portugal Director of Pukara, digital newspaper KIN:07

Doing Research in BOLIVIA 105 Annex 3: Stakeholder Mapping /Selected Sample

Subgroup # # Resear - Share in total Initial number Rate of Final number Institutions chers of of respo- response of respon- # Researchers ndents dents Subgroup 1 20 1.54% 5 75% 6 1 Sociological Research Institute (IDIS) 20 Subgroup 2 62 4.77% 14 75% 18 2 Center for Planning and Management (CEPLAG) 20 1 Institute of Social and Economic Studies (IESE) 11 Institute for Architecture Research (IIA) 19 Center for Research in Economics and Management 12 (CIEE) Subgroup 9 71 5.46% 16 75% 20 ARU Foundation 20 Center for Studies for Labor and Agrarian Development 18 (CEDLA) 1 Institute of Advanced Studies in Development 18 (INESAD) 2 UNDP (PNUD) 15 Subgroup 10 36 2.77% 8 75% 10 1 CIUDADANIA - Community of Social Studies and 24 Public Action Center for the Studies of Social and Economic Realities 12 (CERES) Subgroup 12 28 2.15% 6 75% 8 1 PROAGRO 15 Fundación Tierra (sede Sucre) 13 Subgroup 13 319 24.52% 74 50% 110 Danish Agency for International Development 15 (DANIDA) 1 GiZ (German agency/ international cooperation 15 for sustainable development and international education work) Ministry of Economy and Public Finance - Viceministerio 15 de Presupuesto y Contabilidad Ministry of Economy and Public Finance - Viceministerio 15 de Tesoro y Credito publico 4 Ministry of Environment and Water - Viceministerio 15 de Medio Ambiente, Biodiversidad, Cambio climático, Gestión y Desarrollo forestal Ministry of Environment and Water - Viceministerio de 12 Recursos Hídricos y Riego Ministry of Productive Development and Plural 35 Economy - Viceministerio de Micro y Pequeña empresa Ministry of Public Works, Services and Housing . 15 Viceministerio de Vivienda y Urbanismo OMS 15 2 OPS 15 6 Social and Economic Policy Analysis Unit (UDAPE) 37 Spanish Agency for International Development 19 Cooperation (AECID)

106 Doing Research in BOLIVIA Subgroup # # Resear - Share in total Initial number Rate of Final number Institutions chers of of respo- response of respon- # Researchers ndents dents Swiss Contact 14 UNICEF 24 5 Ministry of Rural Development and Land - 17 Viceministerio de Desarrollo Rural y Agropecuario 3 Ministry of Development Planning - Viceministerio 29 de Inversion Publica y Financiamiento Externo Ministry of Labour, Employment and Social Security - 12 Viceministerio de Empleo, Servicio Civil y Cooperativas Subgroup 17+33 38 2.92% 9 75% 11 3 Institute of Economic Research 10 Instituto de Investigaciones Fausto Reinaga - UPEA 8 Universidad Publica de El Alto 6 1 School of Productivity and Competitiveness 4 Universidad de Aquino Bolivia 3 Institute of Socio Economic Research (IISEC) 4 2 Instituto de Investigaciones Sociales - Pablo Zárate 3 Villka - UPEA Subgroup 18+34 43 3.31% 10 75% 12 3 Universidad Católica Boliviana 6 Center for population studies (CEP) 7 Institute for Education Sciences Studies (IIHCE) 6 1 Center for Higher education studies (CESU) 7 Universidad Privada Franz Tamayo 4 2 Universidad Simon I. Patino 3 Center for the Generation of Information and Statistics 3 (CEGIE) Center for Finance Innovation (CIIFI) 4 Center of Innovation in Information Technologies for 3 Education and Enterprise (CITIEE) Subgroup 20+36 67 5.15% 15 75% 19 Centro de investigaciones de Facultad de Ciencias 6 Políticas, Jurídicas y Sociales - UTO Instituto de Investigaciones Económicas y 6 Empresariales. Instituto de Sociología Boliviana. 8 6 Departamento de Postgrado de la Universidad SXX 6 Centro de Investigación y Documentación Pedagógica 2 2 Dirección de Postgrado e Investigación Científica 3 UTO Instituto de Investigación de la Amazonia Boliviana de 4 la Facultad de Ciencias Forestales 3 Instituto de Investigación en Ciencias Económicas 5 5 Instituto de investigaciones de la Facultad De 2 Ciencias Económicas Financieras Y Administrativas Instituto de Investigación y Proyectos 5 Instituto de Investigación de Estudios Sociales y 3 Humanísticos Centro de Investigaciones Lingúisticas y Educativas. 1

Doing Research in BOLIVIA 107 Subgroup # # Resear - Share in total Initial number Rate of Final number Institutions chers of of respo- response of respon- # Researchers ndents dents 4 Dirección de Investigación Científica y Tecnológica 1 (Dicyt) Sucre Organización Boliviana de Mujeres en Ciencia (Capitulo 2 Chuquisaca, existe a nivel nacional) Centro De Investigación de Proyectos de Grado para la 4 Interacción Socio comunitaria (CIPGIS) CIBIOMA (Centro de Investigación en biodiversidad y 1 medio ambiente) - UABJB 1 Instituto de Investigaciones Económicas, 3 Administrativas y Financieras Dirección de Investigación Ciencitífica y Tecnologíca 1 (Dicyt) Tarija Centro de Información Empresarial y Planificación 2 Estratégica Dirección de Investigación Científica y Tecnológica 1 (Dicyt) Potosí Dirección de Investigación Científica y Tecnológica 1 (Dicyt) Pando Subgroup 25 +41 162 12.45% 37 75% 47 Agua Sustentable 9 Asociación CUNA 6 Bolivian Center for Multidisciplinary Studies (CEBEM) 7 Centro Boliviano de Investigación y Acción Educativas 8 (CEBIAE) Centro de Investigación Social y Trabajo en Equipos 6 Multidisciplinarios (CISTEM) Centro de Promoción de la Mujer Gregoria Apaza 6 (CPMGA) Fundación SARTAWI SAYARIY 6 Fundacion SER 6 3 Fundacion Solon 6 9 JUBILEO Foundation 10 5 National union of institutions for the work of social 8 action (UNITAS) 4 Peasant Research and Promotion Center (CIPCA) 7 TIERRA Foundation 10 La Razon 8 7 Fundacion UNIR 8 Fundacion CONSTRUIR 8 Servicios Múltiples de Tecnologías Apropiadas (SEMTA) 6 Centro de Capacitación y Servicios para la Integración 3 de la Mujer (CECASEM) FUNAVI 5 2 Fundacion PUMA 4 1 Milenio Foundation 4 Fundacion PROFIN 4 8 Friedrich-Ebert-Stiftung FES Bolivia 4 Vision Mundial 5

108 Doing Research in BOLIVIA Subgroup # # Resear - Share in total Initial number Rate of Final number Institutions chers of of respo- response of respon- # Researchers ndents dents INASET 4 6 Colectivo de la Mujer Indígena Andina Amazónica y 4 Oriente Pachamama (COMAI - PACHAMAMA) Subgroup 26+42 32 2.46% 7 75% 9 The Andean Communication and Development Center 8 (CENDA) 1 Documentation and Information Center Bolivia 4 (CEDIB) 2 FAUNAGUA 5 Fundación Gaia Pacha 3 Los Tiempos 5 Opinion 4 Somos Sur 3 Subgroup 27+43 54 4.15% 12 75% 16 2 Center for Participation and Sustainable Human 10 Development (CEPAD) Centro de Promoción Agropecuaria Campesina (CEPAC) 6 El Deber 8 Natura 10 3 Asociación Forestal Indígena Nacional 5 1 Center for the studies for Urban and Regional 5 Development (CEDURE) Centro de Investigación y Documentación Santa Cruz 5 (CIDCRUZ) PROCESO Servicios Educativos 5 Subgroup 28+44 100 7.69% 23 75% 29 Centro de Ecología y Pueblos Andinos 10 CIPCA (Norte Amazonico) 8 Herencia 8 Plataforma Interinstitucional de Apoyo a la Igualdad de 9 Oportunidades de Género PFCUVS - Investigación y Transferencia de Tecnología 10 (FAUTAPO) (regional Tarija) 4 Acción cultural Loyola (ACLO) 7 Asociación Social Tarija (ASOCIO) 5 5 CEJIS (Regional Trinidad) 5 2 Centro de Estudios Hoya Amazónica - Mojos 4 CIPCA - Beni 5 Instituto de Investigación y Capacitación Campesina 4 (IICCA) Instituto Politécnico Tomás Katari (IPTK) 3 JAYNA Comunidad de Estudios 4 Línea Institucional de Desarrollo Rural (LIDER) 3 1 Fundación Participación y Sostenibilidad (PASOS) 5 3 Centro de Investigaciones y Políticas Sociales (CIPS) 5 6 Centro de Investigación y Servicio Popular (CISEP) 5

Doing Research in BOLIVIA 109 Subgroup # # Resear - Share in total Initial number Rate of Final number Institutions chers of of respo- response of respon- # Researchers ndents dents Subgroup 29+45 144 11.07% 33 50% 50 4 Center for Social Research (CIS) – Vicepresidency of 6 the Plurinational State of Bolivia 7 Central Bank of Bolivia 10 Gobierno Autónomo Departamental de La Paz 10 Ministry of Development Planning - Viceministerio de 8 Planificacion Estrategica del Estado 5 Ministry of Development Planning - Viceministerio 10 de Planificacion y Coordinacion Ministry of Economy and Public Finance - Viceministerio 8 de Pensiones y Servicios Ministry of Economy and Public Finance - Viceministerio 8 de Politica Tributaria Ministry of Environment and Water - Viceministerio de 8 Agua Potable y Saneamiento básico 2 Ministry of Productive Development and Plural 9 Economy - Viceministerio de producción industrial a mediana y gran escala 6 Ministry of Public Works, Services and Housing - 10 Viceministerio de telecomunicaciones 3 Ministry of Public Works, Services and Housing - 8 Viceministerio de Transportes Swedish Agency for International Development 8 Cooperation (ASDI) Ministry of Rural Development and Land - 8 Viceministerio de Coca y Desarrollo Integral Ministry of Labour, Employment and Social Security - 10 Viceministerio de Trabajo y Previsión Social Ministry of Productive Development and Plural 8 Economy - Viceministerio de Comercio Interno y Exportaciones Gobierno Autonomo Municipal de La Paz 6 Banco Mundial 2 1 Diakonia 1 Interamerican Development Bank 2 Ministry of Rural Development and Land - 4 Viceministerio de Tierras Subgroup 30 20 1.54% 5 50% 7 1 Gobierno Autónomo Departamental de 10 Cochabamba Gobierno Autónomo Municipal de Cercado (GAMC) 10 Subgroup 31 14 1.08% 3 50% 5 Gobierno Autónomo Departamental de Santa Cruz 6 1 Gobierno Autonomo Municipal de Santa Cruz 8 Subgroup 32+48 65 5.00% 15 50% 22 2 Gobierno Autónomo Departamental de Beni 8 Gobierno Autónomo Departamental de Chuquisaca 8 Gobierno Autónomo Departamental de Potosí 6

110 Doing Research in BOLIVIA Subgroup # # Resear - Share in total Initial number Rate of Final number Institutions chers of of respo- response of respon- # Researchers ndents dents 4 Gobierno Autónomo Departamental de Tarija 10 Gobierno Autonomo Municipal de Oruro 6 Gobierno Autonomo Municipal de Potosi 6 Gobierno Autonomo Municipal de Sucre 6 1 Gobierno Autónomo Departamental de Oruro 3 Gobierno Autónomo Departamental de Pando 3 Gobierno Autónomo Municipal de Cobija 3 Gobierno Autónomo Municipal de Tarija 3 3 Gobierno Autonomo Municipal de Trinidad 3 Subgroup 35 14 1.08% 3 75% 4 Universidad Católica Boliviana "San Pablo" 5 Universidad Privada de Santa Cruz de la Sierra 5 1 Jose Ortiz Mercado Institute for Economic and 4 Social Research (IIES-JOM) Subgroup 37+38+39 12 0.92% 3 75% 3 Fundapro 1 Chamber of Commerce and Services 3 Federation of Private Enterprises 2 1 IMG Consulting 2 2 Chamber of Industry and Commerce 4 TOTAL 1301 100% 300 407

Doing Research in BOLIVIA 111 Annex 4: Distribution of Selected Sample

Rest of Bolivia

La Paz La Paz Government and Funding Agencies (12,9%)

Civil Society (43,9%)

Rest of Bolivia Rest of Bolivia

Higher

education institutions(32,3%) Cochabamba

La Paz Cochabamba # Received Surveys: 155 - Researchers: 96 - Administrators: 39 - Policymakers: 20

Higher Education Institutions Private Sector Civil Society Government and Funding Agencies (32,3%) (1,9%) (43,9%) (21,9%)

112 Doing Research in BOLIVIA Annex 5: Stakeholder Mapping – List of Universities in Bolivia and Academic Staff Members

A Public Autonomous Universities: 7. Universidad De La Amazonía Boliviana 1. Universidad Mayor Real y Pontificia San 8. Universidad De La Cordillera Francisco Xavier de Chuquisaca (USFX) 9. Universidad De Los Andes Sucre, Chuquisaca (UDELOSANDES) 2. Universidad Mayor de San Andrés 10. Universidad Evangélica Boliviana (UEB) (UMSA), La Paz 11. Universidad La Salle (ULS) 3. Universidad Mayor de San Simón (UMSS), 12. Universidad Latinoamericana Cochabamba 13. Universidad Loyola 4. Universidad Pública de El Alto (UPEA) 14. Universidad Nacional Del Oriente 5. Universidad Autónoma Gabriel René Moreno (UAGRM), Santa Cruz de la Sierra 15. Universidad Nacional Ecológica 6. Universidad Técnica de Oruro (UTO) 16. Universidad Priv. Ntra. Sra. De La Paz (UNSLP) 7. Universidad Autónoma Tomás Frías (UATF) 17. Universidad NUR 8. Universidad Autónoma Juan Misael 18. Universidad Para El Desarrollo Y La Saracho Innovación 9. Universidad Autónoma del Beni Mariscal 19. Universidad Para La Investigación José Ballivián (UAB) Estratégica En Bolivia 10. Universidad Nacional Siglo XX 20. Universidad Privada Abierta Latinoamericana (UPAL) 11. Universidad Amazónica de Pando 21. Universidad Privada Boliviana (UPB) B. Private University members of the 22. Universidad Privada Cumbre Executive Committee of the Bolivian 23. Universidad Privada De Ciencias University (CEUB): Administrativas Y Tecnológicas 1. Escuela Militar de Ingeniería (EMI) 24. Universidad Privada De Oruro (UNIOR) 2. Universidad Católica Boliviana San Pablo 25. Universidad Privada De Santa Cruz De La (UCB) Sierra (UPSA) 3. Universidad Andina Simón Bolívar 26. Universidad Privada Del Chaco 4. Universidad Policial (UNIPOL) 27. Universidad Privada Del Valle (UNIVALLE) C. Private Universities: 28. Universidad Privada Domingo Savio 1. Universidad Adventista De Bolivia (UAB) (Upds) 2. Universidad Bethesda 29. Universidad Privada Franz Tamayo (UNIFRANZ) 3. Universidad Boliviana De Informática 30. Universidad Privada Indígena 4. Universidad Central (UNICEN) Tawantinsuyu Axlla (UTA) 5. Universidad Cristiana De Bolivia (UCEBOL) 31. Universidad Real De La Cámara Nacional 6. Universidad De Aquino Bolivia (UDABOL) De Comercio

Doing Research in BOLIVIA 113 32. Universidad Salesiana De Bolivia 36. Universidad Tecnológica Boliviana (UTB) (USALESIANA) 37. Universidad Tecnológica Privada De Santa 33. Universidad San Francisco De Asís Cruz (UTEPSA) 34. Universidad Simón I. Patiño (USIP) 38. Universidad Unidad 35. Universidad Técnica Privada Cosmos 39. Universidad Unión Bolivariana (UNITEPC) Source: Ministerio de Educacion, 2016

D Academic and Research Staff: Type of University Research Staff Public Private Notes 2011 2015 2011 Number of Social Science Researchers 1181 963a 450 researchers is not available. Fellowships 351 - 135 Number of Social Science Number of Research Centers 210 - 53 centers and their researchers in 2015 is not available. Natural Sciences 41 - 8 Engineering and Technology 65 - 13 Medical Science 22 - 9 Agricultural Sciences 40 - 3 Social Science 36 - 15 Humanities 6 - 5 a Data available for 9 of 11 Public Universities.

Source: Ministerio de Educacion, 2011 – CEUB, 2015

114 Doing Research in BOLIVIA

@ceresbol Parque Fidel Anze No. S-22, Esq. Av. Eudoro Galindo, Edificio San Lucas, Cochabamba|BOLIVIA T +591 4 4799365 | [email protected]

Global Office |nd 2 Floor, West Wing ISID Complex, 4, Vasant Kunj Institutional Area, New Delhi-110070 | INDIA T+91 11 4323 9478/4323 9494 | F +91 11 2613 6893 | www.gdn.int