FOURTH MEETING of MINISTERS of EDUCATION OEA/Ser. K/V.7.1

Total Page:16

File Type:pdf, Size:1020Kb

FOURTH MEETING of MINISTERS of EDUCATION OEA/Ser. K/V.7.1

ORGANIZATION OF AMERICAN STATES

Inter-American Council for Integral Development (CIDI)

FOURTH MEETING OF MINISTERS OF EDUCATION OEA/Ser. K/V.7.1 August 10-12, 2005 CIDI/RME/INF.4/05 Scarborough, Republic of Trinidad and Tobago 11 July 2005 Original: English

QUESTIONNAIRE ON CURRENT PRACTICES IN EDUCATIONAL REPORTING Presentation of results Technical Secretariat of the Inter-American Committee on Education

17th Street and Constitution Avenue, NW, Washington, D.C. 20006 QUESTIONNAIRE ON CURRENT PRACTICES IN EDUCATIONAL REPORTING

Presentation of results Technical Secretariat of the Inter-American Committee on Education

The Questionnaire stems from a mandate of the Special Summit of the Americas, held in Monterrey, Mexico in January 2004. In the declaration of the Summit, the heads of state and government stated that they “commit[ed] to increase access to and dissemination of information concerning [their] educational systems with the objective of improving their performance.” In response to the mandate, during the II Meeting of the authorities and Executive Committee of the Inter-American Committee on Education, the member countries requested that the Technical Secretariat develop a questionnaire that would collect information on “current practices in member countries for informing the public on the characteristics and results of education systems.”

Both the Technical Secretariat of the Inter-American Committee on Education and the Department of Education of the United States participated in the design of the questionnaire. Contributions were also made by the Secretariat of Public Education of Mexico and the Canadian Council of Ministers of Education and Culture. From its inception, it was considered important that the questionnaire asked the countries, at a basic level, about the production and dissemination of educational information. The questionnaire also sought to recognize that dissemination requires those within an education system to decide what information is relevant, how it should be produced and what actors must be informed.

The questionnaire was structured under the assumption that the dissemination of educational information contributes to the improvement of education through strengthening teachers’, schools’ and parents ’ capabilities to identify the problems and solutions. The dissemination of information can also guide and strengthen compensatory actions of national and local governments as well as contribute to a legislative process that is more sensitive to the specific needs, timelines and processes of the educational system.

The Questionnaire on Current Practices in Educational Reporting was sent to the heads of international relations or international cooperation as well as to the CIE delegates of the 34 national education authorities of the Organization of American States (OAS) Member States. The Technical Secretariat sent an electronic file of the Questionnaire on July 21 and 23, 2004 to the 34 member countries and made an online version available August 3rd of the same year. Thirty-two national authorities sent their questionnaires to the offices of the Technical Secretariat, or they completed them online, from August 11th to October 13th , 2004. The Technical Secretariat then compiled the data supplied by the 32 countries that answered the questionnaire and produced a report based solely on that data.

The structure of the questionnaire and those who completed it

The questionnaire is divided into 10 sections, each beginning with a key question.

17th Street and Constitution Avenue, NW, Washington, D.C. 20006 3

The first five key questions focus on public dissemination practices generally and are divided into five categories according to the type of information. Each of these sections aims to outline the type of information reported, the actors involved in the interpretation of the information, the intended recipients and the dissemination methods used. In all of the sections the respondents were asked to provide information on the latest published education reports (including title, year, edition and possible website, if applicable).

The sixth and seventh questions focus on the dissemination of information specifically for families and schools. These sections seek to identify government efforts to disseminate relevant information for decision making among teachers, schools, parents and students. These sections focus on themes emanating from comments made by experts from the member countries during the launch meeting of the second phase of the Regional Education Indicators Project that was held in Cancun, Mexico, in June 2004. During that meeting, these experts highlighted the importance of using information about academic performance as a central input for reflection and action among educational actors, especially teachers and school personnel. 4

The eighth and ninth questions Table 1. Who answered the questionnaire? refer to efforts to educate the media and

Antigua and Coordinator - Technical & Vocational Education & legislative bodies to ensure that they are Barbuda Training, Ministry of Education adequately informed about the workings of Argentina National Director of Information and Assessment of the education system and can actively the Quality of Education (DINIECE), Ministry of Education participate in the interpretation of this Barbados Deputy chief education officer (planning, research information. and development), Ministry of Education Belize Education Officer- Statistics Bolivia Planning Officer Lastly, question 10 allows the Brazil General Coordinator of the Consolidated System on ministries to explain how the dissemination Educational Information (INEP). of educational information fits within the Canada Coordinator, Research and Statistics, Council of Ministers of Education broader education policy framework. This Chile Chief Officer, Department of Research and section is divided into three parts. The first Development, Ministry of Education part considers information as a possible Colombia Information Coordinator, Office of Planning, Ministry of Education input for key actors in education (such as, Costa Rica Sub-director, Division of Curricular Development, principals, teachers and educational Ministry of Education authorities). The second part offers Dominica Senior Planning Officer Ecuador Director, Division of Statistics, Ministry of possible criteria for the allocation of Education resources based on educational El Salvador National Director of Monitoring and Assessment, Ministry of Education performance. The third part seeks United States of Director, Annual Reports Program information for building consensus and America collaboration among various actors. Grenada Education Officer – Statistics and Assessment Guatemala Director of Information Unit, Ministry of Education Guyana Chief Planning Officer Honduras Principal Consultant to the Minister General considerations Jamaica Acting Director, Planning & Development The Bahamas The Education Officer The immediate conclusion Mexico General Director of Assessment, Secretariat of Public Education garnered from the data collected by the Nicaragua Director of Public Information and Director of survey is that practically all national Prospecting and Policies, Ministry of Education educational authorities in the hemisphere Panama General Director of Education, Ministry of Education Paraguay Technical Officer, Ministry of Education disseminate, to varying degrees and in Peru Chief of the Unit of Education Statistics, Ministry of multiple ways, the information that they Education have gathered. Countries devote important Dominican Director of Statistics, Ministry of Education Republic efforts especially to the dissemination of St. Kitts and Technical Coordinator educational achievement data as measured Nevis St. Lucia Statistician lll by national student assessments. However, Suriname Head of Department of Research and Planning there are cases in which this information Trinidad and Research Officer, I has little relevance for main actors and Tobago certain ethnic groups, as is often the case Uruguay Officer, Research Unit with many teachers and principals. Also, Venezuela Director of Budget and Planning, Ministry of there are few policies that are specifically Education designed to provide useful information to parents or to legislators. 5

Table 2. Main answers of first 9 sections

D o e s y o u r g o v e r n m e n t p u b l i s h a n n u a l s t a t i s t i c a l d a t a o n p r i m a r y a n d       30 s e c o n d a r y e d u c a t i o n e n r o l l m e n t ?

D o e s y o u r g o v e r n m e n t p e r i o d i c a l l y p u b l i s h s t a t i s t i c a l d a t a o n b a s i c          28 e d u c a t i o n a l i n d i c a t o r s ? D i d y o u r c o u n t r y p r o d u c e e d u c a t i o n a l d a t a t h r o u g h t h e l a s t n a t i o n a l p o p u l a t i o n c e n s u s a n d / o r n a t i o n a l   n    30 p o p u l a t i o n s u r v e y ? A r e s t a n d a r d i z e d s t u d e n t p e r f o r m a n c e a s s e s s m e n t s a n d / o r a c h i e v e m e n t t e s t s c a r r i e d o u t i n p r i m a r y o r s e c o n d a r y  n          28 e d u c a t i o n ? D o e s y o u r c o u n t r y p a r t i c i p a t e i n c o m p a r a t i v e i n t e r n a t i o n a l a s s e s s m e n t s a n d / o r a c h i e v e m e n t t e s t s c a r r i e d o u t i n   n                       14 p r i m a r y o r s e c o n d a r y e d u c a t i o n ? D o e s y o u r g o v e r n m e n t p u b l i s h e d u c a t i o n a s s e s s m e n t r e p o r t s s p e c i f i c a l l y d e s i g n e d f o r s c h o o l s   n                      19 ( t e a c h e r s , p r i n c i p a l s ) ? D o e s y o u r g o v e r n m e n t p u b l i s h e d u c a t i o n a s s e s s m e n t r e p o r t s s p e c i f i c a l l y d e s i g n e d f o r f a m i l i e s   n       n                      7 ( s t u d e n t s , p a r e n t s a n d g u a r d i a n s ) ? D o e s y o u r g o v e r n m e n t w o r k t o e d u c a t e t h e m e d i a t o e n s u r e a m o r e a c c u r a t e r e a d i n g a n d i n t e r p r e t a t i o n o f  n                        16 e d u c a t i o n a l d a t a ? D o e s y o u r g o v e r n m e n t w o r k t o e d u c a t e t h e C o n g r e s s t o e n s u r e a m o r e a c c u r a t e r e a d i n g a n d i n t e r p r e t a t i o n o f   n    n            n             10 e d u c a t i o n a l d a t a ? A f i r m a t i v e a n s w e r s 3 7 2 8 7 8 8 9 6 5 5 3 5 9 4 3 5 7 7 2 8 6 5 7 6 6 7 6 4 4 3 7

n Question not answered Questionnaire not answered One issue unanticipated in the questionnaire was the participation of local and state/provincial authorities in the management of information. While the questionnaire focused on the actions of national governments, in some countries local authorities bear the responsibility for the dissemination, collection and regulation of educational information, giving national authorities a minimal role in the diffusion process. The questionnaire does not explicitly inquire about the details of cases where the dissemination of information is decentralized. Chile, Canada and the United States each indicated the use of this system of dissemination. Chile stated that the Ministry of Education’s commitment to the dissemination of educational information has led to the development of the Municipal Education Information System (SIEM), which offers educational information to municipalities via its website. The municipalities, in turn, take on the responsibility of disseminating that information among schools and communities. The Coordinator of Research and Statistics from the Canadian Council of Ministers of Education indicated that although his responsibilities for the dissemination of information at the national level are limited, he could still offer some information on 6 the general characteristics of the publications developed in the provinces. In the United States, individual states, as well as local school districts and schools, disseminate information regarding school characteristics, basic education statistics, and student performance data. This is generally done through documents known as “report cards,” which are often available online. At the national level, the National Center for Education Statistics is responsible for collecting and disseminating education statistics, and student achievement data from the National Assessment of Education Progress are disseminated online.

The dissemination of enrollment information, basic educational indicators and educational information garnered from the census

The large majority of countries in the hemisphere has developed information diffusion activities that are based on annual enrollment and graduation data in primary and secondary education. This information and the associated indicators (called “basic indicators” in the survey) are traditional inputs for the evaluation and planning carried out by educational authorities.

Only Antigua and Barbuda and the Bahamas completely lack the periodic publication of the enrollment figures and basic education indicators. Belize, Dominican Republic, St. Kitts and Nevis and Suriname, on the other hand, do not mention any printed publications, websites or other reporting methods. Though fifteeni countries annually print and publish statistical compendia on enrollment information, there are few editions distributed. Six countries manage to print one thousand or more annual units: Argentina, Brazil, Chile, Mexico, Peru and the United States.

The dissemination of basic indicators is similar to that of disseminating enrollment figures. Twelveii countries reported that they publish compendia of indicators, but print fewer than 1000 copies, with the exceptions of Brazil (5,000), Canada (2,500), Peru (2,000), Chile (1,000) and Mexico (1,000). Despite stating that they publish basic indicators, Barbados, Belize, Ecuador, Jamaica, Panama, Dominican Republic and Venezuela do not specify public access to a publication nor a website or other diffusion method.

As it has been mentioned within the context of the Regional Educational Indicators Project (PRIE), information on education systems would have a greater impact if it could be converted into a useful input for the daily work of teachers, principals, families and communities, and not only for national or regional authorities. Figure 1: Sector part icipation in writing of narrative report s Therefore, educational information based on census dat a (# of countries) put at their disposal should reflect 10 both the situation of their 6 community and of their schools. The countries’ information dissemination practices for 1 1 0 0 enrollment data seem to move in this direction. Of the 30 countries E d u c a t i o n A c a d e m i a , T e a c h e r s N G O 's T e a c h e r s L a w m a k e r s that publish enrollment a u t h o r i t i e s r e s e a r c h e r s U n i o n s information, 22 disaggregate this information at municipal, local or school levels. Bahamas, Belize, Colombia, Guyana, Mexico, Paraguay, Trinidad and Tobago and Uruguay are the eight countries that do not publish information at any of these levels. Seventeen countries publish information on enrollment for individual schools. 7

However, there are few countries that publish basic educational indicators by municipality, community or school. Only Bolivia, Costa Rica, Dominica, Dominican Republic, El Salvador, Guatemala, Panama and St. Lucia publish drop out and retention data for individual primary and secondary schools.

Often, the greatest educational inequalities in the hemisphere are drawn along ethnic lines within nations. With this in mind, it is important to note that only 5 countries publish annual enrollment information disaggregated by ethnic group. These countries are Bolivia, Costa Rica, United States, Guatemala and Panama. Other countries with significant indigenous populations collect and publish information on indigenous populations served by bilingual-intercultural modalities, without specifying the ethnic group of the students. Costa Rica, Panama and the United States publish drop out and retention indicators disaggregated by ethnic group.

The majority of the countries (30) that answered the survey did collect educational information based on census data. Twenty-oneiii of these countries published reports using data collected from the census.

As demonstrated in Figure 1, the sectors that had the highest level of participation in the writing of reports using this data were educational authorities (10 countries) and academia (6 countries). Those that did not participate in the writing of the report were teachers’ unions and lawmakers (0 countries).

On the other hand, Figure 2 Figure 2: Recipients of narrative reports based on census data displays the institutions to which these (# of countries) narrative reports were sent. On the 13 whole, the institutions in the 11 hemisphere that most often received 10 10 8 7 the reports based on census data from their governments were educational 3 authorities (in 13 countries), and other ministries. While teachers’ unions and Ministries Other Congress Teacher NGOs Universities Schools congresses (10 countries) also received of Education ministries Unions the report from their governments, they did not participate in its development. Only three countries (Belize, Dominican Republic and Paraguay) indicated that they distributed the report to schools.

The Dissemination of the Results of Student Assessments and Achievement Tests

Figure 3: Sector participation in the writ ing of reports Considerable effort is required to on student assessments (# of countries) effectively report on the results of national 20 standardized exams administered to primary and secondary level students. Of the 28 countries that administer these 8 iv 5 exams, 23 have consistently produced 1 1 0 descriptive reports. The number of these publications exceeds on average the

E d u c a t i o n A c a d e m i a , T e a c h e r s T e a c h e r s L a w m a k e r s N G O s number of publication of enrollment and A u t h o r i t i e s r e s e a r c h e r s U n i o n s 8 basic indicators (in the 20 countries that publicized the results of secondary education performance exams, the reported average of copies published was 3,696, in comparison to an average of 841 publications for enrollment information.)

Of the 28 countries that reported on national standardized exam performance, Colombia, Panama and the Dominican Republic did not specify the title of any publication, related Web address or other method for the publication of the results. According to Figure 3, those that participate the most in the writing of the reports are educational authorities. Those that have a low level of participation are NGOs and teachers unions. The five countries that involved primary and secondary teachers in the writing of these reports were Antigua and Barbuda, Argentina, Grenada, Nicaragua and St. Kitts and Nevis. Regarding the dissemination of the Table 3. International Standardized reports, 19 of the 28 countries sent the reports to primary and Exams secondary schools, 12 countries sent reports to the universities and 10 countries sent reports to teachers’ unions. Cambridge Internal Exam, Caribbean Advanced Proficiency Exam Caribbean Secondary Examinations Certificate With regard to comparative international Investigación Iberoamericana de Escuelas Eficaces assessments, 14v countries participated in at least one of the Laboratorio Latinoamericano de Evaluación de la assessments found listed in Table 3. Eight of those countries Calidad Educativa published the results through printed reports, three are in the PISA PISA PLUS process of generating the aforementioned report and three TIMSS 2003 countries did not compile or publish any type of printed Primer Estudio Internacional Comparativo en document containing the assessment results. lenguaje y matemática en 3o y 4o de educación primaria y factores asociados Progress in International Reading Literacy Study Dissemination of Information to Schools and Families

Although 19 countries reported that they publish education evaluation reports specifically designed for schools, only 16 provided detailed information on these reports. Using the information supplied by these 16 countries, three types of reports can be identified:

Statistical Reports: Belize, Bolivia, and Brazil provided statistical information concerning individual schools. Bolivia published 15,674 copies and Brazil published 216,000 copies.

Reports on Student Performance: These are reports that national and state (provincial, departmental, etc.) authorities provide individual schools with information about student performance as measured by national standardized tests. These reports may also contain information on exam results in other communities or regions, in order to provide a basis for comparison of schools. Examples include the Report of Results, System of Measuring of Quality of Education SIMCE, of Chile; The Report of National Evaluation of grades 2-4 of Dominica; the Report Cards with information on the performance of individual schools of the United States (shared with parents and the general public); the Results of School Advantage of México; School Report: Evaluation of School Academic Performance of Students 3rd and 6th grade of Nicaragua and other reports that were described but not specified from Canada, El Salvador, Honduras and the Dominican Republic.

Annual School Reports: These are reports that are delivered to schools at the end of a school year about particular challenges that each school faces. Here we have grouped together the reports of Jamaica, St. Kitts and Nevis and Saint Lucia. Jamaica presents reports to all schools about certain weaknesses but does not publish the report for wider consumption. St Lucia’s (End of 9

Term/Year Assessment Report) provides schools with information about individual teachers and students and simultaneously gives recommendations to schools. St. Kitts and Nevis did not detail the information sent out in their annual report.

This categorization does not completely respond to the purpose of classifying each report, but helps us identify components that can guide future efforts to systematize experiences and identify relevant lessons: dissemination of information on the behavior and composition of school enrollment in each school, dissemination of information on standardized tests on students’ performance or school achievement in each school, dissemination of evaluations of relevant aspects of the education cycle in each school.

Figure 4 illustrates sector Figure 4: Sector part icipat ion in the writ ing of t he reports for schools (# of countries) participation in the writing of the above-mentioned reports. Of 16 12 countries, 12 involved educational authorities in the drafting of the reports, while academics and 4 4 teachers participate each participate in 4 countries. 0 0 0 Concerning reports designed E d u c a t i o n A c a d e m i a , T e a c h e r s T e a c h e r s N G O s L a w m a k e r s A u t h o r i t i e sR e s e a r c h e r s U n i o n s specifically for families, only Bolivia, Canada, Chile, United States, Mexico, Peru and Saint Kitts & Nevis publish these types of reports. We can identify three profiles on dissemination practices from the information provided by the countries:

Dissemination of reports through Internet, done by Bolivia, Mexico, Peru and the United States (only the latter two countries specified that the information published on Internet for families is designed to be user-friendly and written in clear and simple language).

The second profile consists of reports based on standardized tests. Examples include Chile’s SIMCE Report for Teachers and Guardians and the use of state “report cards” in the United States. Their purpose is to inform parents on educational performance, measured at the schools where their children are enrolled. These reports include information on the behavior of performance in time, as well as their relative position in comparison with regional and nationals groups of schools.

A third profile is presented by the isolated case of Saint Kitts & Nevis, where educational authorities, teachers and principals deliver reports to parents three times per year on school performance. These reports are presented at meetings where students are also participating and where performances as well as students’ individual attitudes are discussed.

Education of the Media and Congress to ensure a correct reading and understanding of the data from the educational system

Fifteenvi countries described actions to educate media. Most of them mention press conferences where opportunities for dialogue are opened among authorities, specialists and the media on the meaning and implication of educational data. Some specific initiatives are highlighted, such 10 as permanent counseling to the press provided by Brazil’s INEP; meetings in Canada to explain to the media the information that is going to be published, detailed expositions for media delivered in Chile; workshops for journalists and press editors and with press officers from the ministries of education in Colombia and workshops for the media at the design phase in the Dominican Republic.

Tenvii countries described actions to better educate the Congress. Most of them prefer to present and explain educational information through occasional counseling sessions with the legislative committees that oversee education. Two cases that could be mentioned are the effort of INEP in Brazil to maintain a team of specialists that responds to the needs of the Congress and the meetings of the Education Committee of the Legislative Assembly of Panama within the framework of the Dialogue for Integral Transformation of the National Educational System of Panama.

Policy Purposes

The last section of the questionnaire gave educational authorities the opportunity to specify the purposes that the dissemination of information has in the broad framework of national education policies (see Figure 5). With regard to the allocation of resources, the information disseminated is not usually integrated into policies of prices or incentives for schools or teachers. This information is more frequently seen as a component used to define the allocation of compensatory resources among schools. More common purposes for disseminating information were to report on the process of school management and to foment public debate about education.

Figure 5: Policy Purposes of Dissemination (# of countries)

T o i d e n t i f y i n d i v i d u a l t e a c h e r s f o r p e r f o r m a n c e a w a r d s

T o i d e n t i f y i n d i v i d u a l s c h o o l s f o r a w a r d s

T o e n h a n c e j o i n t e f f o r t s b e t w e e n s c h o o l s a n d c o m m u n i t i e s

T o a l l o c a t e c o m p e n s a t o r y r e s o u r c e s a m o n g t e a c h e r s

T o i n f o r m l o c a l c o m m u n i t i e s a b o u t s c h o o l s ' p e r f o r m a n c e

T o a l l o c a t e c o m p e n s a t o r y r e s o u r c e s a m o n g s t u d e n t s

T o a l l o c a t e c o m p e n s a t o r y r e s o u r c e s a m o n g s c h o o l s

T o i n f o r m m u n i c i p a l o r l o c a l e d u c a t i o n a l a u t h o r i t i e s

T o r e v i s e c u r r i c u l a

T o i n f o r m c l a s s r o o m t e a c h i n g p r a c t i c e s

T o f o m e n t p u b l i c d e b a t e a b o u t e d u c a t i o n

T o i n f o r m s c h o o l s ' m a n a g e m e n t p r a c t i c e s

0 5 1 0 1 5 2 0 2 5 3 0

Conclusions

Most countries in the hemisphere annually publish statistical data on the enrollment of students in primary and secondary school. This majority also publishes basic educational indicators and produces information through the censuses of their respective countries. The sectors that receive the reports most often are the same educational authorities, other ministries and academic entities. 11

Very few countries design reports on educational assessment that are directed to the sector of parents or guardians and students.

Through an examination of the levels of sector participation in the writing of reports on the census, standardized exams and schools themselves, it can be concluded that “educational authorities” is the sector that has the highest level of participation in the majority of countries. Non- governmental organizations (NGO’s), teachers unions and legislators have a low level of participation in the writing of these reports.

Regarding the policy implications of the dissemination of educational information, the majority of countries indicated that these reports serve to inform the process of school management and to foment public debate about education. Many countries concurred that they did not use these reports to identify deserving teachers or schools for awards or incentives. Further research must be conducted to ascertain the effectiveness of these reports in improving school management and pedagogy.

Less than half of the countries in the hemisphere participate in comparative international standardized exams of student performance at the primary and secondary levels.

Approximately half of the countries of the hemisphere attempt to educate the media about the educational data published by the government. The effect of these efforts on the media and its public remain unexplored.

Only a third of the countries in the hemisphere try to implement informative activities and training for their Congresses. These countries most often present this information to the education committees within the congresses.

Very few countries have indicators that disaggregate data by ethnic group, especially with regard to the educational situation of indigenous peoples. The majority of countries with indigenous populations report their programs and modalities in intercultural and bilingual education without specifying the ethnic or linguistic group to which they belong.

0ea34ab2bf2bd039a2d403e83b0ba732.doc i Argentina, Barbados, Brazil, Chile, Dominica, Granada, Guatemala, Guyana, Mexico, Paraguay, Peru, St. Kitts and Nevis, St. Lucia, Trinidad and Tobago, Uruguay ii Brazil, Chile, Canada, Dominica, Granada, Guatemala, Guyana, Mexico, Paraguay, Peru, St. Lucia, Trinidad and Tobago iii Bahamas, Belize, Bolivia, Canada, Chile, Colombia, Costa Rica, El Salvador, Jamaica, Mexico, Nicaragua, Panama, Paraguay, Dominican Republic, St. Kitts and Nevis, St. Lucia, Trinidad and Tobago, United States, Uruguay, Venezuela iv Antigua and Barbuda, Argentina, Bahamas, Belize, Bolivia, Brazil, Canada, Chile, Dominica, El Salvador, Granada, Guyana, Honduras, Jamaica, Nicaragua, Paraguay, Peru, Dominican Republic, St. Kitts and Nevis, St. Lucia, Trinidad and Tobago, United States, Venezuela v Argentina, Belize, Bolivia, Brazil, Canada, Chile, Colombia, Honduras, Jamaica, Mexico, Paraguay, Peru, St. Lucia, United States vi Antigua and Barbuda, Argentina, Belize, Brazil, Canada, Chile, Colombia, Costa Rica, Jamaica, Mexico, Nicaragua, St. Kitts and Nevis, Suriname, United States, Venezuela vii Antigua and Barbuda, Belize, Brazil, Chile, Honduras, Panama, Paraguay, St. Kitts and Nevis, United States, Venezuela

Recommended publications