Pakistan Radio: A Forum for Moderate Voices Project Evaluation Report
Submitted to: Search for Common Ground-Pakistan
Submitted by: National Defence University & Quaid-e-Azam University, Islamabad -Pakistan
Table of Contents
Executive Summary ...... 1
Introduction ...... 4
Evaluation Scope and Methodology ...... 4 Scope ...... 4 Objective of the Evaluation ...... 5 Methodology ...... 5 Research Tools ...... 5 Locale ...... 5 Sources of Information ...... 5 Means of Analysis ...... 7
Project Overview ...... 9 Project Objectives ...... 10 Project Deliverables and Activities ...... 10 Additional Activities under R4PB ...... 11
Project Evaluation ...... 12
Evaluation Overview ...... 12
ii
Evaluation of Trainings and Coaching Sessions ...... 12 Evaluation of Administrative Affairs of the Project ...... 15 Evaluation of Programs Produced ...... 17 Evaluation of Training Manuals ...... 20 Evaluation of the Impact of Rabita Programs on Masses ...... 20
Conclusion ...... 25 Outcomes and Achievements ...... 25 Success Stories ...... 26 Challenges ...... 26 Recommendations...... 27
Annex I ...... 28
Annex II ...... 30
Annex III ...... 32
iii
Executive Summary
This is an evaluation report undertaken by Department of Peace and Conflict Studies, National Defence University, and Department of Statistics, Quaid-e-Azam University, Islamabad-Pakistan for Search for Common Ground's (SFCG) project on “Radio for Peacebuilding”, a project funded by Dutch Ministry of Foreign Affairs, Netherlands.
Search for Common Ground (www.sfcg.org) is an international, non-governmental organization whose mission is to change the way the world deals with conflict, away from adversarial approaches toward cooperative solutions. SFCG has been working in the field of conflict transformation for 26 years.
The 'Radio for Peacebuilding' project has three major components – development and adaptation of guidebooks on radio talk show production aimed at Peacebuilding into Urdu and Pashto, training and coaching provided to FM station producers and presenters to host radio talk shows on Peacebuilding and finally production of talk shows using the common ground approach. While implementing this project, SFCG partnered with the Uks Research, Resource and Publication Center on Women and Media, and Intermedia Pakistan.
The report is divided into four major sections: Introduction, which describes the basic objectives of the program and the evaluation process; Project overview which elaborates on the project itself; Project evaluation which describes the findings and describes the evaluators' opinions on the basis of findings; and finally conclusion and recommendations based on all the other sections.
SFCG has had success in 'Radio for Peacebuilding' in Africa and Nepal. The initiative in Pakistan was aimed at contextualizing the process and use radio to promote moderate voices and fight extremism and intolerance. There have been some major accomplishments of the program which are described as follows:
Major accomplishments –
The guidebooks are one of its kind produced in Pakistan. There are no other reference materials for radio talk show producers and presenters on the areas of conflict and Peacebuilding. The guidebooks are relatively easy to understand and have used Pakistani examples. Given this adaptation, these guidebooks have the potential of being used by Pakistani radio professionals.
Another major achievement of the project is creation of a peace community on air through formation of the alliance among all the FM radio stations. SFCG is privileged to pioneer not only the project of Peacebuilding in Pakistan but also form the biggest radio peace alliance in Asia.
The promised number of trainings were four (3 primary level and 1 advance level) yet SFCG conducted two ToTs for their partner organizations as well as PBC producers (Annex I) which was neither committed to the donor nor envisioned in the initial phase of project implementation, but these training seemed valuable in ensuring concept clarity and expanding the reach and sustainability of the project even beyond project duration.
The Focus Group Discussions (FDGs) – used by the evaluators as tools – showed that there was a palpable change in the attitudes of trainees about issues of peace and conflict, extremism and tolerance and as well as a very positive change in their behaviors in producing and broadcasting their programs with respect to choosing issues and using language. Their skills and the incorporation of their skills in producing programs on issues directly related to peace, and sensitive issues of conflicts were also evaluated through production of mock-shows, which the trainees conducted 1
commendably. The problems identified in this regard had more to do with the cultural and political environments in which the programs are produced. The unanimous opinion from all the participants entailed that the trainees benefited immensely from the suggested models and tools of conflict mapping and analysis and KAB, Conflict Tree and SWOT (Strengths, Weaknesses, Opportunities and Threats) were entirely new learning methods for them which some of them utilized and integrated to their working assignments (both radio programs and curriculum development in the institution) after attending the sessions.
Coaching phase was appreciated by participants as an innovative means of follow up. The participants were of the opinion that the coaching phase was like refresher training and respondents said that the coaching phase was helpful in identifying exactly how to implement what they have learnt during the training and design Peacebuilding talk shows. Some of the trainees even said that keeping in view the applied approach used during the coaching sessions, they at times felt that the coaching sessions were even more beneficial than the trainings. This view is also understandable due to the fact that coaching sessions seemed more interesting and beneficial to certain participants because the trainings had already laid out certain foundations, which the coaching sessions built upon. Moreover, the applied and issue oriented sessions on individual basis with the participants may also be the factors behind such a view.
In terms of production of talk shows, 125 Rabita programs were produced as compared to 120 programs that were committed in the proposal. In addition to that Pakistan Broadcasting Corporation (PBC) producers produced 34 programs, an initiative by SFCG Pakistan though not promised in the proposal but was undertaken to expand the reach and sustainability of the project. Therefore, training and coaching phase had a success rate of 100 % which is a very high percentage given the first attempt and scale of the project. A survey that included 541 respondents was also carried out and it showed that 27% of respondents listened to talk shows as their first priority, 13.5% of all respondents had listened to Rabita, of which 16% followed it regularly, and a majority of those who had listened to the programs admitted being positively affected by the content.
Impacts and lessons learnt – While accomplishments are important in terms of outcomes that can be quantified, the evaluators believed that the actual accomplishments come in the form of impact of the whole process. Following are the major impacts that can be described for the project:
SFCG has been able to sensitize and create awareness amongst the radio producers and presenters of their role and the role of radio talk shows on Peacebuilding.
With the initial support of SFCG, talk shows aimed at Peacebuilding have been initiated and in some FM stations have been continued even after the support has been withdrawn.
The project has also created a one of a kind, reference material in Pakistan for Radio talk show hosts interested in Peacebuilding programs.
SFCG conducted two national summit of Radio management from all over Pakistan at the beginning and end of the project which involved the station managers at the very beginning of the project and formalized their involvement through MOU's, which developed a strong support for the project even after its ending. SFCG has created a general goodwill amongst its stakeholders and is viewed positively.
2
In order to improve the quality of shows, constant monitoring and feedback mechanism, at least for the initial six months, needs to be developed. Without long term engagement, the quality of shows will decline as the space between participant’s training and radio show production increases.
Issues and Recommendations – Overall, the issues identified and recommendations made can be summarized as follows:
For the trained radio presenters to master the art of using the common ground approach on their radio shows, they require a lot more investment in terms of training and coaching.
In order to penetrate at larger scale and to continue working with all the conflict zones of Pakistan, SFCG should expand the existing training programs for producers and presenters through continuation of the existing and experiment a variety of the project activities.
There is no denying fact that discussion programs can be very effective medium to spread the message of mutual coexistence, accommodation, tolerance, respect of divergent views, and peace in our fragmented society. However people are generally more interested in entertainment/music programs when it comes to FM broadcasts.
Given the nature of the project –Radio for Peacebuilding, can be considered a success in terms of achieving its objectives and sensitizing its target audience of radio professionals. As in any other case, the impact of radio programs on the listeners is difficult to measure. However, a listener's' survey conducted of Rabita programs that included 541 respondents showed that 27% of respondents listened to talk shows as their first priority, 13.5% of all respondents had listened to Rabita, of which 16% followed it regularly, and a majority of those who had listened to the programs admitted being positively affected by the content. However sustained results at least once a year a survey on SFCG supported programs would help put plans in perspective and devise further strategies for SFCG.
3
Introduction
SFCG – Pakistan initiated and implemented a project “Pakistan Radio: A forum for Moderate Voices in Pakistan (also known as Radio for Peacebuilding - R4PB)” in collaboration with Intermedia: Empowerment through Information and UKs: A Research, Resource and Publication Center on Women and Media, in Pakistan. The project has successfully been completed with all objectives obtained throughout 14 months (i.e. 23 November 2009 – 31 March 2011). The focus of R4PB was to provide an effective platform for radio producers and presenters to introduce and practice non-adversarial approaches to peace and bring social change through such capacity building in local communities. SFCG – Pakistan was established with the greater vision to produce common ground approaches, introduce peace as essential and inherent element to Pakistani society and making the people aware and believe that peace is not an impossible entity for Pakistan. It may take a decade of continuous efforts to bring positive change and making people work for peace; hence SFCG has taken the initiative and created a group of media professionals to contribute to serve the purpose through radio programs.
SFCG along with its local partners conducted various activities comprised of baseline survey to map media professionals, program content, format etc prior to any other project activity, three primary trainings, one advance level training, two national summits, two ToTs, coaching and capacity building activities. The greatest achievement of the project is creation of a peace community on air through formation of the alliance among all the FM radio stations. SFCG is privileged to pioneer not only the project of peacebuilding in Pakistan but also form a radio peace alliance in Asia.
Since SFCG is an international organization working for peacebuilding and conflict transformation through collaborative approach rather than confrontational or adversarial, its values and work ethics are stronger and competitive. In this regard, R4PB fulfilled all the commitments made to the donor and also conducted those activities which were not included as part of the contract with the funding organization. Not only the promised number (120) of “Rabita Program” was produced and broadcasted but also a series of participatory and interactive trainings for producers, presenters and trainers were arranged and well attended. The training methodology ranged from smaller role-plays and simulations to mock shows on topics of contemporary importance and value. Moreover, coaching sessions were given to the participants in order to facilitate them to produce and host discussion program in a specific direction, integrating concepts and notions of peace, Peacebuilding and conflict transformation. The greatest achievement of the project is creation of a peace community on air through formation of the alliance among all the FM radio stations. SFCG is privileged to pioneer not only the project of Peacebuilding in Pakistan but also form a radio peace alliance in Asia.
1. Evaluation Scope and Methodology
1.1. Scope
The purpose of this evaluation was to study and examine the project Radio for Peacebuilding Pakistan, implemented by Search for Common Ground (SFCG) Pakistan, along with its partners. The evaluation aims at presenting a thorough appraisal of the project in order to inform the funding agency, SFCG Pakistan, and other affiliates, of the strengths, weakness and overall impact of the project, while providing recommendations for improvement of the project.
Pakistan, at the moment, finds itself in unstable situation with the state and society rife with political, ideological and structural problems. In this situation, there are various attempts underway to somehow rescue the state from falling prey to the myriad problems and faultlines it is threatened with. SFCG, having
4
identified a possibility for change, aims to contextually replicate in Pakistan its previous successful venture in Nepal, through Radio for Peacebuilding project.
1.2. Objectives of the Evaluation
a) To assess the effectiveness of the project (i.e., the extent to which the project stated objectives are being/have been achieved or can be achieved).
b) To assess the effectiveness and appropriateness of the training, coaching (with reference to trainees’ development) and entire process of technical production, chains of talk shows starting with topics, broadcasting, and feedback.
c) To assess the impact of the project on the listeners.
d) To examine the project’s technical and nontechnical aspects, and provide a broader picture for the project intervention, exploring the relationship between the technical and nontechnical aspects.
e) To provide recommendations for suitable adjustments to the projects, in line with the needs on the ground, keeping in view the wider purpose of Radio involvement in peace and conflict resolution.
1.3. Methodology
The research adopted an Evaluative Research method (Summative type) and used scientific- experimental models (for control group exercises, mock shows), qualitative/anthropological models (for interviews, FGDs, content analysis), convenience sampling for surveys, and participant-oriented models (targeted audience interviews) in order to carry out the study.
1.4. Research Tools
The research although primarily qualitative also incorporated quantitative methods like descriptive statistics and graphical representations.
1.5. Locale
The study was carried out at three stations – Islamabad, Karachi and Lahore, where evaluators conducted Focus Group Discussions, Experimental Group Exercises, and Surveys. The sessions for participants from Khyber-Pakhtunkhwa (KPK), FATA, Azad Kashmir were held for Islamabad due to proximity. The field work was carried out in the three cities due to volatile situation in the country esp. in KPK and FATA.
1.6. Sources of Information
a) In-depth Focus Group Discussions with radio producers and station managers: The trainees were divided into different groups that discussed
given themes. A moderator facilitated each group and conducted one-on-one as well as group discussions. The themes dealt with issues ranging from the backgrounds of
the trainees to the content of the training sessions, performance of the trainers, their acquaintance with concepts of peace and concepts, and their cognitive and/or behavioral FGD with Radio Producers and Stations development and change. Managers of Sindh 5
b) Interviews with Trainers and Staff: The trainers who participated in the project were also contacted and interviewed in order to take their inputs about the project, and assess the appropriateness of the choice of trainers. The SFCG staff involved in the project was also interviewed for its perspectives about the project, discussing the administrative issues, and exploring the problems and challenges faced during the course of the project.
c) Mock-shows:
The trainees at all three stations were given situation- based tests in the form of mock-shows. They were provided with definite topics and a limited preparation time to arrange a 25-mintue program. The programs were then performed and evaluated based on observation techniques. The exercise aimed at assessing both the
cognitive and behavioral changes in the trainees due to the training.
Mock Show: Mr. Feica- Mast FM 103 Karachi
d) MCQ Test: The cognitive or content-based learning of the trainees was evaluated using written tests consisting of 15 multiple Choice Questions. These questions were obtained from the training manual that was used in the training. e) Surveys: The informal survey was carried out at three different locations across the country – Islamabad, Lahore and Karachi. A sample of 541 respondents was selected to study the impact of Rabita program. The sample was selected using the convenience sampling method1.
Demographics:
The sample was divided into two parts: Educated (University Students, Urban Professionals) and Uneducated (Taxi and Bus Drivers, Waiters, Laborers etc.). Other demographic variables included in the survey were age, gender, city, religion, sect and ethnicity. The sample was chosen on the basis of assumed frequency of radio listenership, keeping in view that nowadays, the major sources/places of radio transmissions, are cars, mobile phones, and radios in roadside restaurants.
Descriptives:
The basic instrument of data collection in the survey was a questionnaire regarding the impact of Rabita program. The results were interpreted using descriptive statistics.
1 Keeping in view the large population and temporal delimitations, the following formula was used to calculate the minimum sample size per city to represent the population:
Z = 1.96, p = 0.1, q = 0.9, e = .05
Here, p represents the proportion of listeners in the population. It is assumed to be 10% of the population, i.e. 0.1. Similarly, q represents the proportion of non-listeners. With a 95% confidence level, and a tolerable error of 5%, the normal distribution variable Z is calculated to be 1.96.
6
f) Experimental Group Exercises:
The experimental group exercise was carried out on university students in Islamabad Lahore and Karachi.
The sample size was 130. Post-test questionnaire-based data was collected after airing a sample of the Rabita program. Similar to the informal survey, the demographics and data collected in the experimental group exercise were interpreted using descriptive statistics.
Experimental Group Exercises
g) Content Analysis of radio programs: The evaluators also conducted content analysis of a large proportion of the talkshows produced and presented by the trainers from various radio stations. In total, the evaluators carried out content analysis of 100 talkshow programs originally in Urdu, Pashto and Sindhi. The sample constitutes 75% of the total programs produced and also received by the evaluators in digital form.
The programs were analyzed against a set of 10 ‘tools of analysis’ developed to test the technical aspects of program production, quality of production, presenter’s performance, knowledge of issues, incorporation of peace messages and neutralization of conflict/violence messages.
h) Other Sources: Other sources for data collection included training manuals, training session reports, previous evaluation reports, and other necessary documents.
1.7. Means of Analysis
Instruments and Tools: appropriate statistical packages; concepts and approaches to peacebuilding and conflict transformation2; core-team discussions.
The analysis was aimed at:
a) Gauging the effectiveness of the trainings conducted by SFCG in view of impact on the trainees and their learning through tests and observation.
b) Thorough content analysis of a large sample of recorded programs produced after the trainings, in light of the relevant concepts and theoretical orientation of Peacebuilding and Conflict Transformation as well as the content of the trainings imparted.
c) Judging the relevance of the content of programs with the respective local cultures, values, sensitivities and issues (latent as well as incumbent) through comparative analysis.
d) Analysis of interviews and inputs from FGDs through observation and comparative analysis.
2 Peacebuilding and Conflict Transformation are part and parcel of Peace Studies and Conflict Resolution. See Glossary for the definition of Peacebuilding and Conflict Transformation.
7
e) Analysis of survey results, and experimental group exercises using appropriate statistical packages to demonstrate the results of the data collected through descriptive statistics.
In order to increase relevance and precision in evaluation, the evaluators linked each of the sources of information to the respective objective being met. Table 1.1 illustrates the sources of information used along with the questions that were used for data collection as well as analysis, and served as the standard line that kept the research and evaluation process on the right track.
Table 1.1 Evaluators’ Questions , By Objectives Sources of Questions Target Objective(s) Being Met Information Focus Groups How much and in what Trainees (producers, To evaluate the trainers, Discussions ways have the trainings presenters and station trainees and training affected the trainees? managers) sessions How do the trainees see To provide the trainings and recommendations for trainers? selection of trainees, trainers & adjustment of training
Interviews Which learning theory was Trainers; SFCG Staff To examine the project’s used for training? technical and nontechnical What were the selection aspects criteria for partners in To provide project and trainers? recommendations for What were the problems improvement in training and challenges? content and pedagogy Mock Shows What are the insecurities, Trainees To evaluate the capabilities inhibitions and of the trainees reservations of the trainees To discover the problems with respect to political trainees face in their issues? respective areas How much of the trainings To provide do/can the trainees recommendations reproduce? Surveys Who listens to radio and Educated and Uneducated To assess the reach and Rabita? samples from populations impact of the programs and Where is radio listened to in Karachi, Lahore, radio as a medium more, and which channels Islamabad and Rawalpindi To provide are more popular? recommendations for How and how much does suitable programs, Rabita influence people? program themes, channels and broadcast timings Experimental How does the programs Student Groups in Karachi, To assess the effectiveness Group Exercises impact direct audience? Lahore and Islamabad and impact of a program How much do the programs affect them? What kind of messages do they receive from the 8
programs? Written MCQs Basic and relevant concepts Trainees To evaluate the trainees and Test of Peacebuilding and test their concepts of Conflict Transformation Peacebuilding and Conflict Transformation Content How and how much do the Trainees (on the basis of To assess the effectiveness Analysis programs reflect trainings the programs and mock- and impact of programs, and concepts? shows ) capacity of the trainees and How well can the trainees quality of radio production reproduce what they are and broadcast taught? To provide How can program recommendations for production and theme improvement of the selection be improved? program content, themes, production and presentations through training
Content What were the proceedings SFCG Team; Trainers; To examine the project’s Analysis of of the training sessions? Trainees technical and nontechnical Training What was the content of aspects manual, the training manuals? To provide Training recommendations for Reports improvement
2. Project Overview
The Pakistani society is rife with protracted political and socio-cultural ailments. While traditional security measures have continued to take place in order to respond to such threats and issues since long, limited has been done to safeguard non-traditional security interests in the country. Search for Common Ground - Pakistan (SFCG) made its entry in late 2009, with the vision to bring a shift in people’s perception on conflict and violence from adversarial to cooperative problem solving. SFCG believes that conflict is not bad always; its energies can best be utilized through collaboration and cooperation rather than typical confrontation. For this purpose, SFCG initiated and implemented a project “Radio for Peacebuilding (R4PB)” in collaboration with Intermedia: Empowerment through Information and UKs: A Research, Resource and Publication Center on Women and Media from 23 November 2009 and extended till 31 March 2011 in Pakistan. SFCG has endeavored to build peace through enhancing constructive role of media and encompassing capacity building in local communities through collaborative approach towards peace. The common ground approach entails making people believe that there is always a chance of peaceful coexistence and difference of opinion does not necessarily commence or mark beginning of a conflict. The R4PB project aimed at creating awareness about peacebuilding and conflict transformation by utilizing the strength of the most popular and accessible media platform i.e. Radio. Since radio is one of the most powerful and accessible tools to reach out masses with messages of positive notions, tolerance, peaceful co-existence and harmony, the project was successfully implemented and completed in different areas of Pakistan, ranging from metropolitan cities to less developed rural areas. The project was implemented by utilizing four major tools to build peace in Pakistan, which were; i) building a peace community on air through forming an alliance of FM radio stations; ii) training of the radio professionals throughout the country; iii)
9
coaching of the trainees; and iv) an agreement with the participating radio stations to launch a series of radio discussion programs with the name “Rabita”.
2.1 Project Objectives
SFCG carried out the project activities in order to obtain various objectives. The primary purpose of all was to utilize the most powerful and accessible medium of communication i.e. Radio to convey the message of peace and create opportunity and option for common ground approaches to prevail through creative and indigenous problem solving. The idea was to equip radio producers and presenters with the non-adversarial approach towards conflict mitigation.
The objectives to launch and implement this project in Pakistan were:
1) To encourage a shift in attitudes in selecting radio broadcasters, towards facilitating constructive and culturally sensitive dialogue on key, often controversial issues relating to human rights, gender equality, domestic conflict, democratization, minorities, social development, political participation, and others. 2) To provide exposure to radio audiences of participating stations in a constructive, non-violent problem-solving model by making use of participating radio stations as forums for bringing together diverse voices – civil society, community and religious leaders, government officials, academics, etc – with a focus on understanding the differences and highlighting the commonalities.
2.2 Project Deliverables and Activities SFCG - Pakistan sub-contracted with two local non-government organizations namely UKs: A Research, Resource and Publication Centre for Women and Media, and Intermedia: Empowerment through Information. The partner organizations implemented R4PB and conducted activities under the project. The 14 month long project consisted of various activities including the promised deliverables and additional activities (for details, see Annex I), such as; a radio networking event to give orientation about R4PB, an exclusive Training for Trainers (ToT) for partner organizations, three primary level trainings for the radio producers and presenters, one advance level training of the shortlisted participants from the three initial trainings, two national summits for the senior management of the participating radio stations, and one last Training of Trainers (ToT) of the Pakistan Broadcasting producers and presenters whereby 24 participants were trained. Besides, SFCG extended its coaching services to the radio professionals for better and accurate productions of the discussion programs at the participating radio stations. The project achieved all the deliverable targets within the timeframe. SFCG Pakistan also employed target oriented marketing strategy and got the promotional material printed, adequate publicity was given to the project details on other media platforms including electronic and print.
The deliverables committed to the donor organization and which SFCG successfully executed and delivered during the project implementation were:
1) A Baseline Survey/Assessment was completed through a third party pole to
2) level and quality of the existing radio programs, identifying needs of programs and productions and contextualizing gender participation.
3) 60 radio producers representing 46% of all radio stations in Pakistan, including 50% of stations in NWFP, FATA and Baluchistan (10) and the remainder (50) drawn from other Pakistani provinces as well as Pakistan administered Azad Kashmir, trained in techniques for using radio as a forum for promoting conflict mitigation, the rule of law, and full social
10
participation through 3 1-week (7 day, 8 night) training workshops. Three primary level trainings were conducted for the producers and presenters in 14 month time span.
4) 40 producers and presenters (selected from the initial 3 workshops and out of which 37 participants could make it to the advance level training) received additional practical training as part of hands-on workshops resulting in the creation of talk show program templates used by participating radio stations for actual radio programming. One advance level training as well as follow up coaching sessions were given to the selected participants.
5) 1 guidebook/manual for radio journalists and producers with a focus on de-radicalization published in Urdu and Pashto languages and disseminated via the project’s website and in print (1,500 copies).
6) 120 radio talk show episodes named “Rabita” (40 radio stations x 3 episodes) produced and broadcasted at the national/ local levels through community, public and private FM stations in Pakistan.
2.3 Additional Activities under R4PB
SFCG did not only carry out the promised project activities but also expanded the deliverables to two National Summits as well as two ToTs (for details see Annex I).
1. The National Summit I was organized on 19 June 2010 in Islamabad for the radio stations and greatest alliance of FM radio station was formed for the very first time in Asia. Memorandum of Understanding was signed between SFCG and FM radio stations to promote ‘community of peace on air”.
2. The National Summit II was arranged on 20 January 2011 in Karachi to ensure and discuss the experience of radio stations to broadcast Rabita program. SFCG also discussed the sustainability of the programs after the successful completion of the project. The participants shared their experiences of understanding the concepts and differences of conflict and violence and discussed the ways to promote and strengthen peace community on air.
3. First ToT was organized on 29 May – 1 June 2010 in Islamabad for the local partner organizations (Intermedia and Uks) to sensitize them with SFCG vision and goals. The orientation lessons were also given with a view to familiarize them with the envisioned R4PB project activities in Pakistan.
4. Second ToT was conducted on 26-29 January 2011 in Islamabad for Pakistan Broadcast Producers to further improve the production of Rabita program.
SFCG enjoys the privilege of introducing practices of Peacebuilding for the very first time in Pakistan. The nation has been going through conflict situations and violence since long yet peace is not impossible in the region. Peacebuilding is a natural process and chances of having and blossoming peace are not bleak in the country. The people in Pakistan need to be taught the concept of co-existence with the differences through greater cooperation and finding common grounds. SFCG and its conducted activities discovered a profound scope in the Pakistani society for peacebuilding and transformation of people’s perception on peace.
Conflict Transformation and Peacebuilding, in its essence, is a long term and result oriented process that may take decades. In order for such a process to be fruitful, it is imperative that it continues unhindered. For the very reason, it seems unfair to judge and evaluate the effectiveness of the project implementation just after a year time span, the evaluation findings suggest that R4PB turned out a great success so far, with few 11
technical and structural shortcomings. However, the report concludes with specific recommendations to make it a continuous process in a conflict-stricken country like Pakistan.
3. Project Evaluation
The socio-cultural fabric of Pakistani society is knitted with rich ethnic and sectarian diversity. A single conflict brews up with several underlying dimensions hence providing a rather smooth ground for its sustenance and perseverance sans management or sometimes ill management by the concerned authorities. However, conflict mitigation could evolve and prevail in the society by hitting the targeted recipients and affectees (of the conflict) at the bottom to top layers of the society. Quite timely and appropriately, SFCG has taken the initiative to build peace by taking grass root actors on board of the agenda. The R4PB has been able to accomplish what SFCG has envisioned prior to launching the project in Pakistan. It has expanded the project to additional activities along with the deliverables committed to the donor organization at the time of contract. The tools of analysis utilized for this evaluation, were: Focus Group Discussions, experimental exercises, interviews with trainers, trainees and staff of SFCG, mock shows, and MCQs exams of the trainees, informal surveys, content and quality analysis of radio programs, evaluation of training manuals, reports of the primary and advance level trainings, feedback from the trainees, assessment of the trainees by the trainers etc. The evaluators followed specific means of analysis such as conceptual orientations of peacebuilding, conflict transformation and conflict prevention, retrospective or prospective reconciliatory paradigms in the relationship between different groups and individuals and the technical savvy of media theory and practice through which production and quality of ‘Rabita’ (contact/connection) program has been assessed.
The project R4PB was evaluated through diverse sources of information and means of analysis. The following section entails analysis on the targets and objectives achieved during the specific time period.
3.1. Evaluation Overview
As stated earlier, the evaluators used various sources and techniques for data collection, and employed several data analysis mechanism. The detailed appraisal and evaluation of the project, categorized in the format project activity, with reference to Source of Information, Objectives and Results is given below.
a) Evaluation of Trainings and Coaching Sessions
SFCG implemented the project with the similar activities for the selected radio producers and presenters in the country, cautiously made selections that equally represented each province, ethnicity and culture from different parts of Pakistan. Two of the main activities of the project were training and coaching sessions, which were separately and repeatedly held by SFCG and its partners.
In order to evaluate the trainings and coaching sessions, the evaluators used numerous tools mentioned below.
Sources of Information
i. Focus Group Discussions: FGDs were conducted on various themes in order to know about the trainings imparted, coaching sessions, evaluate the capacities of the trainees, and gauge the changes in their knowledge, attitude and behavior.
ii. Interviews with Trainers, Trainees: The trainers and trainees were interviewed in order to gather first-hand information about the happenings of the training sessions, coaching sessions, ToT sessions, and national summits, and take their perspectives on the project, while also evaluating the primary actors of the project – trainers and trainees – and their selection procedure. 12
iii. MCQ Test: A written MCQ test was administered in order to know how much had the trainees learned about the basics of peace and conflict, the result of which would obviously be reflective of their learning through training and coaching. Table 3.1 Sources of Information Table 3.2 a) Focus Group Discussions
Tools of Analysis b) Interviews a) Observation c) Informal Surveys b) Statistical Packages d) Experimental Group Exercises c) Discussions e) Content Analysis of Rabita Programs
d) Referential Content f) Content Analysis of Manuals and Analysis using theories Reports e) Cross-examination
Observations from the Focus Group Discussions, Interviews with Trainers, and Trainees
Trainings: R4PB conducted two types of trainings for both trainers and trainees; which included two ToTs (for trainers) and three primary level trainings (7 days each in Karachi and Islamabad) and one advance level training (4 days in Islamabad) in different time periods (see Annex 1 for details). The reason behind conducting two ToTs was to train the partner organizations and senior management of PBC (in another ToT in January 2011) to familiarize with the agenda and the format for the further proceedings of the project (i.e. training sessions for the potential/desired trainees).
In ToT (29 May – 1 June 2010), Yubakar Raj Rajkarnikar3 was invited as a trainer and the feedback of the partner organizations (UKs and Intermedia) was positive and encouraging. The training material and sessions were helpful and up to the satisfaction of the participants and the medium of instruction was English, yet, Hindi/Urdu was also used as per requirement of the participants.
On primary level trainings, two kinds of responses on the content and effectiveness of the sessions were generated through FGDs. While majority of the trainees opined that the sessions were helpful for them grasping theoretical notions of peace and role of media in peacebuilding process, few also said they were already equipped with the said concepts and their understanding was enhanced further after attending the training sessions. In view of the trainees, they already knew the former and used to include them in their discussion programs even
Focus Group Discussions
3 Mr. Yubakar Raj Rajkarnikar was serving as Media Manager at SFCG – Nepal.
13
prior to attending SFCG trainings. Yet such concepts were conceptualized with technical terms and jargons only after attending the three primary level training sessions. Hence, during interview with SFCG Staff, the evaluators were told that participants from PBC in (January 2011) had better understanding and awareness of the issues and peace concepts.
The unanimous opinion from all the three centers entailed that the trainees were benefited immensely from the suggested models and tools of conflict mapping and analysis and KAB, Conflict Tree and SWOT (Strengths, Weaknesses, Opportunities and Threats) were entirely new learning methods for them which some of them utilized and integrated to their working assignments (both radio programs and curriculum development in the institution) after attending the sessions.
Trainees from Lahore and other stations from interior Punjab admitted that the sessions taught them some very new concepts especially the linkage between social development, justice and peace. Similarly, a trainee from Umarkot4 put it by sharing personal experience that her understanding of peace was confined to the symbol of ‘peace dove’ prior attending the SFCG trainings. The notions of tolerance, peaceful coexistence, interfaith dialogue and harmony got clearer perception through the imparted trainings. Another trainee from Ghotki5 station viewed the sessions as technical to provide the radio programs with precision, focus and a genuine balance between arguments from all guest speakers.
The evaluators also asked the trainees if they have got some attitudinal shifts in their thinking process and they candidly said trainings were a great help for speeding up positive thinking.
The three primary or initial level trainings may be termed as successful in terms of methodology, interaction, skill exercises and substance. The advance level training also met the expectations of the shortlisted participants from 40 radio stations. The initial trainings and the trainers received laudatory comments from most of the trainees during and after the training sessions. Trainers from partner organzitions; UKs and Intermedia and SFCG staff were rated as good trainers according to the trainees and evaluators.
On the content and explanation of the concepts during the trainings, the trainees viewed the substance which was more related to educational concepts (like peacebuilding and conflict, violence etc) rather than technical such as how to improve sound quality of a radio program etc. Therefore the concepts could not correspond to their conventional wisdom, educational background and their expectations to the trainings which they anticipated to cater all technical and scientific aspects of radio technology.
In ToT (Annex 1), trainers received adequate trainings and orientation to conduct primary and advance level trainings in the proceeding time period of the project. During primary and advance level trainings, trainers followed the manuals given to them and tried to warm up the sessions through small exercises making propitious use of flip charts and other tools. Hence it was also observed that the trainers kept a fine balance between conceptual understanding of peacebuilding and media techniques.
While the training sessions emphasized exclusively on basic conflict analysis, the coaching lessons endowed conspicuous credence to conflict resolution mechanisms through creative problem solving (See Annex III - Glossary) to be included in the talk shows. The trainees incorporated the notions of peace and adopted problem solving approach to present and produce radio programs. The coaching lessons were capable in bringing importance of local issues in selection of themes for programs, for instance, the producers and presenters were taught to identify role of spoilers and facilitators in talk shows.
4 Sajida Sumbal
5 Samina Naz
14
An MCQ test (Annex II) was also administered in order to evaluate the basic conceptual understanding of the trainees, and hence their learning through the training and coaching sessions. The exam was prepared with the help of the concepts given in training manuals and handouts provided to the trainees during the sessions. The test was of 15 marks and 27 trainees took the exam. The outcome of the exam was a mix in which one participant obtained 86.67 %, six secured between 70 to 79%, while another six got between 60 to 64% marks (Figure 1.1). The rest of the trainees achieved average and less than average marks. The findings of the tests are as follows in figure 1.1:
Figure 1.1
7 No. of Trainees 6 5 4 3 2 No. of … 1 0 85 and 80 to 70 to 65 to 60 to 50 to 41 to 40 and Above 84 79 69 64 59 49 Below
Coaching: The partner organizations UKs and Intermedia conducted coaching sessions for the trainees in different parts of Pakistan during December 2010 – January 2011 (Annex 1) on technical and non-technical aspects of radio productions. The interviews with the trainees reflected that themes related to peacebuilding were covered and technical aspects to produce and host a radio talk show on issues of sensitive and critical orientations under a non-confrontational perspective was given during the coaching sessions.
Some of the trainees even said that keeping in view the applied approach used during the coaching sessions, they at times felt that the coaching sessions were even more beneficial than the trainings. This view is also understandable due to the fact that coaching sessions seemed more interesting and beneficial to certain participants because the trainings had already laid out certain foundations which the coaching sessions built upon. Moreover, the applied and issue oriented sessions on individual basis with the participants may also be the factors behind such a view.
In brief, the coaching sessions had a positive and lasting impact on the trainees and their programs, and the exercise was a necessary and laudable one as the follow up of the training sessions.
b) Evaluation of Administrative Affairs of the Project
Interviews were conducted with the trainers, trainees and local staff at SFCG to find out challenges and problems faced by SFCG, the criteria used for selection of partners and trainers, the grip of trainers over concepts of peacebuilding and conflict transformation, the training methodology to train media professionals, quality of coaching given to trainees during the project implementation
15
Sources of Information
i. Interviews of SFCG Staff and trainers: The members of SFCG staff and some trainers were interviewed in order to examine the selection criteria for the trainees, partners in project and trainers, and to find out the administrative, logistical problems and challenges faced during the project.
ii. Interviews of trainees: The views of trainees were also taken into account in order to evaluate the administrative affairs of the project. Their perspective was also important since they were the recipients during this project.
Observations from the Interviews
Following are the results of the interviews and the observations of the evaluators regarding the objectives and questions for evaluation.
Problems and Challenges for SFCG: Local staff at SFCG was interviewed to know the problems and challenges faced during the project implementation. Keeping in view that SFCG was the only organization that introduced peacebuilding in Pakistan; the challenges for R4PB were natural and anticipated during the initial phase of the project. In order to cope with those challenges, SFCG employed an effective marketing strategy to make the people aware of the importance of peace in Pakistani social context. For example, after every training, SFCG made sure that the press releases about the trainings and summits were issued to the well known newspapers of Pakistan, promos went on air right before every Rabita program. One of the pioneering staff of SFCG also said that the most challenging task during the initial phase of this project was that people used to get suspicious about the concept of having or discussing peace in Pakistan. Despite being a conflict prone society, a bulk of population did not have any understanding of peacebuilding in Pakistan so such kind of responses from the people were anticipated by SFCG and partner organizations. However, SFCG along with its implementing local partners coped with such challenges in a systematic manner. During FGDs, Trainees also admitted that their perception on the peacebuilding training was totally changed after receiving the first primary training under R4PB and evaluators noticed palpable change of their behavior towards peace and the contexualization of the notions and peace messages they catered during the focus group discussions.
Selection of Partner Organizations, Trainers and Trainees: The selection of partner organizations was done by SFCG – Pakistan by floating Expression of Interest to identify potential partners. Almost 20 organizations applied and SFCG selected Intermedia and UKs for their reputation, experience in media trainings, and their well-established contacts in the media industry. Intermedia had greater outreach in KPK, FATA, Baluchistan, AJK and Islamabad and UKs had an easy access to Punjab and Sindh. UKs was also given priority for its reputation to include gender component to its nationwide trainings. The trainers were selected by the partner organizations independently. The trainees for primary level trainings were selected by adopting and following certain criteria which was promised with the donor as part of the commitment. It entailed the experience of the trainee as a full-time radio producer or presenter, who has worked at radio as a committed and determined professional not a part-timer etc, ethnic and religious diversity, proper participation from all radio stations, provinces etc. For advance level training, selections were made by the partner organizations on the basis of their interest, passion and performance in the earlier training sessions.
Administrative affairs and arrangements: The trainees were also quite satisfied with the manner they had been looked after, organizationally as well as intellectually, during the course of the project. The logistics and arrangements, they told, throughout the project had been immaculate and they never faced any problem, in fact, they developed good personal relationships among themselves, as well as with the SFCG and its partners.
16
c) Evaluation of programs produced
As a part of the project, the producers and presenters who had attended the training sessions conducted by SFCG and its partners, had to produce an aggregate of 120 programs, using the Platform of Rabita – the common title used for the programs. In this regard, SFCG ensured that the trainees indeed produced the pledged number of programs. The evaluators in order to evaluate the quality and content of the programs produced under the banner of Rabita, carried out the content analysis of almost 100 of the total produced programs. The 100 programs were carefully listened and the content was analyzed by employing the technical tools of radio productions and theoretical concepts of peacebuilding.
Sources of Information
i. Content Analysis of programs: The content analysis of the programs was carried out to assess the format and quality of the programs, to evaluate the skills as well as attitudes of the presenters, and to find out the messages of peace and conflict in the programs.
ii. Mock-shows: The mock shows were conducted to evaluate the creative and operational abilities of the host of the one hand, and on the other, to find out the operational (technical and non-technical) problems and constraints faced by the participants while producing/presenting their programs.
Observations from the Content Analysis of Programs
Format of Rabita Program
In terms of radio production, Rabita programs fall into the category of “Discussion Programs” that are also commonly known as “Talk Shows”. Such programs are usually hosted by a moderator with two or more participants. Discussion programs provide a platform for the exchange of ideas on contentious issues of public concern. Given the diversity of issues that affect the humans in their individual and social lives, the producers and presenters face the daunting challenge of selecting the topics of public interest. Issues that impinge upon the individuals in their private and public life range from private to public, social to economic, domestic to international and cultural to religious. Sometimes, community/listener participation in the programs increases public interest in the topic under discussion.
Quality of the Rabita Programs: Discussion programs are typically categorized as:
i. Descriptive & Diagnostic
ii. Analytical
iii. Prescriptive
iv. Mixture of above all
Most of the Rabita programs provided for evaluation and analysis fall the 4th category with the exception of very few prescriptive result oriented programs.6
6 Host Tahir Chughtai of FM 93 Radio Muzaffarabad did a result oriented program on problems of education facilities in the neighborhood. The education Minister of AJK was invited and it became a very effective problem-solving program. Similarly host Sajida Shamim of FM 95 Umar Kot discussed the closure of more than Medical Units in Umar Kot very effectively.
17
The decisive factors in judging the quality of a particular program are; home work and preparation by the producers and presenters, the control of moderator/host on debate, quality of questions asked in the programs, appropriate selection of the guests, tone and pace of the program, and attractive opening and conclusive closing of the program.
A certain level of tension/conflict in an effective discussion program is essential. Moderator needs to have complete control on the dynamics and level of tension in the program. Some of the programs were quite balanced in terms of information, presentation, control and conclusiveness.7 However, a few of them reflected poor host control and lack of understanding of the basic issue.8 Some programs were marked by heightened level of tension among the guests where hosts failed to intervene at proper time. Hosts were also unable to conclude the discussion on a peaceful note or a common ground.9
Peace and Conflict in societies depends on the presence or absence of direct, structural and cultural violence. Language plays an important role in escalating or diffusing tensions. The programs presented for evaluation reflect that most of the presenters are conscious of their social responsibility as community leaders and peacebuilders. Most of the times they try to use neutral language in their presentation10. At times however, because of lack of education and absence of dialogue culture in Pakistani society regarding pluralism, diversity and peace education (Annex III - Glossary) they use language and idiom which promotes conflict rather peace. Regardless of consciousness about the sensitivity of their role and job in society, their programs reflect their inability to overcome the dilemma of “Us vs Them”, social constructs of ‘negative other’ and insensitivity.11
Naming and accusing persons and organization12 who are not represented in the discussion programs is not an acceptable norm in broadcasting. This kind of program leads to escalation of emotions and peace-
7 Host Sajjad Pervaiz of FM 91.6 “The Voice of AIOU” in a program produced by Iffat Ali on “Educational Systems and their role in current socio-economic and political situations”. The approach of the host was not only progressive and informative but also very constructive.
8 Host ALI of FM 90 Radio Rose Islamabad while raising the problem of driving manners and traffic rules, completely failed to control the dynamics of the program. The guest selection could have been far better. Host’s own understanding of the traffic rules and driving manners was very superficial. He was not prepared at all. A similar program by FM 104.6, Bahauddin Zikriya University Multan lacked research and basic understanding of the issue. The host and guests were unable to distinguish between the feudal and political system.
9 Host Ayesha Mujtaba of Margalla College FM Islamabad while doing a program on Student liberty and communication gap between faculty and students was unable to conclude her program on a peaceful note and no common ground was explored.
10 Chilatn FM 88, Host: Abdullah Khan, Program: Rabita Topic: Valvar and Vatta-satta Guests: Mufti Asadullah Khan and Muhammad Jamal Baloch
11 A guest in a program hosted by Abdullah Khan on Chilatn FM 88 said very inappropriate thing that if there were no garbage collector kids, cities will be full of junk.
12 Majid Ali Saghar of FM 91-Ghotki in his Rabita program on “Not providing employment to Locals” accused persons and companies while discussing the issue.
18
lessness in the locale. Similarly, the hosts are expected to refrain from being judgmental and taking sides. Personal projection13 is reflective of bad taste of the host/s.
Extensive usage of unintelligible non-local, non-national language (English) is very common in almost all the programs. Local idiom and language should be used when discussing the issues of public interest. Most of the local audience in the neighborhood is usually unable to understand typical jargons which the presenters might have learnt during the SFCG training.14
Production Flaws
i. Training in script writing is required
ii. Producers and presenters should develop the habit of doing research and homework before conducting the program
iii. Enhanced production facilities needed
iv. Finances should be improved and incentives be offered.
Table 3.3 Mock-Show Themes It was observed while analyzing the recorded radio programs that the accused person/party in the specific case has not been a) Raymond Davis Case invited in most of the programs, the accused person/party should be b) Assassination of Salman called in as well. As in their absence, the program became an
Taseer and Blasphemy accusation/blame game and in this situation it is hard to achieve laws common ground. c) Blasts at Data Darbar Environment in which the programs are produced: The evaluators d) Talibanization of FATA asked the trainees to conduct mock shows in which they were asked and military operation to conduct programs keeping in view all factors (local cultural sensitivities, organizational constraints and security issues) that affect their programs in reality. Most of the presenters conducted the shows properly. The impact of cultural/security concerns on programs was palpable, and it is obvious that the participants carried out their actual programs in situations circumscribed by similar constraints beyond their, and SFCG’s, control, therefore making the work and the project not only difficult, but also appreciable. Nonetheless, the producers and presenters did manage to incorporate peace messages, and adopt problem-solving approaches to very sensitive issues. Two participants from KPK province, namely Shehryar Shah and Faiq Nawaz, confided that through the mock shows they had discovered how they could punctuate their programs with subtle and seemingly benign peace messages, without offending the people who would otherwise be irate if the same messages are categorically expressed. They maintained that they would continue to use the techniques they have discovered in their future programs.
13 FM 88, Chakwal, Host: Muhsin Shehzad, Topic: Bridging the gap between Media and Public
14 Host Abdullah Khan of Chilatn FM 88 in his program on Children Garbage Collectors used the terms Common Ground and Search for Common Ground
19
d) Evaluation of Training Manuals
The content of the training manuals was evaluated by scrutinizing the substance given in the manuals. It was also examined how roles plays and simulation exercises were designed and whether or not they meet the requirements of a presenter and producer.
Observations
An appraisal was carried out to check the quality of training manuals used during the R4PB project implementation. The trainings imparted comprised of role-play exercises and simulations given in the manuals. Most of them were carefully designed keeping in view the mental level and conceptual understanding of the trainees. The role plays and exercises seemed adequately fulfilling the need of learners and complimented the conflict analysis tools presented in the manuals. There were occasional complaints of certain portions of trainings being complicated/bookish, nonetheless, conceptual training of the trainees was very important, which was equally acknowledged by some of the participants.
e) Evaluation of the Impact of the Rabita Programs on Masses
In order to assess the impact of Rabita Programs on the masses, the evaluators also conducted a survey in Islamabad, Lahore and Karachi.
Sources of Information i. Survey: The survey was carried out in order to find out: i) who listens to radio?; ii) where is radio listened to and which are the popular channels?; iii) how and how much does Rabita influence people? The sample size for the survey was of five hundred and forty one (541) respondents, of which 31.2% were from Islamabad, 30.3% from Karachi, and 38.4% from Lahore (shown in Table 3.4).
ii. Experimental Group Exercise: This exercise was carried out having selected one Rabita program. The purpose of carrying out this exercise was to assess the psyche of the listeners, and generalize the result to the general populace of Pakistan that SFCG and the project confront. The exercise also aimed at discovering the putative impact of the single Rabita program on the listeners. Table 3.5 Table 3.4 Radio Listeners City-wise Sample Distribution Frequency Percent City Frequency Percent ISLAMABAD 169 31.2 NO 123 22.7 KARACHI 164 30.3 YES 418 77.3 LAHORE 208 38.4 Total 541 100 Total 541 100.0 Observations on the questions the survey was aimed at Table 3.6 Sample Education-wise Who listens to Radio? Where and How much do they listen? Classification Frequency Percent This was an important question to know keeping the project in view, so Educated 457 84.5 that it could be known whether or not the choice of radio as the medium to Uneducated 84 15.5 reach out to the masses was correct. The survey (Table 3.5) shows that by Total 541 100 having chosen Radio as the medium, the project was reaching out to 77.3% of the population. This figure show the percentage of the respondents who told that they did listen to radio, and keeping in view the large figure, it may rightly be said that choice of radio as the medium was correct. This claim is further buttressed 20
by the fact that FM Radios are most potent media tools that still have a deep relationship with their respective communities, and have avid listenership at the grassroots level on community issues.
Survey conduction
Table 3.7 Gender/City Crosstabulation Of the total 541 respondents, 84.5% belonged City Total to the educated class, while the 15.5 % were uneducated (Table 3.5). This parity was ISLAMABAD KARACHI LAHORE intentionally kept in order to take responses Gender F 63 56 54 173 from a diverse sample. M 106 108 154 368 The age of the respondents was also kept in Total 169 164 208 541 consideration, and which is positively skewed with an average of 26 years. Another distinction of sex was also maintained, with 32% of the respondents being females and 68% being males.
The statistical review of the available data revealed that 77.3% of the total respondents are radio listeners (Table 3.5), of which 68% are males and 32% are Table 3.8 Radio Listeners Gender-wise females (Table 3.8). Q1 Total Furthermore, 50.8% of the total males, and 26.4% N Y of the Females are radio listeners. Location-wise analysis Gender F Count 30 143 173 revealed that 28% of the respondents from Islamabad, % of 5.5% 26.4% 32.0% 32% of those from Karachi and 39% of those from Lahore Total are radio listeners. Of those who listen to radio, 36% listen M Count 93 275 368 to radio at home, 10% at office, and 14% listen to it while % of 17.2% 50.8% 68.0% driving. Total The number of hours the radio is listened to is Total Count 123 418 541 positively skewed with an average of 2 hours per day. Of % of 22.7% 77.3% 100.0% the radio listeners, 44% listen to the radio for less than one Total hour, 31% between 1-3 hours, 12% between 3-5 hours and 11% listens to the radio for more than 5 hours. 21
The analysis of program preference of the radio listeners revealed that 71% of the radio listeners like to listen to music programs, 27% prefer talkshows, and 27% prefer news programs.
Analysis of popularity and impact of channels revealed that 30% of the radio listeners listen to FM 106.2, 23% listen to FM 103, 18% listen to FM 99, 16% listen to FM 101, and 10% listen to FM 100. Others didn’t mention the name of any specific channel.
Who listens to Rabita? Whom does Rabita Influence and how?
The analysis of the data also revealed that 13.5% of the respondents are Rabita Listeners (Table 3.9), of which 30% are females and 70% males, which also means that 13% of females and 14% of males of the whole sample are Rabita listeners.
And on the issue of location, it is revealed 11% of the respondents Table 3.9 from Islamabad, 15% from Karachi respondents, and 17% from Lahore Rabita Listeners are Rabita Listeners (Table 3.10), while 14% of the educated class and Frequency Percent 10% of the sample from from uneducated class are Rabita Listeners. No Res. 132 24.4 On the issue of impact, 97% of Rabita listeners feel that Rabita is No 336 62.1 a good platform. 67% feel that Rabita of programs are aired at Yes 73 13.5 appropriate timings. On the question of followership, 16% of the listeners Total 541 100.0 stated that they are Regular Listeners, 36% listen to the program occasionally, while 45% have not followed the program consistently.
Of all the Rabita Listeners, 81% feel that Rabita programs have positively affected their lives, while 96% feel that the programs are helpful in bringing awareness on social issues and reduce intolerance at grass root level.
Table 3.10 Rabita Listeners Location-wise Total Important Points No Res. N Y City ISLAMABAD 55 95 19 169 Radio is a popular medium, and KARACHI 30 109 25 164 77.3% of the respondents listen LAHORE 47 132 29 208 to radio, therefore making it a potent tool for message Total 132 336 73 541 delivery.
By selecting talkshows as the format for the programs, SFCG was able to reach 27% of listeners, those who prefer listening to talk shows.
FM 106.2, FM 101, FM 103, FM 100 and FM 99 were the most popular radio channels amongst the respondents.
Rabita program has 16% regular listeners (16% of the 13.5%), those who not only listen to the program, but follow it regularly.
71% of the respondents prefer music programs over any sort of other programs.
22
Majority of the listeners have positive views about Rabita programs and admit being somewhat affected by them.
Rabita Programs have reached all sectors of society in various cities, and are followed alike by men and women, educated and uneducated, and urban professionals and laborers.
Observations on the psyche of the populate and their putative reception of the programs
What is the psyche of the listeners, and how do they interpret the programs?
This was an important question to respond to in order to objectively gauge the efficacy of the programs produced, and their impact on the listeners. For this purpose, the evaluators conducted three Experimental Group Exercises in Islamabad, Lahore and Karachi. The basic idea behind employment of this tool was to gauge the direct impact of a Rabita program on listeners who were all part of the study and were directly involved in it. During this exercise, the samples, comprising of groups students, were handed questionnaires to be filled after collectively listening to one Rabita Program15 specifically chosen for the study. The selection of the Rabita program was made for the importance of the topic (comparison of modern education and religious seminary education) and the role of the presenter in keeping the program on track with the focus on common ground approaches and creative solutions.
For the Experimental Group exercise, a total sample of 130 students was selected from Islamabad, Karachi and Lahore, and the exercises were separately conducted.
Of the 130 students included in the study, fifty one (51) were from Table Nature of Islamabad, fifty (50) from Karachi and twenty nine (29) from Lahore. The 3.12 Program gender based analysis of the data revealed that 65% of the respondents were Frequency Percen females and 34.6% were Males. Majority of the respondents are distributed t around the average age of twenty one (21). Invalid 1 .8 A 21 16.2 When asked about the nature and impact of the program (shown in Table 3.12), the 42.3% of the respondents believed that the program played B 8 6.2 before them was about The Awareness on Social Issues (represented by D in the C 26 20.0 table), 20% were of the view that it was about Education (C), 16.2% D 55 42.3 understood that it is to bring Peace (A), while 9.2 %, 6.2%, 2.3 %, and 1.5% E 2 1.5 Table 3.13 thought it to be about Gap F 3 2.3 between Policies & Cross Examination G 1 .8 implementation (I), Presenter’s Skills Total H 1 .8 Tolerance (B), Ethnic I 12 9.2 Effective identities (F) and Religion Total 130 100.0 - N Y (E) respectively. This Discussion - 3 0 3 6 shows that the respondents Generated Good 1 2 43 46 greatly varied in their Bad 1 1 0 2 understanding of the Positive 0 9 67 76 otherwise very lucid talk and at times misunderstood it. Total 5 12 113 130
15 The selected program was hosted by Sajjad Pervez and Produced by Iffat Ali of AIOU. While Sajjad was not a trainee, Iffat was.
23
While this tells of nothing wrong on the behalf of the presenter, it does present a picture of the minds of the masses the programs are aimed at.
On the skills of the presenter, 86.9% of respondents, of which 68.1% are females and 31.9% are males, agreed that the host presented the program effectively while 9.2% didn’t agree to it. Furthermore, 58.5 % of the respondents, 63.5% of the females and 48.9% of the males, felt that the discussion generated by the guest speakers was Positive, while 35.4 % of the respondents, 33% of the females and 40% of the males, felt it was Good; whereas, only 1.5% of the respondents didn’t like the presentation and marked it as Bad (Table 3.13).
Of all the respondents, 82.3% (86% of the females and 76% of the males) felt that the host followed the Problem Solving approach while conducting the program; whereas, only 13.8% (13% of the females and 16% of the males) saw it as Trouble Creating. Table 3. 14 The 91% of the females, 93% of the males and Cross Examination 91.5% of the respondents feel that such programs are Presenter’s Skills Total helpful to bring awareness on social issues and to reduce Effective? intolerance at the grass root level. - N Y Cross examination of the responses (shown in Do such - 2 0 1 3 Table 3.14) for Question 8 (Was the program effectively programs N 0 5 3 8 hosted?) & Question 9 (How was the discussion that was bring Y 3 7 109 119 generated?) revealed the fact that of 86.9% of the awareness? respondents who felt the program was effectively hosted Total 5 12 113 130 by the presenter, 38% found the discussion generated by the guest speakers as Good, while 58% found it to be having a positive impact. However, of 9.2% of the respondents who didn’t find the presenter’s hosting as effective, 75% found the discussion generated by the guest speakers as Positive, 17% found it Good, and 8% found it as bad.
Similarly, cross examination of the responses for Questions, i) Was the program effectively hosted, ii) Do such programs bring awareness? tells us that 96% of those who felt that the presenter hosting is effective and 58% of those who didn’t, feel that such programs are helpful to bring awareness on social issues and to reduce intolerance at the grass root level.
Since the basic purpose of the program was to understand the minds of listeners of a program, the results of the experiments show that whenever the masses in Pakistan are presented with something even remotely related to religion and nationalism (as done by two of the guests in the selected programs), or if just garbed in such a cloak, they readily accept it, and interpret the notions of peace accordingly, not through an objective understanding of peace, rather through a relative interpretation of peace vis-à-vis Islam and Pakistan, considering the latter two – and the dominant discourses about them – as justifications of peace in themselves, which is dangerous, but nonetheless now a reality in Pakistan. This, on the one hand, highlights the importance and urgency of this project, and on the other, calls for pro-active peace messages in programs.
The uphill task for the programs in this regard can be fulfilled, if the messages are not only positive, but also corrective and re-corrective, in order to effectively undo the previous indoctrination.
24
4. Conclusion
4.1. Outcomes and Achievements
Overall R4PB can be termed as a successful project, which met its objectives, followed the specified agenda and concentrated on result oriented process. The most remarkable achievement was to pioneer and establish a process of peacebuilding in Pakistan amidst volatile security situation and continued with the unhindered project activities for the committed time span. In theory and practice of conflict resolution and transformation, peacebuilding is a long term, result oriented process where targets may be achieved with the efforts continued in decades or more than decades time. It is inapt to judge or assess impact of R4PB at societal level in just one year. Peacebuilding is an evolutionary process, not revolutionary. Expecting concrete results in initial phase may not work wonders. Hence the successes could be delineated as:
i. Unobstructed, target oriented project implementation that might not have brought immediate desired results or an immense impact at the societal level but initiates a process that aims at achieving the desired results. The one year time span may be referred to as a stepping stone or an initiation of the long term process which is bound to bring positive results in the years to come.
ii. The field of Peace and conflict studies is in its embryonic phase in Pakistan. Only few institutions are supporting courses related to peace and conflict resolution, SFCG is the only organization of its kind to ‘practice’ peacebuilding and conflict transformation and has taken the most accessible medium of communication on board.
iii. One of the most encouraging outcomes is to bring fresh ideas and themes to the talk shows through trainings on peace and other positive messages.
iv. The trainings, coaching and other activities during the project implementation created awareness among producers and presenters to play their roles as community leaders and peacebuilders more efficiently and effectively. Media is known as an opinion maker in the society. If radio talk shows are formatted, presented and produced supplying enough messages of peace, acceptance and harmony, the impact on the minds would be long lasting and sustainable. Some presenters introduced the conflict analysis tools in their respective institutions or radio stations.
v. The promised number of trainings were four (3 primary level and 1 advance level) yet SFCG conducted two ToTs for their partner organizations as well as PBC producers (Annex I) which was neither committed to the donor nor envisioned in the initial phase of project implementation.
vi. A clear change in the mindsets and behavior of the trainees was seen and their success stories that they shared during the field trips in three centers were evidence of their transcendence and transformation towards peace.
vii. They adopted a new strategy to deal with controversial issues. Prior to attending trainings, the producers and presenters themselves used to quote controversial issues and now the guest speakers talk about them. Now they try to get into a healthy discussion but rather unending debate while listening to each party’s point of view until all parties share mutual consent to resolve the conflict.
viii. Some of the producers, such as Rafiq Ahmed Feica and Zunera Salman, confided that after high profile assassinations of Salman Taseer and Shahbaz Bhatti they conducted programs to condemn the killings while not even the ruling party members were ready to do so. Zunera Salman specifically mentioned that she wouldn’t have done so were it not for the SFCG training session she had then recently attended.
25
4.2. Success Stories
i. Mr. Hassan Raza Shirazi, a presenter in FM 104.6 who also teaches at Baha’uddin Zakaria University – Multan, adopted SWOT Analysis, KAB Theory and Conflict Resolution techniques as part of the syllabus he teaches.
ii. Mr. Rooh-ul-Amin, a lecturer at Mass Communications Department, Kohat University, shared that he had started teaching a new course titled “Crisis Communication” after his training sessions during the project, and he incorporated important components of what he had learned during the sessions, into his course.
iii. Rafiq Feica, a trainee from Mast FM 103 – Karachi, also shared that a famous presenter Sahir Lodhi was asked to conduct a talk show on Salman Taseer’s assassination which he refused to do, while Rafiq Feica and Abu Rashid, two trainees of R4PB project and affiliated with the same FM station, took a courageous stand and conducted a series of 10 shows on the controversial subject.
iv. Zunera Salman, a PBC participant, confided that she had not uttered a single word in condemnation of Governor Punjab Salman Taseer’s assassination, and had conveniently avoided the issue, however, on Minorities Affairs Minister Shahbaz Bhatti’s assassination, which followed her training session with SFCG, she conducted a program in condemnation of the incident. She categorically stated that were it not for the particular training session, she would have avoided speaking in defense of Shahbaz Bhatti too.
v. Shehryar Shah, a vocal participant from FM Dilbar Charsadda, told the evaluators that he had went beyond the 5 Rabita programs he had pledged, and instead produced 15 programs, and solved numerous community problems.
4.3. Challenges
Pakistan assumes critical importance of being a fault line where conflicts not only emerge but sustain for a longer period of time with no proper management or resolution mechanism. People in power and masses have never been acquainted with the field or practices of conflict resolution. Hence it is also important to mention that different NGOs and INGOs have started working for awareness on the issues of democracy, human rights, women rights etc in Pakistan. Peacebuilding was a new jargon to the country when it was first used by SFCG to initiate its project on “Radio for Peacebuilding”. In just one year, the project initiated by SFCG and implemented by Intermedia and Uks in Pakistan, made the term ‘peacebuilding’ known to a powerful community i.e. Radio producers and presenters. Today, the trainees are not only familiar with the concept of peace but they use the peace jargons and include them to their radio talk shows. R4PB successfully obtained objectives that were desired and envisioned during the different phases of the project implementation. Keeping Pakistan’s volatile situation in view, R4PB may face few challenges in future. In a nutshell, the evaluation team measured and perceived the challenges seeing through the lens of existing circumstantial factors, learning capacity and cognitive reception and perception of the participants and the process of unlearning the messages and notions of violence and negativity that the whole nation had learnt throughout the last sixty-three years of Pakistan’s independence. Positivity can be seen for the project continuation which has already brought remarkable change in people’s behavior and trainees’ attitude. Radio producers and presenters are opinion makers and make an effort to bring drastic change to the society. If the target recipients of the future trainings remain the same, R4PB would win bulk of the population and prepare rather smooth ground for peacebuilding and conflict transformation.
The significant challenges in this regard can be outlined as: 26
i. The primary problem that SFCG faced was the initial confusion in the society which is knitted with a complex ethno-cultural fabric of Pakistan. With the help of its implementation partners, SFCG met the challenge of making its place in the multi-ethnic society and created a community of peace in radio productions. The forthcoming challenge may be envisaged as to have continuous financial support to penetrate at larger scale and to make a greater community of peacebuilding which keeps working in every conflict zone of Pakistan to make the masses aware of the concepts. The R4PB should keep on working with the same pace and efforts. ii. Sometimes, trainees quit their jobs at the respective radio stations or get transferred to some other. In such circumstances, the trainees may not be bound to produce or present Rabita program. iii. Since SFCG has created the biggest alliance of FM radio stations in Asia, the challenge is to keep all of them intact and make them work for peace in continuation. SFCG may have to make rigorous efforts and conduct a series of similar trainings under the same R4PB in future too.
4.4. Recommendations i. As mentioned earlier, peacebuilding is a long term and result oriented process, which gives results over a longer period of time. SFCG needs to continue with the efforts and activities in future too. ii. In order to penetrate at larger scale and to continue working with all the conflict zones of Pakistan, SFCG should expand the existing training programs for producers and presenters through continuation of the existing and experiment a variety of the project activities. iii. Scope, themes and coverage for Rabita programs should be expanded according to the local socio- political context and needs. iv. There is no denying fact that discussion programs can be very effective medium to spread the message of mutual coexistence, accommodation, tolerance, respect of divergent views, and peace in our fragmented society. People are generally more interested in entertainment/music programs when it comes to FM broadcasts. v. SFCG has already taken initiative to commence a community of peace by engaging radio stations and producers through the formation of the alliance under R4PB. A similar alliance should keep on working along with a pool of practitioners and academics from the field be made to rely on for further trainings and activities.
27
Annex I Search for Common Ground – Pakistan Radio for Peacebuilding Work Plan Activity Timeline FMs Stations Location Partners Output attended the events (Provinces)
Training1 of May 29, 2010 – Islamaba Intermedi Lead trainers from Trainers June 1, 2010 d a and Uks partner (TOT) organizations were trained who formed SFCG’s core team for imparting trainings to Radio anchors on Conflict resolution and peacebuilding in their talk-shows.
National2 June 19, 2010 Punjab, KPK, Islamaba Intermedi MOUs were signed Summit I Balochistan, d a and Uks by the FM Radio Capital, Sindh, Stations at the FATA, AJK Summit to promote a community of peace on air.
1st Primary3 July 1-7, 2010 Sindh, Punjab Karachi Uks 18 radio Training broadcasters were trained.
2nd Prim4 ary July 8 – 14, 2010 FATA, KPK, Islamaba Intermedi 21 radio Training Balochistan d a broadcasters were trained.
3rd Primary5 August 2 – 8, Capital, Punjab, Islamaba Intermedi 20 radio Training 2010 Azad Jammu d a and Uks broadcasters were and Kashmir trained. (AJK)
Advance6 November 9-12, Punjab, KPK, Islamaba Intermedi 39 radio Level Balochistan, broadcasters were 28
Training 2010 Capital, Sindh, d a and Uks trained. They shared FATA, AJK their success stories during the training.
Coaching7 of December 2010 Punjab, KPK, Punjab, Intermedi FM stations FM Radio to January 2011 Balochistan, KPK, a and Uks were Stations Capital, Sindh, Balochist coached to FATA, AJK an, improve Capital, technically Sindh, quality of FATA, radio AJK programmin g related to promote community of peace on air.
National8 January 20, 2011 All Radio Karachi Intermedi Radio Summit II Stations a and Uks owners /directors from 40 FM stations gather and shared their work experience of RABITA programs with SFCG.
ToT Pakistan9 January 26 – 29, Sindh, Islamaba Uk 24 PBC’s Broadcasting 2011 Balochistan, d s producers/p Training Punjab, KPK resenters and Capital were trained to produce radio programs by the name of Rabita.
29
Annex II Project Evaluation of SFCG’s R4PB Test for Radio Producers and RJs 6 March 2011
Choose the best answer
1. Which one is correct? a. Peace Building b. Peacebuilding 2. Perception is: a. Imagination or picture of something in minds b. View point c. Opinion d. Definition of something 3. Conflict is: a. war b. Arguments c. Violence d. Clash of interests and ideologies 4. Values are: a. Established beliefs b. Price of something c. Norms and culture d. Rituals 5. Conflict resolution is: a. To end war b. Negotiations c. To resolve a conflict through peaceful ways d. Peace process 6. Violence is: a. War b. Conflict c. Physical and non-physical harm to anyone d. Killing 7. Structural Violence is: a. War between/among different systems or structures b. Policies that harm people like inequality, racism, ethnic hatred etc. c. Fighting between two people d. War of words 8. Cultural Violence is: a. Beating, punching, killing people everywhere b. Legitimizing violence in the name of culture c. Hatred among different cultures d. War between two cultures 9. Conflict Parties are: a. Political parties b. Common people c. Direct and indirect actors in any conflict d. A party or celebrating festivity during a conflict situation 30
10. Conflict zone is: a. A country b. Talibans c. A troubled region, area where most of the time, violence and armed conflict prevails. d. A province 11. Negotiations are: a. A shopping technique b. Compromise c. To avoid the conflict d. Peaceful way to resolve or manage a conflict through dialogue and bargaining. 12. Intervention is: a. Third party involvement b. To interfere in other’s matters c. To create peace between the enemies d. Inviting police or para military forces to mediate 13. Trigger is: a. A weapon b. A policy or event that worsens the conflict situation c. A initial stage of a conflict d. Bad relations between enemies 14. Extremism is: a. Religious fundamentalism b. Terrorism c. Intolerant behavior or attitude towards the other person, community, sect. d. Talibanization 15. Tolerance is: a. Patience b. Truthfulness c. Acceptance of the other person on the basis of humanity and respect d. Hating someone
31
Annex III
Glossary
1 Conflict Management To manage the conflict up to the point where violence is controlled and stopped for temporary time period.
2 Conflict Prevention To prevent conflict at its latent stage through operational, direct conflict preventing measures (such as peacekeeping) to avoid spill over affects, geographical expansion of the conflict.
3 Conflict Resolution Mechanism to resolve conflict once for all through different measures
4 Conflict Transformation A process that transforms conflict energies and dynamics from destructive to constructive, from negative to positive. 5 Cultural Violence Legitimizing violence in the name of culture
6 Inter-faith Harmony Good relations among people of different faiths, religions, sects.
7 Mock Show A pretentious talk show to check the caliber of the trainees if they incorporate their learnings to the programs
8 Peacebuilding A post-war/conflict phenomenon which includes various activities to build peace through reconstruction of the society, rebuilding of institutions, reconciliation between perpetrator and victims, rehabilitation of the affectees and war-hitted areas. 9 Peace Education A field of study (as part of peace studies) where the conventional concepts of violence are taught to unlearn and learn the concepts of peace and other relevant notions.
10 Problem Creating An approach that aggravates the situation or problem
11 Problem Solving An approach through which one draws positive and decisive conclusions
12 Stereo typical Notions The embedded perceptions about something
13 Structural Violence Policies that harm people like inequality, racism, ethnic hatred etc.
14 Violence Any physical and non-physical harm
32