End-Line Assessment

EVALUATING THE EFFECTIVENESS OF CARE NW BALKAN’S PROJECT:

“BOYS AND MEN AS ALLIES IN VIOLENCE PREVENTION AND GENDER TRANSFORMATION IN THE WESTERN BALKANS – YOUNG MEN INITIATIVE (YMI)”

- END LINE ASSESSMENT REPORT -

July, 2016

CONTENT

Acknowledgments

Summary

BACKGROUND OF THE RESEARCH

Project objectives

Evaluation goals

METHOD

Study design

Instruments and procedures

Participants

Intervention program

Limitations

RESULTS

Gender relations

Health of young men

Violence

Participation of young men in intervention program and its effects

CONCLUSING REMARKS

Acknowledgments

We would like to thank the many individuals and organizations who were involved in designing and implementing of this resarch in Bosnia and Herzegovina, Serbia, Kosovo without whom the results presented in this report would not have been possible.

 The team at CARE NW Balkans for their guidance, coordination and support throughout the baseline and endline experience, especially John Crownover, Marina Starcevic, Sasa Petkovic and Miroslav Blagojevic;  Austrian development cooperation which supported this research and project  The large team of data collectors: Dragan Adamović and Branislav Slijepčević from Banja Luka; Erjon Fejzullahu from Pristina; Olen Dashi from Tirana; Jelena Simić from Belgrade; who worked tirelessly to administer the survey at both baseline and endline with classrooms full of young men;  The Youth Serving Agencies (YSA) in each location, who facilitated process of data collecting: Perpeetum Mobile – Banja Luka, Peer Educators Network (PEN) – Pristina, Center for Promotion Healthy Life Style E8 ( Centre E8) - Belgrade, Counseling Line for Men and Boys, CLMB- Tirana.  High schools and its amazing staff: Banja Luka: School of students in industry, Agricultrue school

Pristina: Professional high school Abdyl Frasheri and Technical professional high school Gjin Gazulli

Tirana: Abdullah Keta General high school and Gjergj Canco Professional Electrical high school

Belgrade: Agriculture School and Gymnasium Sveti Sava

 The young men who participated in study by sharing very personal information about themselves and their experiences.  ICRW and Instituto Promundo, who provided key insight on the begininig of YMI program.

Summary

We examined the effects of project activities on the following spheres of life of young men:  Views of young men regarding gender roles and attitudes;  Health of young men, including consuming alcohol, smoking, substance abuse;  Experience of young men with suffered and committed violence;  Participation of young men in different project activities.

Methods included self-administered quantitative surveys completed by participants before and after the intervention program. In the first phase half of 2015th, we conducted the first phase of research. In the second stage, most of young men took part in the educational (intervention) program (particiation in Be a Man club, workshops, campaign activities). In the third phase, in May 2016th , we conducted a final survey. This design research allows us to compare results before and after intervention program and to determine whether there has been a certain change in participants. The questionnaire was divided into several sections (general background, views about men and women, violence, health, participation in program intervention activities…) in order to gather information for the evaluation, as well as to provide understanding of the situation of these young men.

All respondents were young men, aged 15-18 years. Following number of young men participated in both phases of the research: 377 from Banja Luka, 162 from Pristina, and 375 from Tirana, 180 from Belgrade.

Research results show that the most progress in all cities had been made in the area of attitudes towards gender relations. Still, attitudes towards gender equality and violence are overwhelmed with stereotypes so work with youth in this regard should continue. Significant progress has not been made in the area of mental health that is probably a consequence of growing-up, social challenges and adolescents crises youth goes through at this stage. Psychological and physical violence towards peers in most cities is not very pronounced. In the endline research is a bit less evident then at the beginning of the programme. Analyses had shown that all bad phenomena are mostly combination of bad experience in the past, bad role- models from family and peers, and alcohol. As a result of this kind of combination of circumstances some young men enter into a magic triangle: socio-emotional problems – alcohol – violence, and it is not easy to get out of it. This programme had demonstrated that through different aspects of work (youth clubs, campaigns, workshops) situation can be improved, especially in the area of gender relations and peer violence. These aspect had contributed to improvement of lifestyles of young men, and the most influence had been made with those that had participated in Be a Man club. This programme and concept of work gives good results and it should be supported in future and further developed. Additionally, it is necessary to obtain systematic support from institutions that would establish mechanisms so that young men know who to address once they face some problems or have some other need.

BACKGROUND OF THE RESEARCH

CARE’s mission in the region is to contribute to post-war recovery and the socio-economic development of Bosnia & Herzegovina, Croatia, Serbia, Kosovo and Montenegro. CARE in the Balkans consists of Offices in Sarajevo, Bosnia and Herzegovina (BiH), in Belgrade, Serbia and Pristina, Kosovo. CARE in the Balkans places the quality of its program at the center of its business and its mission and has developed a regional strategy that encompasses two main program directions: Gender Equality and Social and Economic Inclusion. The goal of the Social and Economic Inclusion Program is to strengthen capacities and create opportunities for marginalized, socially excluded and poor to integrate into society and access rights. CARE’s Gender Equality Program aims to empower women and girls vulnerable to violence, discrimination and poverty, to reach better life opportunities and social justice.

The Boys and Men as Allies in Violence Prevention and Gender Transformation in the Western Balkans or Young Men Initiative (YMI) project builds upon CARE´s comprehensive and programmatic effort to fight interpersonal and gender based violence (GBV) as well as to improve gender equality in the region. The YMI project is implementing in Albania, Bosnia and Herzegovina, Kosovo and Serbia targeting young men to build their knowledge and attitudes concerning gender equality and healthy lifestyles and to decrease levels of GBV. The Gender Transformative Life Skills program (Program M) is at the heart of this endeavor. The current project aims at scaling up and mainstreaming earlier achievements related to the implementation of Program M via targeted advocacy and a close cooperation with Ministries of Education, public gender agencies, academic institutions, secondary schools, educators, media and other stakeholders. One of the main objectives of the project is to introduce Program M into national Educational Curricula and to acquire an official accreditation for teacher training. To enhance this process, CARE implementing pilot Program M in selected secondary vocational schools in the region in cooperation with teachers. To reach educators in their early stages of career, the project targeting also teacher trainee students at universities.

CARE´s local partner organisations are increasingly recognized as key players by public stakeholders in the field of men engagement, youth work and gender equality. Supported by the project, the partners implementing campaigns targeting in particular youth, but also fathers, male care givers, coaches and other male role models, thus improving their

knowledge and attitudes on gender equality and parenting and to fight gender based violence in families.

Project objectives

Overall Objective is to improve gender equality and decrease interpersonal and gendered violence within Serbia, Bosnia and Herzegovina, Albania and Kosovo society. The project purpose is to increase the uptake of healthy, non-violent and gender equitable lifestyles amongst boys and men (and girls and women) participating in the program. This will be achieved through 3 inter-related results:

1. Gender Transformative Life Skills program (Program M) adopted, accredited and teachers trained by Ministry of Education for use in secondary schools; 2. Lifestyle and social norms campaigns to engage boys and men on issues of violence prevention, gender equality and fatherhood are developed and reach the targeted audience; 3. Local NGO partners act as national resource centres and promote practice, policy and research work engaging boys and men;

Research goals

The assessment is carried out to contribute to a comprehensive understanding attitudes amongst young men within Serbia, Bosnia and Herzegovina, Albania and Kosovo society participating in the program toward gender based violence, gender equity and healthy life styles. We assessed whether there are differences in attitudes, knowledge and behaviors of young men before and after the completion of the project activities? We examined the effects of project activities on the following spheres of life of young men:  Views of young men regarding gender roles and attitudes;  Health of young men, including consuming alcohol, smoking, substance abuse;  Experience of young men with suffered and committed violence;  Participation of young men in different project activities.

EVALUATION METHODOLOGY

Study design

Methods included self-administered quantitative surveys completed by participants before and after the intervention program. We used a questionnaire which was tested in previous researches implemented by CARE NWB and some other research institution. The survey was conducted in several stages. In the first half of 2015th, we conducted the first phase of research. In the second stage, most of young men took part in the educational (intervention) program. In the third phase, in May 2016th , we conducted a final survey. This design research allows us to compare results before and after intervention program and to determine whether there has been a certain change in participants.

Instruments and procedures

The survey included sections on background characteristics (e.g. age, ethnicity, parents’ education levels, etc.), and attitudes and behaviors related to gender norms (e.g., household roles), health seeking behaviors (e.g., seeking treatment of STIs) and violence (e.g., participation in peer violence).

The decision was made to use self-administered surveys, rather than interviewer-administered surveys, in order to collect personal and sensitive information from a large number of young men in multiple school settings. The questionnaire was developed already in earlier phases of the YMI project. The survey was pre-tested in all sites and adjustments were made accordingly prior to administering the baseline. Given the low amount of missing data on the completed baseline surveys (on average, questions were answered by 95% of the young men surveyed), the self-administered questionnaire successfully met the needs of this study. The data collectors shared that while filling out the surveys the young men were quiet and comfortable asking questions. In only a few cases the data collectors reported some participants being disruptive. There were no reports of young men treating the survey as a test

or noteworthy problems with the survey administration procedures. All research subjects gave their consent to participate.

A research consultant was present during this period to explain the surwey, discuss the informed consent process and obtain written consent from each student prior to the start of the survey. The research consultant was also available to answer any questions that arose while completing the questionnaire. While no personal identifiers were collected, each student was assigned a unique code in order to match baseline and endline responses.

The questionnaire was divided into several sections in order to gather information for the evaluation, as well as to provide understanding of the situation of these young men. The sections were as follows:

. General background information: included questions about family, home, demographics, socioeconomics; . Views about Men and Women: included the 17 main items from the GEM Scale . Life experiences including questions about experienced and perpetrated violence, gender based violence . Mental health, health seeking behaviors, smoking, alcohol and substance; . Social networks and social support . Participation in program intervention activities (workshops, ‘’Be a Man club club (BMK), exposure to campaign activities etc)

To assess the young men’s views about men and women roles, the Gender Equitable Men (GEM) Scale were used. The GEM Scale is a widely used and tested instrument which assessing roles of men and women in the home, in relationships, acceptability of violence against women, and attitudes towards homosexuality. The survey instrument includes the 17 main items for the GEM scale. Instruments for young men in Banja Luka, Pristina and Tirana were the same. Questionnaire in Belgrade was different because it had to be adapted to the requirements of their relevant educational institutions. Research areas are the same as in questionnaires in other cities, but the questionnaire contained a smaller number of questions and most of them were differently

worded. At endline, we added a detailed section on program exposure designed to measure participants’ engagement in YMI and how they valued the various program activities. Within the statistical analysis, we have calculated measures of descriptive statistics, frequencies, percentages, arithmetic means. The values of variables in the different phases of research were compared through nonparametric tests. We used tests for two related samples: Wilcoxon test and McNemar test. Survey is conducted collaboratively between CARE, local partners NGOs and the consultant. Local partners NGOs secured permissions to enter the schools and collect questionnaires. Leading coordination role was done by the CARE project manager.

Participants

Research respondents were similar across all four locations (Banja Luka in Bosnia and Herzegovina, Belgrade in Serbia, Pristina in Kosovo, Tirana in Albania) in terms of sex, age and a few other characteristics. All respondents were young men, aged 15-18 years. In the final study, in almost every city was a smaller number of respondents because some of them in the meanwhile dropped out from school. Besides that, some were not in school during final testing. We also excluded from end line data, respondents who said they had never heard about project and who did not participate in any project activity. Such was about 5-10 % in each city. Overall, following number of young men participated in both phases of the research: 377 from Banja Luka, 162 from Pristina, and 375 from Tirana, 180 from Belgrade.

Table 1: Number of respondents from Banja Luka, Belgrade, Pristina and Tirana

in both research phase

Banja Luka Pristina Tirana Belgrade Phase f f f f Participated in both phases 377 162 375 180

Intervention program

CARE Northwest Balkans launched the Young Men Initiative (YMI), a program designed to build more equitable attitudes and behaviors with young men and decreased both gendered and peer violence. YMI worked with young men aged 15-19 in schools to discuss and critically reflect about issues such as masculinity, gender norms, sexuality and violence, both through educational workshops and a social marketing lifestyles campaign. YMI interventions included group workshop and the “Be a Man” campaign. Implementing YSA staff participated in the design of the program and campaign, and facilitators were trained together to help ensure consistency across the different sites. Most of activties were implemented in period Oct 2014 – May 2016 between baseline and endline survey. A similar package of activities was implemented in each of the schools, including:

 Group Educational Workshops: YMI developed a serious of workshops (20 sessions) that were conducted over several months with groups of young men. Workshop sessions addressed multiple topics, including male norms, expressing emotions, labeling, negotiating skills, decision-making, anger management, role-models, homosexuality, sexual health, drugs and alcohol use, peer violence and violence against women. Sessions included interactive approaches that provoked dialogue and reflection by participants.  ‘Be a Man’ Campaign (locally called Budi Musko): The lifestyles campaign was developed by an experienced social marketing group, SMART Kolektiv from Belgrade, in close collaboration with young men from all project countries. Campaign activities and materials were presented in schools and reinforced many of the same topics addressed in the workshops, including sexual health (e.g., promoting condom use), violence prevention and more gender-equitable male norms. Several materials were developed, including posters, t-shirts and brochures. Activities were open to all young men in the schools and often used significant days (International day for human rights; Day against violence; World AIDS Day) to hold educational and entertaining activities, including quizzes, music contests, graffiti art and street fairs. Some of campaign activities were organised in all cities are: violence prevention campaign “React as Human” (flashmob actions, conference, workshops, video’s, lectures etc); Signing of declaration against violence. Beside that in Prishtina they organise: creating of video for international violence day;

drawing murals; campaign Love, Respect and Healthy relationships; campaign with Motto “Boys of Be a Man Club cook! What about you?''; campaign for International Day of HIV/AIDS; 16 Days of Activism “Prevention of gender-based violence”; campaign No- Violence etc . In Banja Luka they organise: Fun run race against violence ; International womans day action; Be a Man – show your talent; action on city square against labelling each other; Flash mob on city square against drinking and driving etc. In Belgrade they organised: BMK members distributing materials, flyers, brochures, promoting BMK; placing posters in school (BMK, Pazisex posters and stickers); BMK footbal matches together with promotion with of materials; „Chalk walk“ action, writing slogans and selected messages on visible pavements/walks in front of school; action on the grand premiere of movie ’’Next to me’’; action for 8th of „Who was your role model while growing up?“. In Tirana they organised 39 campaign actions. Some of the are: Teaser Campaign in High School; 6 TV-show, and 30 radio spots; Family week, promoting fatherhood campaign; drawing of murals; International day of woman; International friendship day “ My friend is better than yours”; Conference of Launching Fatherhood Campaign etc.

Limitations

A general limitation of any quasi-experimental study design is that selection bias cannot be ruled out, since study participants are not randomly assigned to intervention sites. That is, since participants volunteer to participate, those participants may be different in some way than the general population.

To understand what happened in the intervention schools the survey included questions about program exposure. However, this analysis does not control for selection bias, that young men participating in the intervention may have somehow been different for the outcomes of interest before participation, thereby making them more likely to be interested in the program activities.

Using a self-administered survey can be thought of as strength as well as a limitation. By allowing the young men to fill out the survey themselves, they may be more willing to share sensitive or private information than they would in a face-to-face interview. However, a

potential problem with self-administered surveys is that young men may not understand the questions, and may not feel able to ask the data collector for clarification due to embarrassment, concerns about privacy, etc. Efforts were made to reduce this limitation by pre-testing the survey with a similar group of young men in each site to ensure comprehension/simplicity, and by having young men data collectors present during survey administration.

Finally, as this data is specific to certain schools and locations within the different study countries, comparisons between sites can pose difficulties. While it is possible to compare one school to another, these data do not say anything that can be generalized to young men as a whole in these cities, or countries. Rather, the data tell a detailed story only about young men in those specific schools.

RESULTS

The results will be presented by areas of research. During the analysis of the results of the research we didn’t do comparison between young men from different cities. Cities from couple countries are quite different contexts, and we think its not appropriate to compare the results.

Gender relations

Work at home

Table 2: Participation in household tasks (in last 3 months)

Work in home in last Banja Luka Pristina Tirana 3 months (once or more) B E B E B E

Cooking food 49,1 59,7 45,7 54,3 40,7 41,4

Cleaning house 68,5 74,6 64,2 62,9 37,7 40,5

Washing clothes 23,4 25,2 10,5 19,7 9,7 13,3

Fix or repair in house 69,5 76,7 69,8 70,4 65,7 61,3

This table presents the results regarding involvement of young men in the household duties. The results refer to young men in Banja Luka, Tirana, Pristina (in the adapted questionnaire applied to the population in Belgrade this question was not used).

In the final survey young men from Banja Luka were more involved in all aspects of household tasks and duties (cooking, cleaning, washing, caring for others, household repairs). During the period of final survey there was greater participation in the field of food preparation, washing, and household repairs in Pristina. In Tirana, the results are generally equal in almost all areas, but there is progress when it comes to cleaning, cooking and washing tasks.

Based on the results of participation in various tasks we have reached an average measure of the overall participation in the baseline and endline survey. When we compare the involvement in household tasks, we see that in all three cities (Banja Luka, Pristina and

Tirana) there is progress but only in Banja Luka this progress is statistically significant (z = - 2.028; p = 0.043)

Correlation between participation in household tasks and other phenomena

In Pristina young men participate more in household tasks if their attitudes about gender roles and gender norms are more equitable. Also, young men whose fathers are more educated participate more. In Tirana, young men who have more equitable gender roles are more involved. In Banja Luka, a statistically significant difference with other phenomena was not found.

Gender attitudes

We used a modified Gender Equitable Men scale to assess boys’ alignment to various attitudes related to gender. The full scale included fourteen items, and boys chose whether they strongly agreed, partially agreed, or disagreed with each item at both baseline and endline. For ease and specificity of analysis, we present the findings broken into three separate indexes: (1) Gender Roles; (2) Gender Norms; and (3) Homophobia. A fourth index on boys’ attitudes related to violence is presented under the project theme of violence (in the subsequent subheading). In the following graph we can see young men attitudes towards gender roles, norms and homophobia. Larger index percentage points to more tolerant and equitable attitude regarding this sphere. The survey results show that in the area of gender relations progress has been achieved in all cities. In the endline survey respondents have a more tolerant attitude towards gender roles, gender norms and persons with homosexual orientation. For example, in Banja Luka a progress has been achieved in all spheres by 3-9%, in Pristina 12-17%, in Tirana 2-8%, and in Belgrade 4-8%. Thus, the greatest progress has been achieved in Pristina, but in general the respondents in Belgrade demonstrate the greatest gender equity in comparison to other cities. The progress has been achieved but we can conclude that the indices of gender equality are still quite low in all the cities (the range in the endline survey is 16-54%), so the work with

young people on this issue should be continued. We will present results separately for gender roles, gender norms and homophobia. Picture 1: Gender roles index

The gender roles index includes four attitude statements related to the distribution of tasks between men and women. These items are:  “A woman’s most important role is to take care of the home and cook for the family,”  “Changing diapers, bathing, and feeding kids are the mother’s responsibility,”  “A man should have the final word in his home,” and  “It is both a man’s and woman’s responsibility to prevent pregnancy.” Disagreement with the first three items and agreement with the fourth represent the more gender‐equitable responses. We tallied a percentage score for each boy by dividing their number of gender‐equitable responses by the total number of items in the index (four). The figures in Graph 3 above show the average percentage score for this index. A score of 100% would imply that every student gave the gender equitable response to all four questions. Attitudes about gender roles in the endline survey are more gender equitable in all cities. Index of gender roles in the endline survey is represented (in all cities) from 26-45%. Progress in comparison to the baseline survey is 4-17%. The highest progress is in Pristina, and the lowest is in Belgrade, but in this city the index is still the highest.

Picture 2: Gender norms index

Similar progress was achieved in the perception of gender norms. The gender norms index includes three attitude statements related to socially constructed characteristics of men and women. These items were:  “It is okay for men to cry and show their emotions in public,”  “The most important quality for a man is physical strength,” and  “It’s more acceptable for a boy to skip class than a girl.” We counted agreement with the first item and disagreement with the second and third items as gender‐equitable responses, and calculated a percentage score for the index.

Attitudes about gender norms in the endline survey are also more gender equitable in all cities. Index of gender norms in the endline survey is represented (in all cities) from 37-54%. Progress in comparison to the baseline survey is 2-12%. The highest progress is in Pristina, and the lowest in Tirana.

Picture 3 : Homophobia

The homophobia index includes three attitude statements:  “I would never have a gay friend,”  “I would be ashamed to have a homosexual son,” and  “It’s okay to hit or kick a gay person if he flirts with me.”

Attitudes about homophobia in the endline survey are more negative in all cities. Index of negative attitudes toward homophobia in the endline survey is ranged (in all cities) from 16- 33%. So, we see that in this segment of gender relations numerous stereotypes toward gay persons still remain. Most tolerant attitudes were recorded in Tirana. Progress in comparison to the baseline survey is 3-12%. The highest progress in attitudes was recorded in Pristina.

Correlation between gender relations and other phenomena

We counted the correlation between gender relations and other phenomena. What is statistical method ‘’correlation’’ and what correlation coefficients man, it was explained in a footnote.1

1 Correlation analysis is used to determine whether the values of two variables are associated.The correlation coefficient r is a number between -1 and 1. In general, the correlation expresses the degree that, on an average, two variables change correspondingly. If one variable increases when the second one increases, then there is a

It is interesting that in Banja Luka attitudes towards gender roles, norms and homophobia are not significantly correlated with violent behavior, age, education of parents. In Pristina, violent behavior towards peers is negatively correlated with more equitable gender norms (r = 0.179; p = 0.032). So, young men who have more gender equitable attitudes are less prone to violent behavior. In Pristina homophobia is also correlated with peer violence (r = 0.211; p = 0.001), but also with lower levels of education of the mother (r = 0.161; p = 0.047), and father (r = 0.212; p = 0.001). In Tirana, more equitable attitudes toward gender roles are correlated with the age of young men. Those who are older have more gender equitable attitudes (r = 0.173; p = 0.001). More equitable gender norms are correlated with less violent behavior (r = - 0.138; p = 0.01), less violence against girls (r = - 0.115; p = 0.035). Homophobia is correlated with more violent behavior (r = 0.202; p = 0.001) and a younger age of young men (r = - 0.162; p = 0.003). In Belgrade, more equitable gender roles are correlated with less violence against girls (r = - 0.150; p = 0.048) and older age of young men (r = 0.172; p = 0.022). More equitable gender roles are negatively correlated with violence against girls (r = - 0.237; p = 0.002). Homophobic attitudes are correlated with violence (r = 0.153; p = 0.040) and violence against girls (r = 0.182; p = 0.016). We can conclude that the results are logical and that generally there is a correlation between inequitable gender attitudes and different forms of violence.

positive correlation. In this case the correlation coefficient will be closer to 1. If one variable decreases when the other variable increases, then there is a negative correlation and the correlation coefficient will be closer to -1. The p value is the probability that you would have found the current result if the correlation coefficient were in fact zero (null hypothesis). If this probability is lower than the conventional 5% (p<0.05) the correlation coefficient is called statistically significant. Stars (*) behind a number that indicates coefficient r, means that correlation is statistically significant.

Health of young men Mental health Table 3: Mental health

Banja Luka Pristina Tirana Belgrade

B E B E B E B E

Sadness 85,3 88,5 80,1 67,3* 76,6 89,5 71,1 74,1

Stress or anxiety 73,6 81,5** 65,2 57,5 75,1 82,8** 68,7 72,8

Depression 24 32,5* 40,6 31,3 24,8 32,1* 30,4 25,9

Suicidal thoughts 11,1 19** 3,7 7,6* 7,9 8,7 9,4 9,9

As for the mental health, we see that the results in Banja Luka, Tirana and Belgrade are similar or even slightly worse than in the endline survey. This may be due to the fact that young men are facing with increasing challenges as they grow up. These challenges can be related to the searching of their own identity, choice of emotional partners, social independence, etc. Only in Pristina, in all aspects of mental health there is an improvement in 3-13% of young men. We asked young men to whom they turn when they need some help. In all cities young men most often turn to their mothers (20-28%), both parents (17-23%) or a friend (14-16%). Approximately 9-19% of them do not seek help when experiencing a problem.

Alcohol and drugs Picture 4 : Drinking alcohol

As for the consumption of alcohol results have shown that young men were more prone to drinking the alcohol during the endline survey. In the endline survey 6 -20% of young men from all the cities drink more alcohol. This negative trend in most cities is consistent with some previous surveys. Despite numerous prevention programs, adolescents drink more alcohol while growing up. It seems that this is a regular follow-up trend of growing up of young people in the Balkans. Indifferent or even benevolent attitude of the society towards drinking alcohol by males often contributes to this. We note that most alcohol has been consumed by young men from Banja Luka and Belgrade, and by far the least from Pristina. This may be the result of socialization and religious and cultural differences between young men from this area.

Correlation between the consumption of alcohol and other phenomena

We analyzed whether the consumption of alcohol and marijuana is correlated with the age of young men, education of their mother and father, and exposure to violence.

In Banja Luka and Pristina drinking of alcohol is correlated with the exposure to violence (Banja Luka: r = 0.189; p = 0.001; Pristina: r = 0.222; p = 0.009). In Belgrade and Tirana, these findings have not been confirmed.

Picture 5: Smoking marijuana

The situation with marijuana shows similar trends as well as consumption of alcohol. In the endline survey a higher percentage of young men reported that they have consumed marijuana in the last three months. The only positive exception is the young men from Belgrade who consumed marijuana less in the endline survey. However, in both phases of the survey they are still leading in the consumption of marijuana.

Correlation between the consumption of marijuana and other phenomena

In Banja Luka, the consumption of marijuana correlated with exposure to violence (r = 0.300; p = 0.001) and higher level of education of mothers (r = 0.130; p = 0.013) and fathers (r = 0.140; p = 0.007). Correlation with the higher education of parents is somewhat surprising, but it may be associated with greater openness to new experiences, which usually accompanies the category of people who are educated.

In Pristina and Tirana, the consumption of marijuana is correlated with the exposure to violence (Pristina: r = 0.198; p = 0.020; Tirana: r = 0.121; p = 0.023).

In Belgrade, we have not determined statistical correlation between the consumption of marijuana and other phenomena.

It should be noted that in all the cities (except in Belgrade) there is a correlation between the consumption of alcohol and marijuana (r = 0.255, p = - 0.292).

Violence Peer violence Picture 6 : Perpetrated emotional violence toward peers

Results about committed violence are different among cities but similar if we compare the baseline and endline survey. There was no dramatic change. Committed emotional violence is not present to a large extent, except in the case of Belgrade. In Banja Luka, Pristina and Tirana it ranges from 6-11% in the endline survey. Emotional violence has increased in Pristina during the period of the endline survey, while it significantly decreased in Belgrade. In Tirana and Banja Luka it stayed almost the same.

Picture 7 : Perpetrated physical violence toward peers

Physical violence has been committed to a greater extent than emotional. In the endline survey, in Banja Luka, Pristina and Tirana it ranges from 9-18%, while in Belgrade it is significantly higher at 33.9%. If we compare the two phases of survey, we see that in the final phase of the survey physical violence has decreased in Banja Luka, Tirana and Belgrade, while in Pristina it has increased. These changes are not large and are not statistically significant, but the results in three cities indicate that the program had a positive effect on violent behavior.

Correlation between peer violence and other phenomena

In Banja Luka, violence towards peers is correlated with exposure to violence in childhood and the past (r = 0.163; p = 0.002), as well as with the consumption of alcohol (r = 0.353; p = 0.001).

In Pristina and Tirana, violence towards peers is also correlated with exposure to violence in childhood and the past (Pristina: r = 0.185; p = 0.031; Tirana: r = 0.246; p = 0.001), inequitable gender norms (Pristina: r = - 0.179; p = 0.032; Tirana: r = - 0.138; p = 0.001) and consumption of alcohol (Pristina: r = 0.333; p = 0.001; Tirana: r = 0.397; p = 0.001).

In Belgrade, violence towards peers is correlated with exposure to violence in childhood and the past (r = 0.188; p = 0.013).

Gender based violence

Picture 8: Attitudes toward gender based violence

Attitudes about to gender based violence are more negative in all the cities in the endline survey, which is certainly a positive and affirmative data. Index of negative attitudes towards gender based violence in the endline survey is ranged (in all cities) from 61-73%. So, we see that most young men condemn violent behavior which is gender based. Although, what worries is the percentage of 30-40% of young men who in a more implicit or explicit way support this type of violence. These attitudes can certainly be "the lobby" of violent behavior. The most negative attitudes towards this type of violence are recorded in Belgrade. Progress in comparison to the baseline survey is 3-7%.

Table 4: Violence toward (ex)girlfriend Banja Luka Pristina Tirana Belgrade

B E B E B E B E

You humiliated your 0,8 1,3 3,1 1,2 1,8 2 14 16,3

(ex)girlfriend

You hit or punched your 0,5 0,3 0 0,6 0,9 2,8 4,5 6,1 (ex)girlfriend

You had sex with 10,1 3,2** 1,9 0,6 3,1 2,4 7 8,5 your(ex) girl friend when she didnt want to have

Psychological and physical violence against girls or ex-girlfriends is not much represented, except that it is more prominent in Belgrade. Psychological and physical violence against girls in Banja Luka, Pristina and Tirana in the endline survey is represented in 4.5% of respondents, while in Belgrade 16% of respondents confirmed this type of violence. It should be noted that there is no significant difference in the baseline and endline survey. As for the sexual violence, it is also most prominent in Belgrade (in 8.5% of young men in the endline survey). In other cities it is present in 3% of respondents. There is no difference in the baseline and endline survey, except in Banja Luka. In this city sexual violence has decreased from 10.1% to 3.2%, and this difference is statistically significant.

Correlation between violence against girlfriends and other phenomena

In all cities similar correlations between violence against girlfriends (current or ex) and other phenomena have been found. We will mention only what is statistically significant.

In Banja Luka, violence against girlfriends is correlated with exposure to violence in childhood and the past (r = 0.408; p = 0.001), violence towards peers (r = 0.205; p = 0.001) and consumption of alcohol (r = 0.203; p = 0.001).

In Pristina, violence against girlfriends is correlated with exposure to violence in childhood and the past (r = 0.436; p = 0.001), violence towards peers (r = 0.345; p = 0.001) and consumption of alcohol (r = 0.349; p = 0.001).

In Tirana, violence against girls is correlated with previous exposure to violence (r = 0.289; p = 0.001), violence towards peers (r = 0.407; p = 0.001), more inequitable gender norms (r = - 0.115; p = 0.035) and consumption of alcohol (r = 0.292; p = 0.001).

In Belgrade, violence against girls is correlated with previous exposure to violence (r = 0.466; p = 0.001), violence towards peers (r = 0.217; p = 0.004) and consumption of alcohol (r = 0.349; p = 0.001). It is also correlated with stereotypical gender roles (r = - 0.150; p = 0.048) and more inequitable gender norms (r = - 0.237; p = 0.002).

Table 5: Violence toward gay people

Banja Luka Pristina Tirana Belgrade

B E B E B E B E

You made verbal abuse 3,4 3,2 2,5 4,3 8,1 3,3* 22,6 23,4 someone you thought was gay

You hit or beat someone 3,7 2,9 0,6 3,7 4,4 1,8 12,5 15 you thought gay

Psychological and physical violence against homosexuals is not much represented, except in Belgrade. Psychological violence in Banja Luka, Pristina and Tirana in the endline survey is represented in up to 4% of respondents, while in Belgrade 23% of respondents confirmed psychological and 15% physical violence. It should be noted that there are no statistically significant differences in the baseline and endline survey, but in most cases percentages of violence are lower in the endline survey.

Reactions on violence

Picture 9: Honour of Young Men and violence

In the endline survey, there is a smaller percentage of those who would engage in physical confrontation if someone would insult their family. The percentages are lower by 3-4% in Banja Luka and Tirana, and in Pristina the result is lower by as much as 16%. These data speak affirmatively about the effects of the program, but it should be noted that these percentages are still high. 70-84% of young men is still ready to engage in physical confrontation if provoked.

Table 6 : Reactions on violence

Banja Luka Pristina Tirana

B E B E B E

What would you do if you 95,9 95,7 95,6 94,4 88,8 92,6 saw your friend hit his girlfriend

What would you do if you 77,6 78,8 73,3 62 61,5 62,1 saw your friend hit another young men

Most of young men say that they are ready to react in a protective way in case of violence against a girl, i.e. to try to end the conflict and protect the victim. Results are similar in all the cities, in the baseline and endline survey and they range from 89-96% (in the adapted questionnaire applied to the population in Belgrade, this two questions were not used).

It is similar with stopping violence among peers, only the percentages are slightly lower and range from 62-78%.

Participation of young men in intervention program and its effects

Table 7 Participation in Be a Man club

Participation in Be a Man club Banja Pristina Tirana Belgrade Luka

During last 2 school years heard about any activities or 97,3 89,5 96,2 98,3 events hosted by a Be a Man club

During last 2 school years, attended on event hosted by a 56,7 72,6 57,8 78,8 Be a Man Club during the school day

During last 2 school years, attended any event (community 39,8 46,3 43,5 29,9 action) or workshop hosted by a Be a Man Club on a weekend or outside of regular school hours

During last 2 school years become a member of a Be a 10 39 48,8 29,4 Man club

In this table we can see the participation of young men in the "Be a Man club". We see that 89-98% of young men have heard about the Club. Around 56-79% of them have taken part in some activities during the school day, and 29-46% outside of the school day or school. Different percentage of participants in the cities has become a member of the Be a Man club. In Banja Luka, 10% of participants have joined the club, in Pristina 39%, in Tirana 49%, and in Belgrade 29%.

Table 8: Exposure to Be a Man campaign

Banja Pristina Tirana Belgrade Exposure to Be a Man campaign Luka

Budi Musko Klub leaflets 45,6 71,4 69.2 78,8

Budi Musko Klub facebook page 68,9 84,4 84,9 46,9

Budi Musko Klub posters 47,3 69,5 78,6 77,7

Budi Musko Klub t-shirts 42,9 67,5 59,2 60,9

Pazi sex campaign posters 17,2 31,0 40,2 55,3

Pazi sex web site 17,9 39,4 35,6 36,1

Pazi sex promotion event 11,8 33,5 37,6 31,5

React as human posters 44,6 57,7 71,6 71,7

React as human facebook messages 44,2 54,4 69,0 47,8

React as human event 37,8 57,6 62,8 57,2

In this table we see to what extent have young men from four cities noticed some of the campaign activities. The highest percentage (45-84%) has noticed flyers, posters, T-shirts, and heard or visited the Be a Man Facebook page. They have also to a great extent (37-71%) heard of the various activities (React as human posters, Facebook messages, events) within the campaign.

Picture 10: Participation and influence of workshops

In this chart we see the results relating to the effects of participation in the workshops. Approximately 45-82% of young men from all the cities say that they remember club- classroom sessions. 19.7% of them in Pristina, about 45% of them in Banja Luka and Belgrade, and 60.5% in Tirana believe that their friends would now solve conflicts without fighting.

Table 9: Correlation between participation in BMK and other phenomena

Drinkin Work in Peer Gender Gender g house violence roles norms alcohol Banja Luka r ,102 ,046 ,112* ,116* -,143** p ,125 ,388 ,034 ,028 ,006 Participation in Pristina ** ** ** ** Be a Man club r ,306 -,210 ,345 ,257 ,017 p ,003 ,010 ,000 ,002 ,829 Tirana r ,070 ,047 ,105 ,187** ,084 p ,349 ,378 ,050 ,000 ,113 Belgrade r - ,028 ,152* ,140 ,214* p - ,716 ,045 ,065 ,015

In this table we see whether there is a correlation between participation in the BMC activities, and the attitudes and behavior of young men. In Banja Luka, greater participation in the work of BMC is correlated with more equitable gender norms and roles, and less drinking of alcohol. In Pristina those who participated in the work of BMC do more work at home, they are less prone to peer violence, they have more equitable gender attitudes and drink less alcohol. In Tirana, participation in the Club is correlated with more gender equitable roles and norms. In Belgrade, there is also a correlation between more equitable gender roles and less alcohol drinking.

Table 10: Correlation between exposure to BMK campaign and other phenomena

Work in Peer Gender Gender Drinking house violence roles norms alcohol Banja Luka r ,138* ,095 ,121* ,154** ,022 p ,046 ,088 ,027 ,005 ,685 Exposure to Pristina ** ** * * BMK r ,378 -,227 ,212 ,213 -,047 camapign p ,000 ,009 ,015 ,015 ,590 Tirana r ,214** -,094 ,327** ,177** -,084 p ,005 ,089 ,000 ,001 ,122 Belgrade r - ,006 ,101 ,036 ,127 p - ,942 ,184 ,636 ,147

In this table we see the correlation between the exposure to the campaign and attitudes and behaviors of young men. In Banja Luka, there is a correlation with doing more work at home, more equitable gender norms and roles. In Pristina and Tirana there is a correlation between exposure to the campaign with doing more work at home, more equitable gender roles and norms. In Pristina there is also a correlation with a lesser peer violence. It is interesting that in Belgrade no correlation was determined between the exposure to the campaign and some attitudes and behaviors of young men.

Table 11: Correlation between involvement in BMK workshops and other phenomena

Work in Peer Gender Gender Drinking house violence roles norms alcohol Banja Luka r ,142* ,081 ,084 ,204** ,044 p ,034 ,137 ,122 ,000 ,413 Involvment in Pristina ** * BMK r ,281 -,117 ,137 ,214 -,008 worskohps p ,007 ,163 ,106 ,012 ,923 Tirana r ,090 -,078 ,022 ,147** ,049 p ,232 ,147 ,687 ,005 ,353 Belgrade r - -,198** ,168* ,250** ,049 p - ,009 ,027 ,001 ,582

In this table we see whether there is a correlation between the level of participation in workshops and other phenomena. In all the cities there is a correlation between participation in workshops and more equitable attitudes toward gender roles. In Banja Luka, participation in workshops is also correlated with higher level of doing work in the home. In Belgrade, a correlation was also determined with lesser peer violence, and more equitable gender norms. All these data show that participation in BMC, exposure to the campaign, and participation in workshops have contributed to certain improvements in the attitudes and behaviors of young men in different spheres of their lives.

CONCLUDING REMARKS

In this chapter we will integrate and interpret key research results and make main conclusions. Everything will be divided based on the research topics. Key results and priorities for individual cities will also be underlined. At the end we will reflect on influence concrete program activities had on attitudes and behaviour of young men.

Gender relations

In the beginning we will reflect on participation in daily routine at home. In all cities, results of the endline research show greater level of participation of young men in different daily activities at home (cooking, washing, cleaning, etc.). This progress is the most evident in Banja Luka. It appears that programmes such as this one can contribute to greater sensibility of young men in relation to their participation in daily activities at home. This is maybe indirectly linked with development of more sensitised gender norms. Namely, additional statistical analyses show that participation in daily routine at home is linked with more tolerant attitudes towards gender roles and norms.

Research results show that progress in all cities had been made in the field of attitudes on gender relations. In the endline research respondents have more tolerant relations towards gender roles, gender norms and homosexuals. For example, in Banja Luka improvement of between 3 and 9% has been evident in all areas, in Pristina it is between 12-17%, in Tirana 2- 8%, and in Belgrade 4- 8%. Said this, greatest progress had been made in Pristina but, compared to other cities, respondents from Belgrade show greatest respect of gender equality. Progress has been made, but we can conclude that indexes of gender equality are still rather low in all cities (range in the endline research is 16-54%), and that work with young men in this respect should continue. Correlations between gender relations and other phenomena point out to the importance of attitudes related to gender relations. Namely, stereotype attitudes on gender relations are linked with peer violence and violence against young women. One of the ways to combat and prevent violence can be to work on greater gender equality.

Based on these results we can conclude that at the end of the programme significant improvements have bene made in the area of gender relations. That means that this concept of

work gives good results in this area and that it should continue in the future as gender stereotypes are still highly evident with young men. This is especially expressed through very much present homophobia.

Health

Within health area we have been dealing with mental health of young, use of alcohol and marihuana. Results in this area are not very promising. Similar or event somewhat worse results are evident in the endline research. In majority of cities, but in Pristina, at the end of the programme young men showed higher level of grief, stress and anxiety. Percent of those who confirm these emotional statuses are quite high (from 59% to 90%). Depression is little less expressed (in the endline research from 26% to 32%), but it is still quite significant percentage. Results on presence of suicidal thoughts are very worrying, due to possible great consequences. For example, 19% of young men in Banja Luka confirm presence of suicidal thoughts, what is a catastrophic data.

Endline survey results show that higher percent of young men in all cities drink alcohol. Compared to the baseline research results, this number had increased between 6 -20 % of young men in all cities. Situation is similar with use of marihuana. In the endline research higher percentage of young man, but those in Belgrade, state to be using marihuana in last three months. We think this negative trend is a consequence of young men adolescence process followed by acceptance of some peer norms that are not positive. Additionally, research results show that one of the causes could be exposure to violence in the past. Furthermore, young men are more and more confronted with issue of future employment, financial emancipation, and meaning of life. All these challenges are creating a pressure that can cause bad mood or even some more severe psychological conditions. These data show that more attention, institutionally wise as well, should be given to adolescence process of youth and their mental health. There are only few counselling centres that deal with this issue and where a young person could get an advice. This is linked with resistance and stereotypes of youth towards psychologists.

Violence

Concerning peer violence, both psychological and physical, it is not highly present but in Belgrade. In Banja Luka, Pristina and Tirana endline survey results confirm psychological violence up to 11%, and physical up to 18%. At the end of the programme we can see some positive signs. In the endline research, psychological and physical violence in most of the cities are less expressed then in the beginning of the programme. Those changes are not great, but are promising. Only exception is Pristina where level of violence had increased for several percentages. In the endline research, attitudes on gender-based violence are more negative in all cities, what is positive and affirmative data. Majority of young men condemn gender-based violence, but the fact that 30-40 % of young men support this type of violence is still very worrying. Psychological and psychical violence towards young women and gay people is not very much present, but it is again more evident in Belgrade. There are no significant differences between baseline and endline research. Positive thing is that great majority of young men stress they would try to stop violence if they would see it in their surroundings. It is negative that there is still a tendency to thing that man honour can only be defended by force and fight. Furthermore, significant determinant of violent behaviour are exposure to violence in the past and use of alcohol. That means that violent behaviour can be conditioned by socialisation, as well as by some concrete situational factors. We can conclude that, with the exception of Belgrade, different types of violence are not so present. Positive thing is that existence of violence is slightly lower in the endline research. In future more attention should be given to introducing young men with roots of ‘men honour’ and what are the negative consequences it carries with it.

Effects of concrete programme activities

Results had shown that vast majority is familiar with the Be a Man club, and significant percentage of them had participated in some activities. Around 89-98% young men had heard about the Club, and 56-79% had participated in one of the activities organised during a school day. Significant percentage (45-84%) had been exposed to some of the activities organise during the campaign. Flayers, posters, T-shirts and Be a Man club Facebook page had the most visibility. Around 45-82 % young men from all cities claim to remember the classroom

sessions. All this points out to wealth and variety of project activities through which project implementing partners approached and to some extent influenced majority of youth in schools.

Question is to what extend did the different project activities influenced young men and where was the most effect? When we look at the results we can see that all aspects of the work (participation in the work of the Be a Man club, campaign, workshops) had positive effect on the development of gender equality roles and norms. Additionally, there is often a link with participation in daily routine at home. In several cases a link between participation in project activities and reduced peer violence had been identified. Said this, we can conclude that analyses of concrete project activities confirms earlier findings that the highest progress and effect had been made in terms of attitudes towards gender relations.

Interesting question that could be asked is which activities were the most useful? If we see how many positive correlations had been achieved between project activities and different life spheres, we can see that results are almost even. That means that all three aspects of the work had contributed to the accomplishment of project goals, and slightly stronger impact has been made on those that participated in the Be a Man club. This is no surprise as all participants from a Be a Man club took more active and more committed part in most of the programme activities.

Situation and specificities in individual cities

In this paper we will summarize main findings in the cities and emphasize the priority issues for work in the future.

Progress has been made in all cities related to development of gender equality attitudes. That is especially evident in Banja Luka. Still, gender stereotypes are still very evident in all cities and they should be tackled in the future. Situation in Belgrade is slightly better.

Mental health in most of the cities, but in Pristina, is equally worsened with process of adolescence. High percentage of young men from Banja Luka who express high level of suicidal thoughts is especially worrying. This problem should be tackled with some programmes that would be implemented in Banja Luka in the future.

Endline results show that percentage of those using alcohol and marihuana increased in all cities. This problem is the most evident in Belgrade, while use of alcohol is the least evident in Pristina.

Psychological and physical violence is not so much evident, but in Belgrade. In this city even 45% confirm psychological violence, and 34% physical. Said this, this is definitely one of the priority problems in schools in Belgrade. Violence towards young women is the most evident in Belgrade. Problem in all cities are attitudes about gender-based violence. Approximately 30-40% of young men from all cities supports gender-based violence. The positive thing in all cities is that majority of young men points out they would be react in case of violence and try to protect a victim.

Conclusions