Evaluation of the Citizenship Awareness Program Evaluation Division October 2013 Research and Evaluation Research Ci4-119/2013E-PDF 978-1-100-23100-6 Ref. No.: E7-2013 Table of contents List of Acronyms .................................................................................................... iii Executive summary ................................................................................................ iv Purpose of the evaluation ................................................................................................. iv Citizenship Awareness Program profile .................................................................................. iv Methodology .................................................................................................................. v Evaluation findings .......................................................................................................... v Conclusions and recommendations ...................................................................................... vii Evaluation of the Citizenship Awareness Program - Management Response Action Plan (MRAP) ...................................................................................................... ix 1. Introduction ................................................................................................ 1 1.1. Purpose of the Evaluation ..................................................................................... 1 1.2. Citizenship Awareness Program profile...................................................................... 1 1.2.1. Program context and objectives ............................................................................. 1 1.2.2. Overview of Citizenship Awareness activities ............................................................. 2 1.2.3. Other activities in support of Citizenship Awareness objectives ....................................... 3 1.2.4. Governance of the Citizenship Awareness Program ....................................................... 4 1.2.5. Program resources ............................................................................................. 5 2. Methodology ................................................................................................ 6 2.1. Evaluation scope and approach .............................................................................. 6 2.2. Evaluation questions ........................................................................................... 8 2.3. Data collection methods ...................................................................................... 9 2.3.1. Interviews ....................................................................................................... 9 2.3.2. Site visits ...................................................................................................... 10 2.3.3. Ceremony exit surveys ...................................................................................... 10 2.3.4. Survey of new citizens ....................................................................................... 11 2.3.5. Administrative data review ................................................................................. 11 2.3.6. Literature review ............................................................................................ 12 2.3.7. Document review ............................................................................................. 12 2.3.8. Institute for Canadian Citizenship (ICC) case study ..................................................... 12 2.4. Strengths, limitations and considerations................................................................. 12 3. Evaluation findings ...................................................................................... 14 3.1. Relevance ..................................................................................................... 14 3.1.1. Continued need for Citizenship Awareness programming .............................................. 14 3.1.2. Consistency with CIC goals and government-wide priorities........................................... 17 3.1.3. Alignment with federal roles and responsibilities ...................................................... 18 3.2. Performance .................................................................................................. 19 3.2.1. Participation in CIC promotional activities .............................................................. 19 3.2.2. Knowledge of citizenship rights and responsibilities ................................................... 31 3.2.3. Impacts related to valuing Canadian citizenship ........................................................ 36 3.2.4. Impacts related to applying for Canadian citizenship .................................................. 39 3.2.5. Program management ....................................................................................... 42 3.2.6. Resource utilization ......................................................................................... 45 4. Conclusions and recommendations .................................................................. 51 4.1. Conclusions .................................................................................................... 51 4.1.1. Relevance...................................................................................................... 51 4.1.2. Performance .................................................................................................. 51 4.2. Recommendations ............................................................................................ 54 - i - List of tables Table 2–1: Summary of evaluation issues and questions ........................................................... 8 Table 2–2: Summary of interviews completed ....................................................................... 9 Table 2–3: Interview data analysis scale ............................................................................. 9 Table 2–4: Exit survey response rate ............................................................................... 11 Table 3–1: Distribution of Discover Canada publication formats ................................................ 20 Table 3–2: Web analytics of Discover Canada ..................................................................... 21 Table 3–3: Web analytics of CIC citizenship promotion web pages ............................................. 23 Table 3–4: Downloads of reaffirmation ceremony materials .................................................... 24 Table 3–5: Downloads of Canada’s Citizenship Week materials: ................................................ 25 Table 3–6: Web analytics for other CIC citizenship promotion web pages .................................... 26 Table 3–7: Citizenship judge promotional activities .............................................................. 28 Table 3–8: Reach of ICC activities ................................................................................... 29 Table 3–9: Survey results on the impacts of the study guide related to knowledge of rights and responsibilities ............................................................................................ 31 Table 3–10: Survey results on the impacts of citizenship ceremonies related to knowledge of rights and responsibilities ...................................................................................... 33 Table 3–11: Impacts related to knowledge of rights and responsibilities by presence of special elements ................................................................................................... 33 Table 3–12: Impacts related to knowledge of rights and responsibilities by presence of special elements, ceremony site and size ..................................................................... 35 Table 3–13: Survey results on the impacts of the study guide and citizenship ceremony related to valuing citizenship ....................................................................................... 37 Table 3–14: Impacts related to valuing citizenship by presence of special elements ......................... 38 Table 3–15: Impacts related to valuing citizenship by presence of special elements, ceremony site and size .................................................................................................... 39 Table 3–16: Expenditures for the Citizenship Awareness Program ............................................... 46 Table 3–17: Expenditures on citizenship-related communications activities, 2007-08 to 2011-12 .......... 47 Table 3–18: Citizenship-awareness related initiatives funded under the Multiculturalism Program ........ 50 List of figures Figure 2–1: CIC Citizenship Program logic model .................................................................... 7 Figure 3–1: Citizenship take-up rates ................................................................................ 15 Figure 3–2: Reasons for becoming a Canadian citizen for respondents to the survey of new citizens and the ceremony exit survey .......................................................................... 41 Figure 3–3: Most important reason for becoming a Canadian citizen for respondents to the survey of new citizens and the ceremony exit survey ....................................................... 41 - ii - List of Acronyms CAP Citizenship Action Plan CIC Citizenship and Immigration Canada CLB Canadian Language Benchmark CLPPD Citizenship