Mums and Kids Matter Evaluation: Final Report MH – Children and Young People, NSW Ministry of Health 14 October 2016 Bold ideas | Engaging people | Influential, enduring solutions MH – Children and Young People, NSW Ministry of Health Mums and Kids Matter Evaluation: Final Report | 14 October 2016 This page is intentionally blank. © Nous Group n o usgro up.com | i | MH – Children and Young People, NSW Ministry of Health Mums and Kids Matter Evaluation: Final Report | 14 October 2016 Contents 1 Executive Summary............................................................................................................................ 1 1.1 Overview ................................................................................................................................. 1 1.2 Recommendations to further improve the impact of the MaKM Program ............................ 3 2 Background and context .................................................................................................................... 4 2.1 About the evaluation .............................................................................................................. 4 2.2 MaKM Program background ................................................................................................... 4 3 Methodology...................................................................................................................................... 6 3.1 Evaluation plan ........................................................................................................................ 6 3.2 Mixed methods approach, ethical guidelines and data limitations ........................................ 7 3.3 Governance structure ............................................................................................................. 7 3.4 Conceptual framework............................................................................................................ 8 3.5 Best practice principles underpin the evaluation ................................................................... 8 4 Findings .............................................................................................................................................. 9 4.1 What has been delivered under the MaKM Program? ......................................................... 10 4.2 How well does the MaKM deliver services? ......................................................................... 30 4.3 What impact has the MaKM Program had? .......................................................................... 43 4.4 What are the future opportunities and priorities? ............................................................... 67 Appendix 1 Key lines of enquiry ................................................................................................. 80 Appendix 2 Methodology ........................................................................................................... 81 Appendix 3 Economic appraisal assumptions ............................................................................. 86 Constant model assumptions .......................................................................................................... 86 Mother and child pathway assumptions ......................................................................................... 88 Appendix 4 Ethical guidelines ..................................................................................................... 94 Appendix 5 Data limitations ....................................................................................................... 95 Appendix 6 Stakeholders consulted ......................................................................................... 100 Appendix 7 Overview of MaKM programs................................................................................ 103 Appendix 8 Analysis of programs with comparable elements ................................................. 106 Appendix 9 Goal Setting Tool ................................................................................................... 110 Appendix 10 Grouping of MaKM Mental Health Diagnoses ....................................................... 113 Appendix 11 Care Planning Checklist.......................................................................................... 114 n o usgro up.com | ii | List of figures Figure 1: Overview of project activities and deliverables ............................................................................. 6 Figure 2: Nous’ adaptation of the RBA performance measurement framework .......................................... 8 Figure 3: Nous’ best practice evaluation principles ...................................................................................... 8 Figure 4: Participant characteristics,, .......................................................................................................... 12 Figure 5: Mental health risk factors affecting MaKM participants ............................................................. 12 Figure 6: Prevalence of each type of mental disorder amongst MaKM participants ................................ 14 Figure 7: Heat map of multiple diagnoses ................................................................................................. 15 Figure 8: Heat map of LHD referrals since the MaKM Program’s inception .............................................. 16 Figure 9: LHD referrals by quarter............................................................................................................... 17 Figure 10: MaKM Program referrals and the female population and birth rates of LHDs.......................... 18 Figure 11: Total and change in the number of MaKM Program mothers by month ................................. 19 Figure 12: Duration of packages and total MaKM Program participation .................................................. 20 Figure 13: Count and proportion of program packages in each quater...................................................... 21 Figure 14: Total number of services delivered by quarter per mother....................................................... 24 Figure 15: Total number of sessions delivered by quarter per mother ...................................................... 25 Figure 16: Total number of sessions delivered by quarter per mother ...................................................... 25 Figure 17: Direct and non-direct hours of service delivery per mother ..................................................... 26 Figure 18: Total number of sessions delivered by quarter per mother ...................................................... 26 Figure 19: Number and percentage of mothers participating in psychological therapy sessions each month .......................................................................................................................................................... 28 Figure 20: Number and percentage of mothers participating in parent education sessions each month . 28 Figure 21: Number and percentage of mothers with arranged external playgroups and childcare .......... 29 Figure 22: Number and percentage of mothers receiving parenting support and peer consultation........ 29 Figure 23: Breakdown of financial results from financial year 2014-15 ..................................................... 31 Figure 24: Breakdown of YTD financial results for the first three quarters of FY16 ................................... 31 Figure 25: Breakdown of MaKM Program FTE by role ................................................................................ 32 Figure 26: MaKM Program governance structure and referral pathways .................................................. 33 Figure 27: MaKM Program team organisational structure ......................................................................... 34 Figure 28: Lifetime trajectory for the typical mother cumulative cost of service utilisation ...................... 36 Figure 29: To what extent do you agree that the MaKM Program been implemented effectively? .......... 38 Figure 30: To what extent do you agree that the MaKM Program activities been implemented effectively? .................................................................................................................................................. 39 Figure 31: Referrer interactions with MaKM Program ............................................................................... 40 Figure 32: Six participants were interviewed out of 11 who expressed an interest in participating in the interviews for the evaluation ...................................................................................................................... 41 Figure 33: Exit feedback form responses from participants ....................................................................... 44 Figure 34: Comments from participant interviews ..................................................................................... 45 Figure 35: Vignette 1 ................................................................................................................................... 46 Figure 36: Vignette 2 ................................................................................................................................... 46 Figure 37: Family Coach Feedback Form assessment ................................................................................ 47 Figure 38: Family Coach Feedback Form assessment ...............................................................................