The Canadian Journal of Program Evaluation
Total Page：16
File Type：pdf, Size：1020Kb
The La Canadian Revue Journal canadienne of Program d’évaluation Evaluation de programme 34.3 Special Issue 2020 / Numéro spécial 2020 Evaluation in Indigenous Contexts Editor’s Remarks / Un mot de la rédactrice v Isabelle Bourgeois ARTICLES Evaluation in Indigenous Contexts: An Introduction to Practice 391 Robert P. Shepherd and Katherine A. H. Graham Framing the Discussion Section 35 Legal Framework: Implications for Evaluation 400 Pamela McCurry Indigenous Health Service Evaluation: Principles and Guidelines from a Provincial “Three Ribbon” Expert Panel 413 Michelle Firestone, Raglan Maddox, Patricia O’Campo, Janet Smylie, Cheryllee Bourgeois, Sara Wolfe, Susan Snelling, Heather Manson, Constance McKnight, Jeanne Hebert, Roger Boyer II, Wayne Warry, and Vicki van Wagner EvalIndigenous Origin Story: Effective Practices within Local Contexts to Inform the Field and Practice of Evaluation 425 Larry Bremner and Nicole Bowman Learning From Practice Identifying Key Epistemological Challenges Evaluating in Indigenous Contexts: Achieving Bimaadiziwin through Youth Futures 442 Robert P. Shepherd and Katherine A. H. Graham Reflections on Being a Learner: The Value of Relationship-based Community Evaluations in Indigenous Communities 464 Gerald McKinley Reconciliation and Energy Democracy 480 Kimberly A. Scott Indigenous Evaluation in the Northwest Territories: Opportunities and Challenges 492 Debbie DeLancey Reflections on Evaluating in Indigenous Contexts: Looking to the Future 513 Robert P. Shepherd and Katherine A. H. Graham Peer Reviewers for Volume 34 / Examinateurs des manuscrits du volume 34 521 Editorial Team / Équipe éditoriale Editor-in-chief / Isabelle Bourgeois, Ph.D. Rédactrice en chef Professeure agrégée/Associate Professor Université d’Ottawa/University of Ottawa (613) 562–5800 ext. 4291 <[email protected]> Associate Editor / Jill Anne Chouinard, Ph.D. Rédactrice associée Assistant Professor, University of Victoria <[email protected]> Book Review Editor / Jane Whynot Rédactrice, Comptes University of Ottawa rendus de livres <[email protected]> Editorial Assistant / Stéphanie Maltais, Ph.D. Adjointe à la rédaction <[email protected]> EDITORIAL BOARD / COMITÉ DE RÉDACTION Courtney Amo Atlantic Canada Opportunities Agency Tim Aubry School of Psychology, University of Ottawa Nicole Bowman University of WI-Madison Ayesha Boyce University of North Carolina at Greensboro Bernadette Campbell Carleton University Brad Cousins Faculty of Education, University of Ottawa Sarah Earl YMCA GTA Paul Favaro York University Marie Gervais Université Laval Steve Jacob Université Laval Marlène Laeubli LAUCO Evaluation & Training Chris Lovato University of British Columbia John Mayne Consultant, Ottawa James McDavid School of Public Administration, University of Victoria Céline Mercier Université de Montréal Anita Myers Department of Health Studies, University of Waterloo Michael Obrecht Consultant, Ottawa John Owen Centre for Program Evaluation, University of Melbourne Burt Perrin Consultant, France Cheryl Poth University of Alberta Hallie Preskill FSG Social Impact Consultants, San Francisco Linda Rey École nationale d’administration publique Lucie Richard Faculté des sciences infirmières, Université de Montréal Valéry Ridde Université de Montréal Ray C. Rist The World Bank, Washington, D.C. Daniela Schröter Western Michigan University Robert Schwartz University of Toronto Mark Seasons School of Planning, University of Waterloo Nick L. Smith School of Education, Syracuse University Sanjeev Sridharan The Melinda and Bill Gates Foundation PRINTED AND BOUND IN CANADA PUBLICATIONS MAIL AGREEMENT NO 40600510 RETURN UNDELIVERABLE CANADIAN ADDRESSES TO UNIVERSITY OF TORONTO PRESS, JOURNALS DIVISION 5201 DUFFERIN ST., TORONTO, ONTARIO, M3H 5T8 EMAIL: [email protected] Editor’s Remarks I am pleased to introduce this special issue, guest edited by Robert Shepherd and Katherine Graham. The guest editors have assembled a number of important con tributions for this volume, which provide a legal and epistemological framing for evaluating in Indigenous contexts as well as examples of how this translates into practice. There is still much to learn and to construct in this domain of evalua tion, and Shepherd and Graham articulate quite clearly what actions are needed to advance our collective knowledge and practice. I extend my heartfelt thanks to the guest editors, authors, and reviewers who made this special issue possible, and I hope that our readers take away its important messages. Isabelle Bourgeois Editor-in-Chief © 2020 Canadian Journal of Program Evaluation / La Revue canadienne d’évaluation de programme 34.3 (Special Issue / Numéro spécial), v doi: 10.3138/cjpe.34.3.v Un mot de la rédactrice Je suis heureuse de présenter ce numéro spécial pour lequel Robert Shepherd et Katherine Graham sont les rédacteurs invités. Ces derniers ont rassemblé des contributions importantes portant notamment sur un cadre juridique et épis témologique pour l’évaluation dans un contexte autochtone, de même que des exemples de la façon dont cela se traduit en pratique. Nous avons encore beaucoup à apprendre et à établir dans ce domaine de l’évaluation, et Shepherd et Graham articulent très clairement les gestes qui doivent être posés pour faire progresser notre pratique et nos connaissances à cet égard. Je remercie du fond du cœur les rédacteurs invités, les auteurs et les évaluateurs qui ont rendu possible ce numéro et j’espère que nos lecteurs et lectrices se trouveront enrichis par les messages importants qui y sont communiqués. Isabelle Bourgeois Rédactrice en chef © 2020 Canadian Journal of Program Evaluation / La Revue canadienne d’évaluation de programme 34.3 (Special Issue / Numéro spécial), vi doi: 10.3138/cjpe.34.3.vi Evaluation in Indigenous Contexts: An Introduction to Practice Robert P . Shepherd and Katherine A. H . Graham Carleton University SETTING A BETTER DIRECTION FOR EVALUATION IN INDIGENOUS CONTEXTS Indigenous evaluation as a field of inquiry and finding culturally appropriate and responsive ways to evaluate Indigenous programs and services are receiving in creased attention (Cram, Tibbetts, & LaFrance, 2018). One important catalyst has been the Truth & Reconciliation Commission of Canada’s admonitions regard ing the cultural damage caused by residential schools, where recommendations focus on the need for governments to pay greater attention to culturally relevant approaches to research, including program evaluations (TRC, 2015). More gen erally, Western governments are struggling to evaluate programs in Indigenous communities in ways that serve both governmental interests in accountability and quality assurance, while at the same time serving Indigenous needs and interests for program effectiveness and respecting local autonomy (Shepherd, 2018). During the 2015 federal election, Liberal Party leader Justin Trudeau called on Canadians to support change through reconciliation and a renewed nation-to nation relationship between the federal government and the Indigenous peoples of Canada. The government has since committed to reforming the nation-to nation relationship, which has been evident in the Prime Minister’s 2015 mandate letters to his ministers and the Principles respecting the Government of Canada’s Relationship with Indigenous Peoples made public by then - minister of justice Jody Wilson-Raybould in July 2017 (Minister of Justice, 2017). In the mandate letters, the Prime Minister calls for a renewed nation-to-nation relationship with Indig enous peoples “based on recognition of rights, respect, cooperation and partner ship” (Trudeau, 2015). More recently, the Prime Minister has said that recognition is necessary so that we can “get to a place where Indigenous peoples in Canada are in control of their own destiny, making their own decisions about their future.” The Principles say that this is the promise of Section 35 of the Constitution and that they commit the government to advancing the UNDRIP’s “call to respect and promote the inherent rights of Indigenous peoples.” In practice, the federal government committed to focus on supporting In digenous peoples’ governance initiatives in a way that can enable Indigenous governments and the federal, provincial, and territorial governments to work as partners within Canada’s constitutional framework. This commitment extends to First Nations, Métis and Inuit communities. This is again consistent with UN DRIP, which maintains, “it is the mutual responsibility of all governments to shift © 2020 Canadian Journal of Program Evaluation / La Revue canadienne d’évaluation de programme 34.3 (Special Issue / Numéro spécial), 391–399 doi: 10.3138/cjpe.69010 392 Shepherd and Graham their relationships and arrangements with Indigenous peoples so that they are based on recognition and respect for the rights to self-determination, including the inherent right to self-government for Indigenous nations” (UN Offi ce of the High Commissioner for Human Rights, 2013). This is where Indigenous evalua tion enters as a source of evidence in the context of recognition and respect, eff orts to build capacity among all parties to the relationship, and development of models of reflection and control in the areas of programming, finance, and governance. So far, little has been offered in the academic literature regarding the trans formation of evaluation in light of this new paradigm of relations. A recent edi tion of New Directions in Evaluation on Indigenous evaluation makes