The Relationship between Institutional Mission & Student Engagement and Learning Environment

Mission Research Progress Report 2013

Research continues for a ninth year A data sharing opportunity for Catholic Colleges has been available since 2004 in conjunction with the annual National Survey of Student Engagement (NSSE). Institutional researchers at act as administrators of the Catholic College Consortium. Consortium participants administer the NSSE survey and a set of Mission Perception Inventory (MPI) questions at once. They later receive Consortium comparison results on first-year and senior students’ responses not only on every NSSE item and scale, but the mission items, as well. As a result, Catholic College participants are able to:

Assess institutional performance relative to a group of characteristically similar institutions, something not always available with national surveys. Enact program modifications or take action to address outcomes of the MPI and make change where indicated. Share with accreditors assessment efforts relative to mission, institutional effectiveness, and particular student services.

Recent activity A subset of the NSSE Catholic College Consortium participants each year participates in the MPI data-sharing project. Data is released to the Marywood mission research team and custom MPI Reports are prepared. The MPI Reports compare individual schools’ performance on mission items and scales with others in the data-sharing project. The complete list of Catholic Colleges and Universities participating in the NSSE Catholic College Consortium through the years is shown on page four. Three research investigations in the past year include, first, a longitudinal look at MPI scale reliabilities from 2004 through 2012, second, a simple comparison of ranked mean results by Catholic versus Independent consortia and third, t-test analysis of mean differences by group. The differences by group are between NSSE Catholic College Consortium schools’ results and those of the NSSE Mission Engagement Consortium of Independent Colleges (MECIC), begun in 2008, whose members administer the same MPI questions. A inspection of the consistency of MPI scale reliabilities longitudinally over selected years of administration (Table 1) shows very satisfactory Cronbach alpha values have been maintained. The Sense of Mission and Respect for Diversity scales and the a priori NSSE Beliefs and Values (NSSE/BV) scale all have reliabilities ranging from 0.807 to 0.915 in each of the years shown. The overall MPI scale consisting of 19 items has reliabilities ranging from 0.880 in the 2004 inaugural year to 0.942 in 2012. The scales showing weaker reliabilities in years prior to 2009, Individual Actions and Religious Practice, were dropped and those items absorbed primarily into the more successful Values Development scale.

Office of Planning & Institutional Research [email protected] Marywood University CHERC Forum March 2013

1

Table 1: NSSE Catholic College Consortium MPI Scale Reliability Results – Selected Years Cronbach alpha Scale 2004 2006 2008 2010 2012 Sense of Mission 0.867 0.880 0.907 0.894 0.899 Respect for Diversity 0.854 0.868 0.878 0.912 0.915 Individual Actions 0.674 Religious Practice 0.624 0.536 0.620 MPI 0.880 0.902 0.912 0.940 0.942 NSSE/BV 0.807 0.810 0.812 0.817 0.818 Values Development 0.840 0.848

A simple comparison of ranked mean results by item by consortia was done. Table 2 shows mean results for the NSSE Mission Engagement Consortium of Independent Colleges (MECIC), while Table 3 shows mean results for 2009-2012 for the NSSE Catholic College Consortium. Mean results over four years for both Independent and Catholic College consortia indicate steady improvement on every item since 2009.

Table 2 Table 3 Mission Perception Inventory - Independent College Consortium Mission Perception Inventory - Catholic College Consortium Item Means Ranked by 4-Year Average 2009-2012 Item Means Ranked by 4-Year Average 2009-2012 Independent Means 4-Year Catholic Means 4-Year 2009 2010 2011 2012 Mean 2009 2010 2011 2012 Mean The faculty and staff here are respectful of people of This institution offers opportunities for • 4.29 4.28 4.29 4.35 4.30 • 4.27 4.34 4.32 4.34 4.32 different races and cultures. volunteering and community service. This institution offers opportunities for The faculty and staff here are respectful of people of • 4.13 4.19 4.30 4.29 4.23 • 4.23 4.29 4.26 4.33 4.28 volunteering and community service. different races and cultures. The faculty and staff here are respectful of people of The faculty and staff here are respectful of people of • 4.22 4.13 4.22 4.19 4.19 • 4.21 4.27 4.25 4.31 4.26 different religions. different religions. This institution offers opportunities for developing At this institution, there are opportunities for • 4.16 4.12 4.14 4.29 4.18 • 4.23 4.27 4.24 4.26 4.25 leadership skills. students to strengthen their religious commitment. As a result of my experience here, I am more aware The heritage of the founders/founding religious • 4.16 4.10 4.10 4.16 4.13 • 4.17 4.23 4.22 4.24 4.21 of my own personal values. community of this institution is evident here. The students here are respectful of people of This institution offers opportunities for developing • 4.17 4.17 4.07 4.07 4.12 • 4.13 4.16 4.15 4.21 4.16 different races and cultures. leadership skills. Social and personal development of students is an The students here are respectful of people of • 4.15 4.08 4.01 4.10 4.08 • 4.05 4.13 4.10 4.16 4.11 important part of the mission at this institution. different races and cultures. Preparation for a career is an important part of the Preparation for a career is an important part of the • 4.05 4.00 3.98 4.13 4.04 • 4.07 4.06 4.08 4.12 4.08 mission of this institution. mission of this institution. At this institution, there are opportunities for As a result of my experience here, I am more aware • 3.97 4.13 3.85 4.14 4.02 • 4.07 4.09 4.06 4.11 4.08 students to strengthen their religious commitment. of my own personal values. The environment here encourages students to The students here are respectful of people of • 4.06 4.05 3.95 4.00 4.01 • 4.02 4.10 4.07 4.12 4.08 develop an appreciation of diversity. different religions. Students at this institution feel free to express their Social and personal development of students is an • 4.09 3.94 3.95 4.03 4.00 • 4.03 4.09 4.06 4.10 4.07 individual spirituality. important part of the mission at this institution. The students here are respectful of people of Ethical and spiritual development of students is an • 4.02 3.96 4.02 3.94 3.98 • different religions. important part of the mission at this institution. 4.03 4.09 4.04 4.07 4.06 • The mission of this institution is reflected in its The mission of this institution is reflected in its 4.01 4.03 3.90 3.98 3.98 • 4.02 4.07 4.03 4.05 4.04 course offerings. course offerings. • Ethical and spiritual development of students is an The environment here encourages students to 4.03 4.12 3.81 3.86 3.95 • 3.97 4.01 4.06 4.11 4.04 important part of the mission at this institution. develop an appreciation of diversity. The faculty at this institution discuss the ethical • Students at this institution feel free to express their • 3.93 3.92 3.92 3.96 3.93 3.99 4.05 4.03 4.07 4.03 implications of what is being studied. individual spirituality. As a result of my experience here, I am more aware • The faculty at this institution discuss the ethical • 3.97 3.84 3.85 3.82 3.87 3.97 3.99 3.95 4.01 3.98 of social justice (fairness and equality) issues in implications of what is being studied. Thethe world.heritage of the founders/founding religious • As a result of my experience here, I am more aware • 3.95 4.05 3.66 3.52 3.80 3.85 3.89 3.88 3.91 3.88 community of this institution is evident here. of social justice (fairness and equality) issues in The mission of this institution is widely understood Peoplethe world. of different sexual orientations are accepted • 3.84 3.85 3.69 3.69 3.77 • 3.76 3.83 3.91 3.91 3.85 by students. socially here. People of different sexual orientations are accepted The mission of this institution is widely understood • 3.98 3.56 3.69 3.59 3.71 • 3.71 3.72 3.69 3.73 3.71 socially here. by students. Office of Planning & Institutional Research [email protected] Marywood University CHERC Forum March 2013 2

Table 4 Table 5 2009 NSSE 2010 NSSE Freshman Senior Freshman Senior Mean Mean Mean Mean Sig. Sig. Sig. Sig. CCU MECIC CCU MECIC CCU MECIC CCU MECIC The mission of this institution is widely understood by The mission of this institution is widely understood by 3.78 3.99 .000 3.61 3.84 .000 3.84 4.09 .000 3.64 3.82 .000 students. students. Ethical and spiritual development of students is an Ethical and spiritual development of students is an 4.03 4.10 .101 3.98 3.93 .252 4.12 4.26 .000 4.05 4.10 .011 important part of the mission at this institution. important part of the mission at this institution. This institution offers opportunities for volunteering and This institution offers opportunities for volunteering and 4.31 4.25 .114 4.26 4.17 .010 4.39 4.31 .000 4.33 4.14 .000 community service. community service. Social and personal development of students is an Social and personal development of students is an 4.06 4.23 .000 3.98 4.06 .067 4.17 4.16 .716 4.05 4.01 .121 important part of the mission at this institution. important part of the mission at this institution. This institution offers opportunities for developing This institution offers opportunities for developing 4.13 4.24 .004 4.12 4.20 .064 4.20 4.20 .994 4.14 4.11 .156 leadership skills. leadership skills. Preparation for a career is an important part of the Preparation for a career is an important part of the 4.16 4.23 .083 3.99 3.98 .804 4.19 4.19 .878 3.99 3.94 .039 mission of this institution. mission of this institution. The heritage of the founders/founding religious The heritage of the founders/founding religious 4.23 4.02 .000 4.13 3.85 .000 4.29 4.21 .000 4.21 3.95 .000 community of this institution is evident here. community of this institution is evident here. The faculty and staff here are respectful of people of The faculty and staff here are respectful of people of 4.24 4.24 .908 4.18 4.10 .077 4.31 4.23 .000 4.25 4.04 .000 different religions. different religions. The students here are respectful of people of different The students here are respectful of people of different 4.05 4.01 .377 3.99 3.96 .408 4.14 4.08 .002 4.06 3.87 .000 religions. religions. Students at this institution feel free to express their Students at this institution feel free to express their 4.04 4.07 .463 3.93 4.02 .049 4.13 4.08 .022 3.98 3.79 .000 individual spirituality. individual spirituality. The faculty and staff here are respectful of people of The faculty and staff here are respectful of people of 4.25 4.30 .187 4.20 4.18 .484 4.34 4.33 .629 4.25 4.16 .000 different races and cultures. different races and cultures. The students here are respectful of people of different The students here are respectful of people of different 4.05 4.18 .001 4.01 4.04 .430 4.17 4.23 .010 4.07 4.06 .423 races and cultures. races and cultures. People of different sexual orientations are accepted People of different sexual orientations are accepted 3.85 3.90 .295 3.68 3.90 .000 3.97 3.59 .000 3.74 3.24 .000 socially here. socially here. The environment here encourages students to develop The environment here encourages students to develop 4.01 4.08 .088 3.91 3.91 .985 4.10 4.21 .000 3.96 4.00 .061 an appreciation of diversity. an appreciation of diversity. At this institution, there are opportunities for students to At this institution, there are opportunities for students to 4.29 4.10 .000 4.18 3.84 .000 4.36 4.24 .000 4.21 4.08 .000 strengthen their religious commitment. strengthen their religious commitment. The mission of this institution is reflected in its course The mission of this institution is reflected in its course 4.05 4.11 .144 3.96 3.92 .296 4.12 4.13 .735 4.03 3.92 .000 offerings. offerings. As a result of my experience here, I am more aware of As a result of my experience here, I am more aware of 3.79 3.92 .002 3.85 3.92 .138 social justice (fairness and equality) issues in the world. 3.88 3.85 .295 3.90 3.75 .000 social justice (fairness and equality) issues in the world. The faculty at this institution discuss the ethical The faculty at this institution discuss the ethical 3.88 3.95 .124 3.98 3.84 .001 3.98 3.93 .050 4.00 3.85 .000 implications of what is being studied. implications of what is being studied. As a result of my experience here, I am more aware of As a result of my experience here, I am more aware of 4.00 4.12 .005 4.08 4.13 .294 4.08 4.10 .363 4.10 4.04 .017 my own personal values. my own personal values.

Tables 4 through 7 show results of a comparison of consortia mean MPI results by item and class level 2009 – 2012. Significant differences are evident in Catholic and Independent means by student level on most items by year, particularly on ethical and spiritual development , heritage and strengthen religious commitment. Table 6 Table 7 2011 NSSE 2012 NSSE Freshman Senior Freshman Senior Mean Mean Mean Mean Sig. Sig. Sig. Sig. CCU MECIC CCU MECIC CCU MECIC CCU MECIC The mission of this institution is widely understood by 3.77 3.82 .219 3.61 3.64 .525 The mission of this institution is widely understood by 3.92 3.66 .106 3.85 3.46 .000 students. students. Ethical and spiritual development of students is an 4.04 3.83 .000 4.04 3.66 .000 Ethical and spiritual development of students is an 4.13 4.00 .000 3.78 3.62 .000 important part of the mission at this institution. important part of the mission at this institution. This institution offers opportunities for volunteering and 4.36 4.48 .000 4.34 4.33 .657 This institution offers opportunities for volunteering and 4.45 4.35 .511 4.43 4.27 .007 community service. community service. Social and personal development of students is an 4.11 4.16 .104 4.03 3.95 .017 Social and personal development of students is an 4.19 4.05 .390 4.22 3.96 .015 important part of the mission at this institution. important part of the mission at this institution. This institution offers opportunities for developing 4.17 4.28 .001 4.17 4.18 .754 This institution offers opportunities for developing 4.28 4.18 .000 4.40 4.27 .006 leadership skills. leadership skills. Preparation for a career is an important part of the 4.18 4.23 .151 4.01 3.85 .000 Preparation for a career is an important part of the 4.27 4.04 .558 4.29 3.97 .044 mission of this institution. mission of this institution. The heritage of the founders/founding religious 4.22 3.75 .000 4.21 3.49 .000 The heritage of the founders/founding religious 4.34 4.17 .000 3.45 3.16 .000 community of this institution is evident here. community of this institution is evident here. The faculty and staff here are respectful of people of 4.28 4.36 .017 4.23 4.19 .303 The faculty and staff here are respectful of people of 4.39 4.29 .009 4.31 4.14 .000 different religions. different religions. The students here are respectful of people of different 4.11 4.10 .705 4.04 3.97 .018 The students here are respectful of people of different 4.17 4.09 .000 4.05 3.86 .000 religions. religions. Students at this institution feel free to express their 4.06 4.04 .560 3.98 3.89 .009 Students at this institution feel free to express their 4.14 4.03 .449 4.17 3.91 .001 individual spirituality. individual spirituality. The faculty and staff here are respectful of people of 4.29 4.37 .007 4.25 4.27 .634 The faculty and staff here are respectful of people of 4.39 4.30 .282 4.42 4.29 .615 different races and cultures. different races and cultures. The students here are respectful of people of different 4.09 4.11 .683 4.07 4.00 .021 The students here are respectful of people of different 4.20 4.13 .204 4.16 3.93 .000 races and cultures. races and cultures. People of different sexual orientations are accepted 3.94 3.91 .417 3.82 3.66 .000 People of different sexual orientations are accepted 4.01 3.87 .000 3.87 3.54 .000 socially here. socially here. The environment here encourages students to develop 4.09 4.01 .031 3.98 3.88 .006 The environment here encourages students to develop 4.16 4.05 .973 4.16 3.89 .000 an appreciation of diversity. an appreciation of diversity. At this institution, there are opportunities for students to 4.29 3.93 .000 4.23 3.70 .000 At this institution, there are opportunities for students to 4.38 4.20 .000 4.10 3.93 .000 strengthen their religious commitment. strengthen their religious commitment. The mission of this institution is reflected in its course 4.05 4.01 .257 4.00 3.87 .000 The mission of this institution is reflected in its course 4.12 3.99 .002 4.01 3.79 .000 offerings. offerings. As a result of my experience here, I am more aware of 3.83 3.82 .924 3.91 3.94 .437 As a result of my experience here, I am more aware of social justice (fairness and equality) issues in the world. social justice (fairness and equality) issues in the world. 3.90 3.94 .017 3.81 3.87 .066

The faculty at this institution discuss the ethical The faculty at this institution discuss the ethical 3.88 3.86 .649 3.99 3.97 .587 3.99 4.02 .093 3.93 3.91 .001 implications of what is being studied. implications of what is being studied. As a result of my experience here, I am more aware of As a result of my experience here, I am more aware of 4.02 4.06 .334 4.09 4.16 .034 4.11 4.12 .352 4.14 4.13 .722 my own personal values. my own personal values. Learn more More information is available by contacting Ellen Boylan, Ph.D., Director of Planning and Institutional Research at Marywood University, Scranton, PA, [email protected], 570.348.6203. Explore also http://www.marywood.edu/instresearch/activity.stm.

3 NSSE Catholic College Consortium MPI Data-Sharing Project 2004-2012 Participating Institutions (92) Institution City State Institution City State Reading PA Nazareth College Rochester NY Aquinas College Grand Rapids MI Newman University Wichita KS Assumption College Worcester MA Aston PA Kansas City MO Niagara University Niagara NY Belmont University Nashville TN South Euclid OH Barry University Miami Shores FL Notre Dame de Namur Univ Belmont CA Berry College Mount Berry GA Ohio Dominican University Columbus OH Bellarmine University Louisville KY Our Lady of the Lake College San Antonio TX Owensboro KY Our Lady of the Lake U-San Antonio San Antonio TX Souix City IA Quincy IL Cabrini College Radnor PA Nashua NH Cardinal Stritch University Milwaukee WI Sacred Heart University Fairfield CN Chaminade U of Honolulu Honolulu HI Saint Ambrose University Davenport IA Philadelphia PA Saint Anselm College Manchester NH Clarke University Dubuque IA Saint Bonaventure University St. Bonaventure NY College of Mt. Saint Vincent Bronx NY Lorreto PA College of Saint Elizabeth Morristown NJ Saint Gregory's University Shawnee OK College Our Lady of the Elms Chicopee MA Saint Josephs College Rensselaer IN DePaul University Chicago IL Saint Joseph's College of ME Standish ME Desales University Center Valley PA Saint Leo University Saint Leo FL Dominican College of Blauvelt Orangeburg NY Saint Martin's University Lacey WA Dominican University River Forest IL Saint Mary's College of CA Moraga CA PA Saint Mary's University of MN Winona MN Madison WI Latrobe PA Emmanuel College Franklin Springs GA Chicago IL Felician College Lodi NJ Seton Hall University South Orange NJ Clayton MO Loudonville NY Franciscan U of Steubenville Steubenville OH Southern Catholic College Dawsonville GA Erie PA St. John's University-NY Jamaica NY Georgian Court University Lakewood Twp NJ Saint Mary's University TX San Antonio TX Gwynedd Gwynedd Valley PA Stonehill College Easton MA Philadelphia PA College of St. Benedict, St. John St. Joseph/Collegeville MN Immaculata PA The College of Saint Rose Albany NY La Roche College Pittsburgh PA The College of Saint Scholastica Duluth MN Lewis University Romeoville IL Thomas More College Crestview KY Livonia MI University of Dallas Irving TX Manhattan College Bronx NY University of Great Falls Great Falls MT Marian University Fond du Lac WI University of Mary Bismarck ND MI University of San Diego San Diego CA Arlington VA University of St. Francis Joliet IL Merrimack College No.Andover MA University of St. Thomas (TX) Houston TX Dallas PA University of St. Thomas (MN) Saint Paul MN Molloy College Rockville Centre NY University of the Incarnate Word San Antonio TX Cresson PA Villanova PA Mount Marty College Yankton SD La Crosse WI Mount St. Mary's U Emmitsburg MD Walsh University North Canton OH Office of Planning & Institutional Research [email protected] Marywood University CHERC Forum March 2013 4