NGCP National Webinar: Lessons Learned for Effective Evaluation of Girl-Serving CS Programming Chat Transcript, September 29, 2016
Erin Hogeboom: Welcome to the NGCP National Webinar "Lessons Learned for Effective Evaluation of Girl-Serving CS Programming." Please introduce yourself here in the chat, let us know what organization you are with, and what state you reside in. Thank you!
Neale Pickett: Neale Pickett, Los Alamos National Laboratory in New Mexico
Vanessa Vega: Vanessa Vega, Rocman Et Al Research & Evaluation, in San Francisco
Barbara Miner: Barbara Miner, Portland Oregon
David Kratzer: David Kratzer, from the Supercomputing Challenge in New Mexico
Jesse Mostipak: Jesse Mostipak, Girl Scouts of Northeast Texas
Judy Hart: Judy Hart - Director - Camp summer gold – Nebraska
Karen Peterson: Welcome everyone!
Julia Orr: Julia Orr, Intrepid Sea, Air & Space Museum – NYC
Heather Benedict: Heather Benedict - Independent Consultant - Saint Paul, MN - Working with Twin Cities PBS – SciGirls
Patrice Gans: Patrice Gans, Executive Director, Random Hacks of Kindness Junior
Emily: Emily McLeod, Techbridge, Oakland California
Diana De los Santos: Diana De los Santos - Associate Director of Education - Girls Who Code - San Francisco
Brit La Fritz: Hi! My name is Brit, I'm the STEM Training and Program Designer VISTA (AmeriCorps VISTA) at Austin Partners in Education. I'm in Austin, Texas.
Lyn Swackhamer: Lyn Swackhamer, National Center for Women and Information Technology (NCWIT), Colorado
Amy Gow: Amy from TX - STEM Consultant
Gail Sheldon: Hi, Gail Sheldon, Library Consultant, Alabama Public Library Service.
Patrice Gans: Patrice Gans, CT
Bernadette Chi: Hi, my name is Bernadette Chi and I'm with the Research Group at the Lawrence Hall of Science (UC Berkeley).
Chrissy Z: Chrissy Ziccarelli - Associate Director of Instruction at Girls Who Code in NYC
Amanda Lindsay: Amanda Lindsay, Lithonia, GA I work for the DeKalb County Public Library
Susan Lowes: Susan Lowes, Teachers College, Columbia University, researcher and evaluator c scharber: cassie scharber, University of Minnesota, researcher
Amy Werst: Amy Werst, Center for STEM Education at The University of Texas at Austin
Kara Sammet: Kara Sammet, Google, Evaluation & Gender specialist
Barbara Miner: Barbara Miner, Girls Engage Technology, Saturday Academy in partnership with Girl scouts of Oregon and SW Washington
Suzanne: Suzanne - Power of Discovery: STEM Hub, California
Karen North: Hi from Houston. Retired CS teacher and advocate scaling Girls in CS with AAUW, NCWIT and code.org.
Andrew Spence: Hello from the Kentucky Science Center, Louisville KY
Ellen: HI everyone! I'm with Girls Who Code and I'm calling from San Francisco, California
Karen Stellabotte: Karen Stellabotte, Program Director with TechGirlz in PA
Jill Warwick: RGI Corporation - Washington State
Kerry Forrest: Collegiate Pathways, Inc. Orlando, FL
Hada Guzmán: Hada Guzmán- Middle School Program Manager, Girls Inc. of Alameda County in California
Cheryl Allendoerfer: Hi, from the University of Washington. I work with URM undergrad and high school students who are interested in STEM.
Sharlyn Gunderson-Izurieta: Sharlyn Gunderson-Izurieta, School of Computing, Montana State University
Bonnie Meinke: Bonnie Meinke, Space Telescope Science Institute, Baltimore, MD
Mariana S: Mariana Sprouse, Charles County Public Library in Maryland.
Alissa Jolly: Alissa Jolly: Educational Service District 112, REACH Program, Vancouver, WA
Neal Sales-Griffin: Neal Sales-Griffin, Incoming CEO of CodeNow (www.codenow.org)
Laticia Dezell: Laticia Dezell Holbert - Director of Ed & Training Innovation, YWCA Metro Chicago
Clara Cahill: Clara Cahill, Manager of the Computer Science Education Initiative at the Museum of Science, Boston
SciGirls: It's Leah and Sarah from SciGirls in Minnesota
Allison 2: Allison, STEM Specialist for Girl Scouts of Greater Atlanta
Karolina Kumiega: Karolina from Girls Who Code!
Ashley Crowe: Girls Scouts of Northeast Texas, Ashley Crowe, VP Girl Experience
Su-Jen Roberts: Su-Jen Roberts, Researcher at New Knowledge Organization, New York City BirdSleuth K-12 Team, Cornell Lab of Ornithology: Hi there, Jennifer Fee and Kelly Schaeffer with the Cornell Lab of Ornithology, Ithaca NY
Angela Bamber: Otero Junior College, STEM Grant in La Junta, CO c scharber: HI, Leah and Sarah!
Mercedes McKay: Mercedes McKay, CIESE, Stevens Institute of Technology
Carolyn Blue: Carolyn Blue, NWAC Clubhouse, Detroit, Michigan
Shauna Rhooms: Shauna Rhooms, Npower, New York City
P. Garcia: Patricia Garica, Researcher at the University of Michigan
Ryan Meadows: Ryan Meadows, Pre-collegiate Outreach Programs, Worcester Polytechnic Institute (WPI), Massachusetts
Christine Halverson: Christine Halverson: Wicked Science
Mike: Mike McGee, Incoming Director of Programs, CodeNow (http://codenow.org)
Judy Schmidt: Judy Schmidt, University of Illinois Extension
Sarah MacGillivray: Education Development Center, Waltham MA
Kathy Barnett: Kathy Barnett , Founder Be You, Inc. www.hocobeyou.com & Club Advisor Girls Who Code www.girlswhocode.com (HoCo, MD)
Christine Halverson: Hi Everyone - Wicked Science out of Chicago, IL
Lizzie Hager-Barnard: Lizzie Hager-Barnard, UC Berkeley (California)
David Keyes: Hi all. Dave Keyes here. City of Seattle IT Department, Community Technology Program
Karen Thurm Safran: Karen Thurm Safran- San Jose. Been in EdTech for 20 years doing Marketing- Apple then helped build iD Tech for the past 15 years. Am now taking time off before my next career adventure.
Judy Hart: what do the blue states represent on the recent map?
Karen Peterson: We are hoping to expand to blue states!
Kathy Haynie: Kathy Haynie, Haynie Research and Evaluation
Wendy DuBow: Hi there, Wendy DuBow, Director of Evaluation at NCWIT
Judy Hart: I have a girl’s camp in Nebraska and have connected through the Connectory. waiting to get started on a collaborative project.
Karen Peterson: Welcome everyone!
Karen Peterson: Judy - let's talk
Karen Peterson: I'll reach out
Monika Whitfield: Hi Karen and group - Monika Whitfield, Expanding Your Horizons Network (EYHN) here!
Judy Hart: thank you Karen.
Karen Peterson: Feel free to ask questions here in the chat box. And share resources! We'll share the chat with everyone. Please introduce yourself in the chat if you are just joining us. Welcome!
Kim Walker: Kim Walker and Julie Diana, Innovation Directors at The Agnes Irwin School Esperanza Zenon: Hi All Esperanza Zenon River Parishes Community College Gonzales LA
Retha Kelly-Horne: Thanks, sorry I'm late. I am Retha with ScienceSouth in SC
P. Garcia: would love access to the Google Site.
Karen Peterson: P. Garcia - we will find ways to share the resources on that site.
P. Garcia: Thanks!
Kathryn guimond: Kathryn Guimond from the Science Museum of Minnesota - hello!
Torie Bates: Torie Bates with Google also here!
Jamie Gurganus: Jamie Gurganus University of Maryland Baltimore County
Karen North: Looking for implementation stipends for teachers. Having hard time getting administrative support for time for staff. Heard at the White House CS update that donors choose is allowing funding for professional development. Do you have that link? Presenting locally in my school district to teachers who are asking for support and need information for Saturday.
Wendy DuBow: Wondering how many CS Open grantees have taken advantage of the one on one's with Haynie Research?
Karen Peterson: Wendy - Kathy can provide more info - but ALL of them worked with Kathy at some point.
Karen Peterson: Karen - I'll look for it and will send to you offline.
Bernadette Chi: Opportunities provided by STEM Academy sound really exciting. Is there a fee charged for the summer camps or are they provided for free to participants?
Karen Peterson: Bernadette - we've passed that along and Cathy will address soon.
Retha Kelly-Horne: We are small, but surveys are not working for us, so this is helpful.
Karen North: Can you add more details on how you built capacity implementation?
Bernadette Chi: Thank you! I'm assuming that the in-school activities are provided free of charge as part of the classroom activities.
Erin Hogeboom: I think that's an accurate assumption, Bernadette, but we will confirm with Cathy.
Wendy DuBow: Kathy - connect offline? I'd love to hear more about the amount of time you spent with grantees and what types of guidance you ended up providing
Monica: Would you be willing to share your assessment tool?
Erin Hogeboom: We're pleased you are on here, Retha, we hope you'll learn some other options you have at your fingertips!
Kathy Haynie: Hi Wendy - Haynie Research worked closely with three of grantees, and provided some support to another five of the projects.
Christine Halverson: I am interested in this case study in more detail - is there a print copy of study?
Kathy Haynie: Wendy, write to me at [email protected].
Wendy DuBow: Can Kathy share how they ended up gathering data from the younger students in this program?
Kathy Haynie: It varied from project to project, but interviews and classroom observations were most typical with elementary-aged students.
Karen Peterson: Here is Cathy's email: [email protected]
Kathy Haynie: There is also a framework on dimensions of school-level capacity building that Cathy Law used for generating interview questions.
Christine Halverson:[email protected] - thanks for sending the electronic study
Carolyn Blue: Great job Cathy! Thanks!
Karen Peterson: Feel free to ask questions here.
Judy Hart: What part of the country is Code Now covering?
Rosalia Gomez, UT Austin: how are the students recruited?
Karen North: How do you get the trainers to volunteer?
Karolina Kumiega: Will you be sending this presentation over email to the attendees?
Ryan Meadows: Can you talk more about what is covered in the one-hour training for the volunteers?
Bernadette Chi: A general question just to clarify: did the different grantees utilize a common set of instruments or did they create/tailor assessments for each program? And ultimately, will all of these assessments be available to others outside of the initiative to review/use?
Erin Hogeboom: These are great questions! I'll pose them to Yvonne once she is finished.
Erin Hogeboom: And Bernadette, we'll be answering your general question as well.
Karen Peterson: Karolina - all registrants will receive the webinar recording and presentation. Karolina Kumiega: Great, thank you!
Wendy DuBow: I missed what Yvonne said about *when* they surveyed students. I also noticed that her questions are all formative rather than summative--what student outcomes do they measure?
Patrice Gans: Is it possible to see a copy of the actual survey that the students receive?
Ellen: I'm also interested in the actual survey.
Diana De los Santos: Have you tried to keep in touch with alumni of your program to see if this experience encourages them to major in CS Later?
Laticia Dezell: That would be awesome! Thank you!
David Keyes: What training is provided to the company volunteers and have you evaluated the program impact on them, trainer needs, and how to increase their effectiveness?
Karen Peterson:[email protected]
Gail Sheldon: I am also interested in collecting outcomes versus outputs, how the program impacts them later.
Elsa Bailey: Do you collect data on the volunteers' reaction to the training, and then their subsequent reaction to their teaching experience?
Ellen: When you say "a lot" of students take APCS, what percentage is that?
Kathy Haynie: Persistence is such an important student outcome.
Diana De los Santos: Thank you!
SciGirls: Do the alumni have any chances to work as near-peer mentors for current students? Patrice Gans: Do the students come into the program with an interest in computer science? How do you measure their prior computer experiences?
Retha Kelly-Horne: Have to leave for outreach; Thank you all so much. Erin, Karen, Cathy, Yvonne: this was quite helpful/informative and I look forward to receiving the recorded chat, and I will be reaching out to Cathy and Yvonne for their study/survey info. Best to all!
Erin Hogeboom: Thank you for attending, Retha! You can watch the recording to catch the end.
David Keyes: Thanks for the information!
Kathy Haynie: The CS Open grants were fairly small scales, so most CS Open evaluations were limited in scope.
Patrice Gans: Thank you
Karen North: What funding can be found to scale these effective projects? Have parts in place in Spring Branch ISD. Need project manager. Would it be possible for NGCP to partner with code.org to train volunteers? Now only teachers are allowed to attend workshops. Would like to pair a teacher with a code buddy.
Kathy Haynie: There was a common pool of CS-related survey items which many grantees used to build or revise their surveys.
Gail Sheldon: Juliet, would you mind me contacting you?
Bernadette Chi: Thanks, Karen P! Looking forward to reviewing the findings and report!
Karen North: Thank you for this fabulous information. Toggling with typing and monitoring my 6- month old granddaughter – Would like CS to be part of every school by the time she starts. My 1st grade and 7th grand grandsons in SBISD are still waiting.
Juliet: Hi Gail - happy to follow up with you.
Gail Sheldon: [email protected]
Carolyn Blue: Thank you NGCP for this information! Great job!!!
Karen Peterson: Happy Birthday to us!
Juliet: My contact information [email protected]
Karen Peterson: Thanks for your participation!
Gail Sheldon: Thanks so much!!!
Juliet: Thank you all for joining today! c scharber: Thank you!
Bernadette Chi: Thank you, all!
Amanda Lindsay: Thanks!
Julia Orr: Thank you!
Su-Jen Roberts: Thank you!
Clara Cahill: Thanks!
Silvia Bravo Gallart: Thanks!
Monika Whitfield: Thank you!
Brit La Fritz: How do we get the link to the recording? I'd love to send this to a colleague!