Combining Advanced Analytics and the Generalized Matching Law in NFL Football Play- Calling

Total Page:16

File Type:pdf, Size:1020Kb

Combining Advanced Analytics and the Generalized Matching Law in NFL Football Play- Calling Western Michigan University ScholarWorks at WMU Dissertations Graduate College 4-2018 Mixing Matching and Sabermetrics: Combining Advanced Analytics and the Generalized Matching Law in NFL Football Play- Calling Jacob Bradley Western Michigan University Follow this and additional works at: https://scholarworks.wmich.edu/dissertations Part of the Experimental Analysis of Behavior Commons, and the Industrial and Organizational Psychology Commons Recommended Citation Bradley, Jacob, "Mixing Matching and Sabermetrics: Combining Advanced Analytics and the Generalized Matching Law in NFL Football Play-Calling" (2018). Dissertations. 3241. https://scholarworks.wmich.edu/dissertations/3241 This Dissertation-Open Access is brought to you for free and open access by the Graduate College at ScholarWorks at WMU. It has been accepted for inclusion in Dissertations by an authorized administrator of ScholarWorks at WMU. For more information, please contact [email protected]. MIXING MATCHING AND SABERMETRICS: COMBINING ADVANCED ANALYTICS AND THE GENERALIZED MATCHING LAW IN NFL FOOTBALL PLAY-CALLING by Jacob Bradley A dissertation submitted to the Graduate College in partial fulfillment of the requirements for the degree of Doctor of Philosophy Psychology Western Michigan University April 2018 Dissertation Committee: Douglas Johnson, Ph.D., Chair Heather McGee, Ph.D. Thomas Critchfield, Ph.D. Derek Reed, Ph.D. MIXING MATCHING AND SABERMETRICS: COMBINING ADVANCED ANALYTICS AND THE GENERALIZED MATCHING LAW IN NFL FOOTBALL PLAY-CALLING Jacob Bradley, Ph.D. Western Michigan University, 2018 The fields of advanced analytics in sports and quantitative analysis of behavior as it applies to sports have developed independently over the last several decades. Both fields share the common goal of using a quantitative approach to describe and predict behavior within sports beyond the common traditional verbal accounts. To date, the two fields have not directly intersected. The current study provides an overview of advanced analytics and quantitative analysis of behavior in sports, demonstrates how the two fields can be combined to better account for the behavioral processes involved in decision- making in sports, and identifies several possible ways the two fields can be combined in future research. The Generalized Matching Equation (GME) from quantitative analysis of behavior has been successfully used to account for NFL play-calling behavior in previous studies when yards-gained on a play was the measure of reinforcement. The current study compares GME models using yards-gained as the measure of reinforcement with GME models using Success Rate—a seminal advanced analytics metric in football assessing the value of a play—as the measure of reinforcement. The GME models using Success Rate as the measure of reinforcement were largely found to account for more variance in play-calling behavior and provide better generalized matching outcomes, thus demonstrating the potential value of combining advanced analytics in sports with the quantitative analysis of behavior to improve the description and prediction of choice behavior in elite sports. Copyright by Jacob L. Bradley 2018 ACKNOWLEDGMENTS I would like to begin by thanking my advisor, Dr. Douglas Johnson for his guidance throughout this project. His continued direction and support were critical to completing this study. I would also like to thank In addition, I would like to thank to my doctoral committee: Dr. Douglas Johnson, Dr. Heather McGee, Dr. Thomas Critchfield, and Dr. Derek Reed. Their expertise, insight and suggestions, especially in the areas of behavior analysis, quantitative analysis of behavior, comparison of quantitative models, and applications of quantitative models of choice to sport behavior, made it possible for me to pursue and complete this project. Most importantly, I would like to thank my wife, Jamie, for her support throughout the research and writing process and her encouragement to pursue my goals in advancing my education. Lastly, I would like to thank Western Michigan University’s Graduate College for their consideration. Jacob L. Bradley ii TABLE OF CONTENTS ACKNOWLEDGMENTS ...................................................................................... ii LIST OF TABLES .................................................................................................. viii LIST OF FIGURES ................................................................................................ ix INTRODUCTION ................................................................................................. 1 Advanced Analytics in Elite Sports ............................................................ 1 Advanced Analytics in Football.................................................................. 8 Success Rate.................................................................................... 8 Expected Points Added ................................................................... 10 Win Probability Added ................................................................... 11 Quantitative Analysis of Behavior in Sports .............................................. 12 Matching Law ................................................................................. 13 Applications to Basketball .............................................................. 15 Applications to Hockey................................................................... 21 Applications to Baseball ................................................................. 22 Applications to Football .................................................................. 24 Limitations and Goals ................................................................................. 37 Preview of the Proposed Research .............................................................. 42 GENERAL METHODS.......................................................................................... 43 Data Collection and Classification ............................................................. 43 GME Analyses ........................................................................................... 44 iii Table of Contents—Continued ANALYSIS 1: SEASON-AGGREGATE LEAGUE OUTCOMES ...................... 45 Analysis 1A: Yards-Gained as Reinforcement .......................................... 46 Analysis .......................................................................................... 46 Results ............................................................................................ 46 Analysis 1B: Success Rate as Reinforcement ............................................ 47 Analysis .......................................................................................... 47 Results ............................................................................................ 47 Analysis 1 Comparison ............................................................................... 48 Analysis .......................................................................................... 48 Results ............................................................................................ 49 Analysis 1 Discussion ................................................................................ 50 ANALYSIS 2: GAME-BY-GAME LEAGUE OUTCOMES ................................ 56 Analysis 2A: Yards-Gained as Reinforcement .......................................... 57 Analysis .......................................................................................... 57 Results ............................................................................................ 57 Analysis 2B: Success Rate as Reinforcement ............................................ 57 Analysis .......................................................................................... 57 Results ............................................................................................ 57 Analysis 2 Comparison ............................................................................... 58 Analysis .......................................................................................... 58 Results ............................................................................................ 59 iv Table of Contents—Continued Analysis 2 Discussion ................................................................................ 60 ANALYSIS 3: GAME-BY-GAME INDIVIDUAL TEAM OUTCOMES ............ 62 Analysis 3A: Yards-Gained as Reinforcement .......................................... 64 Analysis .......................................................................................... 64 Results ............................................................................................ 64 Analysis 3B: Success Rate as Reinforcement ............................................ 64 Analysis .......................................................................................... 64 Results ............................................................................................ 66 Analysis 3 Comparison ............................................................................... 66 Analysis .......................................................................................... 66 Results ............................................................................................ 67 Analysis 3 Discussion ................................................................................ 70 ANALYSIS 4: CORRELATIONAL ANALYSIS OF MATCHING WITH WINNING PERCENTAGE...................................................................................
Recommended publications
  • A Bayesian Approach to In-Game Win Probability in Soccer
    A Bayesian Approach to In-Game Win Probability in Soccer Pieter Robberechts Jan Van Haaren Jesse Davis [email protected] [email protected] [email protected] KU Leuven, Dept. of Computer KU Leuven, Dept. of Computer KU Leuven, Dept. of Computer Science; Leuven.AI Science; Leuven.AI Science; Leuven.AI B-3000 Leuven, Belgium B-3000 Leuven, Belgium B-3000 Leuven, Belgium Premier League - 2011/12 3 : 2 1:0 1:1 QPR 1:2 2:2 3:2 100% City wins 80% 60% Draw 40% 20% QPR wins 15 30 HT 60 75 90 min Figure 1: In-game win probabilities for the game between Manchester City and Queens Park Rangers (QPR) on the final day of the 2011/12 Premier League season. ABSTRACT demonstrates that our framework provides well-calibrated proba- In-game win probability models, which provide a sports team’s bilities. Furthermore, two use cases show its ability to enhance fan likelihood of winning at each point in a game based on historical experience and to evaluate performance in crucial game situations. observations, are becoming increasingly popular. In baseball, bas- ketball and American football, they have become important tools CCS CONCEPTS to enhance fan experience, to evaluate in-game decision-making, • Mathematics of computing ! Probabilistic inference prob- and to inform coaching decisions. While equally relevant in soccer, lems; Variational methods; • Computing methodologies ! Ma- the adoption of these models is held back by technical challenges chine learning; • Information systems ! Data mining. arising from the low-scoring nature of the sport. In this paper, we introduce an in-game win probability model for KEYWORDS soccer that addresses the shortcomings of existing models.
    [Show full text]
  • Gether, Regardless Also Note That Rule Changes and Equipment Improve- of Type, Rather Than Having Three Or Four Separate AHP Ments Can Impact Records
    Journal of Sports Analytics 2 (2016) 1–18 1 DOI 10.3233/JSA-150007 IOS Press Revisiting the ranking of outstanding professional sports records Matthew J. Liberatorea, Bret R. Myersa,∗, Robert L. Nydicka and Howard J. Weissb aVillanova University, Villanova, PA, USA bTemple University Abstract. Twenty-eight years ago Golden and Wasil (1987) presented the use of the Analytic Hierarchy Process (AHP) for ranking outstanding sports records. Since then much has changed with respect to sports and sports records, the application and theory of the AHP, and the availability of the internet for accessing data. In this paper we revisit the ranking of outstanding sports records and build on past work, focusing on a comprehensive set of records from the four major American professional sports. We interviewed and corresponded with two sports experts and applied an AHP-based approach that features both the traditional pairwise comparison and the AHP rating method to elicit the necessary judgments from these experts. The most outstanding sports records are presented, discussed and compared to Golden and Wasil’s results from a quarter century earlier. Keywords: Sports, analytics, Analytic Hierarchy Process, evaluation and ranking, expert opinion 1. Introduction considered, create a single AHP analysis for differ- ent types of records (career, season, consecutive and In 1987, Golden and Wasil (GW) applied the Ana- game), and harness the opinions of sports experts to lytic Hierarchy Process (AHP) to rank what they adjust the set of criteria and their weights and to drive considered to be “some of the greatest active sports the evaluation process. records” (Golden and Wasil, 1987).
    [Show full text]
  • 2021 District 41 Inter-League Rules
    2021 District 41 Inter-League Rules Objective: Promote, develop, supervise, and voluntarily assist in all lawful ways, the interest of those who will participate in Little League Baseball. District 41 leagues participating in Inter- league play will adhere to the same rules for the 2021 Season. General: The “2021 Official Regulations and Playing Rules of Little League Baseball” will be strictly enforced, except those rules adopted by these Bylaws. All Managers, Coaches and Umpires shall familiarize themselves with all rules contained in the 2021 Official Regulations and Playing Rules of Little League Baseball (Blue Book/ LL app). All Managers, Coaches and Umpires shall familiarize themselves with District 41 2021 Inter-league Bylaws District 41 Division Bylaws • Tee-Ball Division: • Teams can either use the tee or coach pitch • Each field must have a tee at their field • A Tee-ball game is 60-minutes maximum. • Each team will bat the entire roster each inning. Official scores or standings shall not be maintained. • Each batter will advance one base on a ball hit to an infielder or outfielder, with a maximum of two bases on a ball hit past an outfielder. The last batter of each inning will clear the bases and run as if a home run and teams will switch sides. • No stealing of bases or advancing on overthrows. • A coach from the team on offense will place/replace the balls on the batting tee. • On defense, all players shall be on the field. There shall be five/six (If using a catcher) infield positions. The remaining players shall be positioned in the outfield.
    [Show full text]
  • NCAA Statistics Policies
    Statistics POLICIES AND GUIDELINES CONTENTS Introduction ���������������������������������������������������������������������������������������������������������������������� 3 NCAA Statistics Compilation Guidelines �����������������������������������������������������������������������������������������������3 First Year of Statistics by Sport ���������������������������������������������������������������������������������������������������������������4 School Code ��������������������������������������������������������������������������������������������������������������������������������������������4 Countable Opponents ������������������������������������������������������������������������������������������������������ 5 Definition ������������������������������������������������������������������������������������������������������������������������������������������������5 Non-Countable Opponents ����������������������������������������������������������������������������������������������������������������������5 Sport Implementation ������������������������������������������������������������������������������������������������������������������������������5 Rosters ������������������������������������������������������������������������������������������������������������������������������ 6 Head Coach Determination ���������������������������������������������������������������������������������������������������������������������6 Co-Head Coaches ������������������������������������������������������������������������������������������������������������������������������������7
    [Show full text]
  • College of Liberal Arts Newsletter
    Fall 2007 “So, what can you do with a liberal arts degree?” e are asked this question frequently by Star for his service in Vietnam, where he served as a Professional Rock freshmen trying to choose a major. Per- correspondent and managing editor of the Southern Climber. Acknowl- W haps you heard it from an uninformed Cross. edged as one of relative at your commencement party. Our answer the best all-round to the question is, “With a liberal arts degree from CEO for Power Companies. In a career featur- climbers in the world, Colorado State University, you can do anything you ing a number of “firsts,” Judi Johansen (political Steph Davis (English want to do. You can be ... ” science 1980) went from M.A. 1995) was the law school to a power first female to climb Governor of Colorado. The Honorable Bill Ritter industry career in the the Salathé Wall (political science Pacific Northwest. She on El Capitan in Yosemite National Park without 1978) was elected was the first female equipment. She has many other “firsts” on high governor of Colo- president and CEO of mountain rock faces around the world. A profile in rado in 2006. Prior PacifiCorp, a subsid- Outside Online described the upside and downside to his election, he iary of ScottishPower, of Steph’s climbing career. The downside? “Having served as district as well as the first your mom suggest (frequently) that you are out of attorney for the female CEO/adminis- your mind.” The upside? “Yosemite. The Andes. And city and county of trator of the Bonn- a life in which every day is a thrilling vertical grab.” Denver.
    [Show full text]
  • India's Take on Sports Analytics
    PSYCHOLOGY AND EDUCATION (2020) 57(9): 5817-5827 ISSN: 00333077 India’s Take on Sports Analytics Rohan Mehta1, Dr.Shilpa Parkhi2 Student, Symbiosis Institute of Operations Mangement, Nashik, India Deputy Director, Symbiosis Institute of Operations Mangement, Nashik, India Email Id: [email protected] ABSTRACT Purpose – The aim of this paper is to study what is sports analytics, what are the different roles in this field, which sports are prominently using this, how big data has impacted this field, how this field is shaping up in Indian context. Also, the aim is to study the growth of job opportunities in this field, how B-schools are shaping up in this aspect and what are the interests and expectations of the B-school grads from this sector. Keywords Sports analytics, Sabermetrics, Moneyball, Technologies, Team sports, IOT, Cloud Article Received: 10 August 2020, Revised: 25 October 2020, Accepted: 18 November 2020 Design Approach analysis, he had done on approximately 10000 deliveries. Another writer, for one of the US The paper starts by explaining about the origin of magazines, F.C Lane was of the opinion that the sports analytics, the most naïve form of it, then batting average of the individual doesn’t reflect moves towards explaining the evolution of it over the complete picture of the individual’s the years (from emergence of sabermetrics to the performance. There were other significant efforts most advanced applications), how it has spread made by other statisticians or writers such as across different sports and how the applications of George Lindsey, Allan Roth, Earnshaw Cook till it has increased with the advent of different 1969.
    [Show full text]
  • Nfl.Com Releases 2006 Fantasy Football Preview Magazine
    NATIONAL FOOTBALL LEAGUE 280 Park Avenue, New York, NY 10017 (212) 450-2000 * FAX (212) 681-7573 WWW.NFLMedia.com Joe Browne, Executive Vice President-Communications Greg Aiello, Vice President-Public Relations FOR IMMEDIATE RELEASE NFL-32 6/8/06 NFL.COM RELEASES 2006 FANTASY FOOTBALL PREVIEW MAGAZINE NFL.com Expert Analysis on Trades, Hidden Gems, Sleepers & Rookies to Look For Player Rankings, Cheat Sheets, & Three-Year Statistical Averages with 2006 Projections Magazine Hits Newsstands on June 12 With football fans already gearing up for the 2006 NFL season more than a month before the opening of training camps, NFL.com has again produced an outstanding tool for fantasy football players to prepare for the upcoming season. For the second consecutive year, the NFL’s own fantasy football magazine – NFL.COM FANTASY FOOTBALL 2006 PREVIEW – provides all the essentials for fantasy players with exclusive analysis and statistics from NFL.com. The magazine hits newsstands on June 12. NFL.COM FANTASY FOOTBALL 2006 PREVIEW, produced by NFL Publishing and Time Inc. Home Entertainment, is priced at $7.99 and features 160 pages of in-depth, position-by-position scouting reports, depth charts, draft cheat sheets, mock drafts, statistics and features. Rankings and analysis found in NFL.COM FANTASY FOOTBALL 2006 PREVIEW will be updated throughout the preseason on NFL.com. Among the highlights: Three Year Averages: A 26-page review of NFL players and their statistics over the past three seasons with projections for 2006. “New Coaches, New Ideas”: NFL.com national editor Vic Carucci discusses how the NFL’s 10 new head coaches will affect the 2006 fantasy football season.
    [Show full text]
  • Sabermetrics: the Past, the Present, and the Future
    Sabermetrics: The Past, the Present, and the Future Jim Albert February 12, 2010 Abstract This article provides an overview of sabermetrics, the science of learn- ing about baseball through objective evidence. Statistics and baseball have always had a strong kinship, as many famous players are known by their famous statistical accomplishments such as Joe Dimaggio’s 56-game hitting streak and Ted Williams’ .406 batting average in the 1941 baseball season. We give an overview of how one measures performance in batting, pitching, and fielding. In baseball, the traditional measures are batting av- erage, slugging percentage, and on-base percentage, but modern measures such as OPS (on-base percentage plus slugging percentage) are better in predicting the number of runs a team will score in a game. Pitching is a harder aspect of performance to measure, since traditional measures such as winning percentage and earned run average are confounded by the abilities of the pitcher teammates. Modern measures of pitching such as DIPS (defense independent pitching statistics) are helpful in isolating the contributions of a pitcher that do not involve his teammates. It is also challenging to measure the quality of a player’s fielding ability, since the standard measure of fielding, the fielding percentage, is not helpful in understanding the range of a player in moving towards a batted ball. New measures of fielding have been developed that are useful in measuring a player’s fielding range. Major League Baseball is measuring the game in new ways, and sabermetrics is using this new data to find better mea- sures of player performance.
    [Show full text]
  • 2021 SEC Baseball SEC Overall Statistics (As of Jun 30, 2021) (All Games Sorted by Batting Avg)
    2021 SEC Baseball SEC Overall Statistics (as of Jun 30, 2021) (All games Sorted by Batting avg) Team avg g ab r h 2b 3b hr rbi tb slg% bb hp so gdp ob% sf sh sb-att po a e fld% Ole Miss . 2 8 8 67 2278 478 656 109 985 437 1038 . 4 5 6 295 87 570 45 . 3 8 5343 44-65 1759 453 57 . 9 7 5 Vanderbilt . 2 8 5 67 2291 454 653 130 21 92 432 1101 . 4 8 1 301 53 620 41 . 3 7 8 17 33 92-104 1794 510 65 . 9 7 3 Auburn . 2 8 1 52 1828 363 514 101 986 344 891 . 4 8 7 230 34 433 33 . 3 6 8 21 16 32-50 1390 479 45 . 9 7 6 Florida . 2 7 9 59 2019 376 563 105 13 71 351 907 . 4 4 9 262 47 497 32 . 3 7 0 30 4 32-48 1569 528 68 . 9 6 9 Tennessee . 2 7 9 68 2357 475 657 134 12 98 440 1109 . 4 7 1 336 79 573 30 . 3 8 3 27 23 72-90 1844 633 59 . 9 7 7 Kentucky . 2 7 8 52 1740 300 484 86 10 62 270 776 . 4 4 6 176 63 457 28 . 3 6 2 21 16 78-86 1353 436 39 . 9 7 9 Mississippi State . 2 7 8 68 2316 476 644 122 13 75 437 1017 . 4 3 9 306 73 455 50 . 3 7 5 31 13 74-92 1811 515 60 .
    [Show full text]
  • This Week in Padres History
    THIS WEEK IN PADRES HISTORY June 9, 1981 June 10, 1987 Tony Gwynn, 21, is drafted by the Former NL President Charles S. Padres in the third round of the “Chub” Feeney is named President June free agent draft. Gwynn was of the Padres. the fourth player selected by the Padres in the 1981 draft. That same day, Gwynn is drafted in the 10th round by the San Diego Clippers of the National Basketball Association. June 12, 1970 June 9, 1993 PIT’s Dock Ellis throws the first The Padres name Randy Smith no-hitter against the Padres in a their seventh general manager, 2-0 San Diego loss at San Diego replacing Joe McIlvaine. Smith, 29, Stadium. becomes the youngest general manager in Major League history. June 10, 1999 June 12, 2002 Trevor Hoffman strikes out the side RHP Brian Lawrence becomes the for his 200th save as the Padres 36th pitcher in MLB history to throw defeat Oakland 2-1 at Qualcomm an “immaculate inning,” striking out Stadium. the side on nine pitches in the third inning of the Padres’ 2-0 interleague win at Baltimore. Only one of the nine pitches was taken for a called strike. June 14, 2019 The Padres overcome a six-run deficit in the ninth for the first time in franchise history, scoring a 16-12 win @ COL in 12 innings. SS Fernando Tatis Jr. has two hits in the six-run ninth, including the game-tying, two-run single, and he later triples and scores the go-ahead run in the 12th.
    [Show full text]
  • The Numbers Game: Baseball's Lifelong Fascination with Statistics (Book Review)
    The Numbers Game: Baseball's Lifelong Fascination with Statistics (Book Review) The American Statistician May 1, 2005 | Cochran, James J. The Numbers Game: Baseball's Lifelong Fascination with Statistics. Alan SCHWARZ. New York: Thomas Dunne Books, 2004, xv + 270 pp. $24.95 (H), ISBN: 0‐312‐322222‐4. I am amazed at how frequently I walk into a colleague's office for the first time and spot a copy of The Baseball Encyclopedia or Total Baseball on a bookshelf. How many statisticians developed and nurtured their interest in probability and statistics by playing Strat‐O‐ Matic[R] and/or APBA[R] baseball board games; reading publications like the annual The Bill James Baseball Abstract; or scanning countless box scores and current summary statistics in the Sporting News or in the sports section of the local newspaper, looking for an edge in a rotisserie baseball league? For many of us, baseball is what initially opened our eyes to the power of probability and statistics, and the sport continues to be an integral part of our lives (for evidence of this, attend the sessions or business meeting of the ASA's Statistics in Sports section at the next Joint Statistical Meetings). This is why so many probabilists and statisticians will enjoy reading Alan Schwarz's The Numbers Game: Baseball's Lifelong Fascination with Statistics. In this book, Schwarz effectively chronicles the ongoing association between baseball and statistics by describing the evolution of the sport from the mid‐nineteenth century through the beginning of the twenty‐first century, and looking at several of its most influential characters.
    [Show full text]
  • UPCOMING SCHEDULE and PROBABLE STARTING PITCHERS DATE OPPONENT TIME TV ORIOLES STARTER OPPONENT STARTER June 12 at Tampa Bay 4:10 P.M
    FRIDAY, JUNE 11, 2021 • GAME #62 • ROAD GAME #30 BALTIMORE ORIOLES (22-39) at TAMPA BAY RAYS (39-24) LHP Keegan Akin (0-0, 3.60) vs. LHP Ryan Yarbrough (3-3, 3.95) O’s SEASON BREAKDOWN KING OF THE CASTLE: INF/OF Ryan Mountcastle has driven in at least one run in eight- HITTING IT OFF Overall 22-39 straight games, the longest streak in the majors this season and the longest streak by a rookie American League Hit Leaders: Home 11-21 in club history (since 1954)...He is the first Oriole with an eight-game RBI streak since Anthony No. 1) CEDRIC MULLINS, BAL 76 hits Road 11-18 Santander did so from August 6-14, 2020; club record is 11-straight by Doug DeCinces (Sep- No. 2) Xander Bogaerts, BOS 73 hits Day 9-18 tember 22, 1978 - April 6, 1979) and the club record for a single-season is 10-straight by Reggie Isiah Kiner-Falefa, TEX 73 hits Night 13-21 Jackson (July 11-23, 1976)...The MLB record for consecutive games with an RBI by a rookie is No. 4) Vladimir Guerrero, Jr., TOR 70 hits Current Streak L1 10...Mountcastle has hit safely in each of these eight games, slashing .394/.412/.848 (13-for-33) Yuli Gurriel, HOU 70 hits Last 5 Games 3-2 with three doubles, four home runs, seven runs scored, and 12 RBI. Marcus Semien, TOR 70 hits Last 10 Games 5-5 Mountcastle’s eight-game hitting streak is the longest of his career and tied for the April 12-14 fourth-longest active hitting streak in the American League.
    [Show full text]