To Err Is Human: Using Science to Reduce Mistaken Eyewitness Identifications in Lineups by Maureen McGough

Researchers take police lineup studies from the laboratory to the field.

In 1984, a Cook County, Ill., jury found 27-year-old Ronnie Bullock guilty of raping a 9-year-old girl in Chicago’s south side. He was sentenced to 60 years in prison. Crucial to the prosecution’s case was the victim’s identification of Bullock in a police lineup. A second rape victim — a 12-year-old girl — also viewed a police lineup and identified Bullock as her attacker.1

Maintaining his innocence, Bullock sought relief from the courts. His conviction was upheld on appeal in 1987, and two state postconviction petitions were unsuccessful. Bullock’s federal habeas petition was denied in 1991.2

In June of 1993, he was granted a motion to have impounded released for DNA testing. Tests revealed that Bullock was not the source of the semen found on the victim’s clothing, and a judge dismissed the charges against him in 1994.3

Bullock spent 10 and a half years in prison for a he did not commit.4

30 NIJ JOURNAL / ISSUE NO. 270 ■ JUNE 2012

The “Greensboro ationwide, mistaken eyewit- identification, but they cannot be ness identifications have Protocols” emphasized controlled in actual criminal cases.9 N played a role in 75 percent of the importance of true convictions later overturned because Several renowned eyewitness of DNA evidence,5 and criminal researchers have focused studies justice practitioners and researchers random assignment and on variables that the criminal justice have a pervasive interest in finding the consistent use system could control, such as who ways to improve the methods used administers the lineup, how the for eyewitness identifications. A of double-blind lineups lineup is administered, lineup com- good deal of research has focused positions and instructions given to on the police lineup, in which victims for conducting a witnesses.10 and witnesses attempt to distinguish a from other individuals pre- scientifically sound By focusing on these controllable sented (known as “fillers”). variables, researchers have produced field experiment. findings from laboratory experiments A recent study from the American that shape investigative practices and Judicature Society (AJS) is adding to procedures.11 These science-based the body of research by investigating practices include: which lineup method results in fewer The initial report on the AJS study 6 mistaken identifications: indicates that sequential lineups sig- ■ Using fillers in lineups that match nificantly reduce the number of filler the verbal description of the ■ Sequential, in which the witness identifications without significantly perpetrator views lineup members one at a reducing the number of accurate ■ Informing the witness that the per- time and makes a decision on each positive identifications. Thus, the petrator may or may not be present individual member, or AJS findings support results from past laboratory experiments. in the lineup ■ Simultaneous, in which the ■ Using a double-blind administration witness views the entire lineup in which the lineup administrator at once Research From Laboratories to the Field does not know who the suspect is Past research using controlled and therefore is unable to transmit laboratory experiments consistently Given the vital role of eyewitness inadvertent cues or feedback to showed that sequential methods testimony in the administration the identifying witness12 yielded fewer mistaken identifica- of justice and the inherent risks Laboratory tests also show that tions. But in 2006, a field study in therein, extensive research has been sequential lineups offer a better ratio Illinois called into question the supe- dedicated to developing lineups that of accurate to mistaken identifica- riority of the sequential method (and minimize identification of fillers with- tions than simultaneous lineups. with it, the use of controlled labora- out significantly reducing accurate, Sequential lineups require witnesses tory experiments as approximations positive identifications. to compare each individual they see for actual eyewitnesses to ). to their recollection of the suspect.13 However, many of the variables that This increases accuracy and reduces Scientists, however, identified flaws may affect the accuracy of eyewit- the risk that witnesses will make a in the Illinois study’s design and ness identification are out of the judgment based on a relative com- implementation. As a result, some control of the criminal justice sys- parison of who among the group experts have deemed the results tem.8 These include lighting of the looks most like the perpetrator rela- “difficult or impossible to interpret.”7 crime scene; length of time a wit- tive to the other lineup members. In ness was exposed to the perpetrator; fact, when a double-blind lineup was To produce more rigorous data using severity of the crime; and character- administered using the sequential field techniques rather than labora- istics of the witness and perpetrator, technique in laboratory testing, iden- tory techniques, the AJS research such as race, age and sex. These tifications were twice as reliable as team developed an improved variables are helpful in estimating those from traditional lineups.14 research design for its study. the likely accuracy of eyewitness

To Err Is Human: Using Science to Reduce Mistaken Eyewitness Identifications in Police Lineups | 31 NIJ JOURNAL / ISSUE NO. 270 ■ JUNE 2012

The Supreme Court and Eyewitness Testimony — Perry v. New Hampshire

yewitness testimony plays a identifications made under sugges- argument would open the door to Ecrucial role in the American tive conditions require preliminary judicial preview of most — if not criminal justice system. However, judicial inquiry — when happen- all — eyewitness identifications. like any process relying on the stance renders the identification Justice Sonia Sotomayor was the integrity of human memory, eye- setting suggestive. lone dissenter. Although the major- witness testimony is imperfect. In Perry, a New Hampshire police ity held that the crucial, common The American Judicature Society officer responded to a call that an factor in relevant Court precedent study found that even when African American man was attempt- was that police arranged a sugges- lineups were conducted using ing to break into cars in a nearby lot. tive interview, Justice Sotomayor procedures shown to lead to fewer When the officer asked an eyewit- countered that the suggestive nature mistaken identifications, witnesses ness to describe the man, she of the interview itself — not the cir- identified a “filler” 12.2 percent of pointed to Perry — the only African cumstances that led the suggestive the time. The courts must there- American man standing in the lot nature — was the key. She believed fore strike a balance between next to a police officer — and identi- that the majority opinion did not ade- allowing the introduction of eyewit- fied him as the man in question. quately consider empirical evidence ness testimony that can be crucial Perry’s followed. The out-of- showing mistaken identifications as to the prosecution’s case and court identification was introduced the single greatest cause of wrong- protecting defendants from unrea- at trial and Perry was found guilty ful convictions in this country. She sonably unreliable evidence. of theft. also highlighted studies showing that The Supreme Court has long held eyewitness recollections are highly In its October 2011 opinion, the that it is up to jurors to evaluate susceptible to distortion and that Court held that the introduction eyewitness testimony and make jurors overestimate the accuracy of this out-of-court identification their own judgments as to its of eyewitness identifications. did not violate the Due Process credibility. However, the Court has Clause. The Court said that the also held that the Constitution’s determination of the Due Process Clause requires credibility of the preliminary judicial inquiry into the testimony in reliability of eyewitness identifica- question should tion if law enforcement created be left to the jurors and unnecessarily suggestive circum- declined to put what it deemed new stances during the identification. legal limits on the use of question- In Perry v. New Hampshire, the able eyewitness testimony at trial. petitioner asked the Court to The Court also opined that Perry’s apply the same principle — that

The 2006 Illinois Report double-blind lineup compared with double-blind, sequential lineups pro- Although laboratory results were the traditional (non-blind, simultane- duced a higher rate of identification 15 promising, proposed changes in ous) lineup. of innocent fillers and a lower rate of 16 investigative practices needed to identification of . In other be field tested before they could The results were surprising. In words, this report contradicted what be used to support widespread 2006, the Illinois State Police laboratory experiments had shown procedural overhauls. In 2003, the released a report (often referred to for years, and it recommended Illinois state legislature charged the as The Mecklenberg Report after against instituting changes based 17 Illinois State Police with conduct- its author, Sheri Mecklenberg) solely on laboratory science. The ing a yearlong field test of the showing that, in two of the three report, which was widely publicized, effectiveness of the sequential, jurisdictions participating in the study, drew resolute support and severe

32 | To Err Is Human: Using Science to Reduce Mistaken Eyewitness Identifications in Police Lineups NIJ JOURNAL / ISSUE NO. 270 ■ JUNE 2012

criticism, particularly regarding a weapon was present, viewing well as lineups in which the eyewit- the design and implementation of conditions, sobriety of the wit- ness had prior knowledge of the the study.18 ness, certainty of the witness, suspect through a previous acquain- and whether it was a cross-race tance. This left researchers with First and foremost, critics stressed identification.23 497 protocol-consistent lineups for that the study confounded the simul- crimes, ranging from simple assault taneous/sequential and non-blind/ The “Greensboro Protocols” to murder. double-blind variables, rendering emphasized the importance of true results largely uninterpretable. It random assignment of lineups into Results was impossible to determine the sequential or simultaneous There were no significant differences whether the better outcome using groups, and the consistent use of in a witness’s ability to identify the the simultaneous lineups was partly double-blind lineups in both groups suspect between the simultane- or entirely attributable to the influ- was also deemed essential for con- ous and sequential techniques. 19 ence of the non-blind administrator. ducting a scientifically sound Witnesses identified the suspect Notably, some proponents of the field experiment. 25.5 percent of the time in simulta- study felt that confounding these neous lineups and 27.3 percent of variables did not color the results, The protocols also highlighted the the time in sequential lineups. This citing research that compared importance of using computers — small difference in identification rates double-blind conditions to non-blind both for administering the line- falls within the margin of error and 20 conditions and finding no effects. ups and for recording witness should not be considered a meaning- responses — to ensure that pro- ful difference. Additionally, critics cited the fact that cedures were fairly conducted in cases were not randomly assigned to accordance with best practices. However, simultaneous lineups either group, and cases thought to be Computers were deemed espe- resulted in 18.1 percent identification “tougher,” such as cross-race identi- cially important because they of fillers, whereas sequential lineups fications or those in which the lineup could ensure uniform administra- resulted in 12.2 percent identification took place after a delay, were more tion of lineups according to protocol, of fillers. This 5.9 percent difference likely to be assigned to the sequen- randomly assign lineups as either in filler identifications was found to tial group, thus negatively skewing sequential or simultaneous, and be statistically significant. the sequential results.21 Critics also randomly order the photos within a noted that some filler identifications lineup. Computers would also allow The AJS study results are consistent were not recorded in simultaneous for uniform, reliable and complete with the results of decades of labora- lineups, thus positively skewing the recordings of witness responses, tory tests showing that sequential 22 simultaneous results. including the time it took for wit- lineups reduce mistaken identifica- nesses to make a determination. tions without significantly reducing The Greensboro Protocols accurate identifications. To address critiques of The The AJS Field Study Mecklenberg Report, the AJS Next Steps Relying on the Greensboro Protocols, convened scientists, lawyers, pros- Researchers plan to conduct the AJS developed a field experiment ecutors and police in Greensboro, additional analyses of the data to that compensated for the deficiencies N.C., to develop a set of guidelines determine: for conducting field experiments of the 2006 Illinois study. The field experiment was conducted at four testing the simultaneous/sequential ■ Whether witnesses are more sites: the Austin Police Department variable. The group was commit- certain about their mistaken (Texas), the Charlotte-Mecklenburg ted to conducting field research identifications in sequential or Police Department (N.C.), the San that would gather reliable data on simultaneous lineups the administration of the lineup Diego Police Department (Calif.) and witness and event variables. and the Tucson Police Department ■ Whether accuracy changes with Data determined to be essential for (Ariz.). the witness’s status as a victim or a scientifically sound field experi- bystander The AJS research team excluded ment included time between crime ■ Whether the identifications were lineups that were not conducted and lineup, type of crime, whether same-race or cross-race using a double-blind procedure, as

To Err Is Human: Using Science to Reduce Mistaken Eyewitness Identifications in Police Lineups | 33 NIJ JOURNAL / ISSUE NO. 270 ■ JUNE 2012

Additionally, although identifica- tions of fillers are clearly erroneous, Notes identifications of the suspect are not 1. Conners, Edward, Thomas 10. See, for example, Doyle, James M., necessarily accurate because the Lundregan, Neal Miller, and Tom “Learning From Error in American McEwen, “Convicted by Juries, Criminal Justice,” The Journal of suspect is not always the perpetra- Exonerated by Science: Case Studies & Criminology 100 tor. The Police Foundation is leading in the Use of DNA Evidence to (2010): 109-148, http://www.law. a second phase of research to follow Establish Innocence After Trial,” northwestern.edu/jclc/backissues/ up on this area. Final report to the National Institute v100/n1/1001_109.Doyle.pdf. of Justice, grant number OJP-95-215, 11. Ibid., 116. June 1996, NCJ 161258, available The police lineup is an inherently at https://www.ncjrs.gov/pdffiles/ 12. Ibid., 17. human process, and therefore inher- dnaevid.pdf. 13. Schacter, ”Policy Forum.” ently flawed. Although no single 2. Garrett, Brandon L., “Judging 14. Steblay, Nancy, Jennifer Dysart, study can lead to the development Innocence,” Columbia Law Review Solomon Fulero, and R.C.L. Lindsay, of a procedure guaranteeing con- 108 (2008): 65, http://www. “Eyewitness Accuracy Rates in columbialawreview.org/assets/ Sequential and Simultaneous Lineup sistently accurate identifications, a pdfs/108/1/Garrett.pdf. Presentations: A Meta-Analytic well-designed field study can be an 3. Conners, “Convicted by Juries, Comparison,” Law and Human important step in developing best Exonerated by Science,” 40. Behavior 25 (2001): 459-473, practices for lineups and other identi- http://citeseerx.ist.psu.edu/viewdoc/ 4. Ibid. summary?doi=10.1.1.110.8546. fication practices. 5. The Innocence Project, “Eyewitness 15. Mecklenberg, Sheri H., Report to Misidentification,” http://www. the Legislature of the State of Illinois: innocenceproject.org/understand/ The Illinois Pilot Program on Sequential About the author: Maureen McGough Eyewitness-Misidentification.php. Double-Blind Identification Procedures, is an attorney and NIJ’s outreach 6. One of the four study sites, Tucson, Springfield, IL: Illinois State Police, coordinator. Ariz., was initially funded as a stand- 2006, http://www.chicagopolice.org/ alone field study by NIJ. The results IL%20Pilot%20on%20Eyewitness% NCJ 238486 of that site analysis were included 20ID.pdf. in the AJS Field Study after the NIJ 16. Ibid. study received funding to use laptop computers. 17. Schacter, “Policy Forum.” 18. Ibid., 2. For more information: 7. Schacter, Daniel L., Robin Dawes, Larry L. Jacoby, Daniel Kahneman, 19. Ibid. ■ Mecklenberg, Sheri H., Report Richard Lempert, Henry L. Roediger, 20. Malpass, Roy S., “Notes on the to the Legislature of the State and Robert Rosenthal, “Policy Forum: Illinois Pilot Program on Sequential Studying Eyewitness Investigations in of Illinois: The Illinois Pilot Double-Blind Lineup Procedures,” the Field,” Law and Human Behavior Public Interest Law Reporter 2006: Program on Sequential Double- 32 (2008): 3-5, http://www.jjay.cuny. 5-8, 39-47; See also Ebbesen, Ebbe Blind Identification Procedures, edu/extra/policyforum.pdf; see gen- B., “Comments on IL Simultaneous v. Springfield, IL: Illinois State Police, erally Conners, “Convicted by Juries, Sequential Lineup Field Test,” 2006. Exonerated by Science.” 2006, http://www.chicagopolice. 21. Wells, Gary L., Nancy K. Steblay, org/IL%20Pilot%20on%20 8. Wells, Gary L., “Applied Eyewitness- and Jennifer E. Dysart, A Test of Testimony Research: System Eyewitness%20ID.pdf the Simultaneous vs. Sequential Lineup Variables and Estimator Variables,” Methods: An Initial Report of the AJS ■ Wells, Gary L., Nancy K. Steblay, Journal of Personality and Social National Eyewitness Identification 36 (1978): 1546-1557, and Jennifer E. Dysart, A Test of Psychology Field Studies, Des Moines, IA: http://www.psychology.iastate. American Judicature Society, 2011, the Simultaneous vs. Sequential edu/~glwells/Wells_articles_pdf/ http://www.ajs.org/wc/pdfs/EWID_ Lineup Methods: An Initial Report Applied_Eyewitness-Testimony_ PrintFriendly.pdf. Research.pdf. of the AJS National Eyewitness 22. Ibid. 9. Ibid., 1548. Identification Field Studies, Des 23. Ibid., ix. Moines, IA: American Judicature Society, 2011, http://www.ajs.org/ wc/pdfs/EWID_PrintFriendly.pdf Learn more about the science behind police lineups: http://www.nij.gov/journals/258/police-lineups.html.

34 | To Err Is Human: Using Science to Reduce Mistaken Eyewitness Identifications in Police Lineups