medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

1 RT-LAMP has high accuracy for detecting SARS-CoV-2 in saliva and 2 naso/oropharyngeal swabs from asymptomatic and symptomatic individuals

3 Short title: RT-LAMP for detecting SARS-CoV-2 in saliva and naso/oropharyngeal swabs

4 †Stephen P. Kidd1,2, †Daniel Burns1,3, Bryony Armson1,2,4, Andrew D. Beggs5, Emma L. A. Howson6, 5 Anthony Williams7, Gemma Snell7, Emma L. Wise1,8, Alice Goring1, Zoe Vincent-Mistiaen9, Seden 6 Grippon1, Jason Sawyer10, Claire Cassar10, David Cross10, Tom Lewis10, Scott M. Reid10, Samantha 7 Rivers10, Joe James10, Paul Skinner10, Ashley Banyard10, Kerrie Davies11, Anetta Ptasinska5, Celina 8 Whalley5, Jack Ferguson5, Claire Bryer5, Charlie Poxon5, Andrew Bosworth5, Michael Kidd5,12, Alex 9 Richter13, Jane Burton14, Hannah Love14, Sarah Fouch1, Claire Tillyer1, Amy Sowood1, Helen Patrick1, 10 Nathan Moore1, Michael Andreou15, Nick Morant16, Rebecca Houghton1, Joe Parker17, Joanne Slater- 11 Jefferies17, Ian Brown10, Cosima Gretton2, Zandra Deans2, Deborah Porter2, Nicholas J. Cortes1,9, Angela 12 Douglas2, Sue L. Hill2, *Keith M. Godfrey18,19, +Veronica L. Fowler1,2

13

14 1Hampshire Hospitals NHS Foundation Trust, Department of Microbiology, Basingstoke and North Hants 15 Hospital, Basingstoke, UK 16 2NHS Test and Trace Programme, Department of Health and Social Care, UK 17 3School of Electronics and Computer Science, University of Southampton, UK 18 4vHive, School of , University of , , UK 19 5University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK 20 6The Institute, Ash Road, Pirbright, Woking, UK 21 7University of Southampton & Division of Specialist Medicine, University Hospital Southampton, UK 22 8School of Biosciences and Medicine, , Guildford, UK 23 9Gibraltar Health Authority, Gibraltar, UK 24 10Animal and Plant Health Agency, New Haw, Addlestone, Surrey, UK 25 11Leeds Teaching Hospitals NHS Trust and University of Leeds, UK 26 12Public Health West Midlands Laboratory, Birmingham, UK 27 13Institute of Immunology and Immunotherapy, University of Birmingham, UK 28 14High Containment Microbiology, National Service, Public Health , Porton Down, UK 29 15OptiSense Limited, Horsham, West Sussex, UK 30 16GeneSys Biotech Limited, Camberley, Surrey, UK 31 17National Biofilms Innovation Centre, University of Southampton, UK 32 18NIHR Southampton Biomedical Research Centre, University of Southampton and University Hospital, UK 33 19MRC Lifecourse Epidemiology Centre, University of Southampton, UK 34

35 †Denotes co-first authorship; +Senior author; *Corresponding author: - [email protected];

36 NOTE: This preprint reports new research that has not been certified by peer review and should not be used to guide clinical practice.

Page 1 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

37 Abstract

38 Previous studies have described RT-LAMP methodology for the rapid detection of SARS-CoV-2 in

39 nasopharyngeal/oropharyngeal swab and saliva samples. Here we describe the validation of an

40 improved sample preparation method for extraction free Direct RT-LAMP and define the clinical

41 performance of four different RT-LAMP assay formats for detection of SARS-CoV-2 within a large-scale

42 multisite clinical evaluation.

43 We describe Direct RT-LAMP on 559 swabs and 86,760 saliva samples and RNA RT-LAMP on extracted

44 RNA from 12,619 swabs and 12,521 saliva samples collected from asymptomatic and symptomatic

45 individuals across multiple healthcare and community settings.

46 For Direct RT-LAMP, we found a diagnostic sensitivity (DSe) of 70.35% (95% CI 63.48-76.60%) on swabs

47 and 84.62% (79.50-88.88%) on saliva, with diagnostic specificity (DSp) of 100% (98.98-100.00%) on

48 swabs and 100% (99.72-100.00%) on saliva when compared to RT-qPCR. Analysing samples with RT-

49 qPCR ORF1ab CT values of <25 and <33 (high and medium-high viral copy number, respectively), we

50 found DSe of 100% (96.34-100%) and 77.78% (70.99-83.62%) for swabs, and 99.01% (94.61-99.97%)

51 and 87.32% (80.71-92.31%) for saliva. For RNA RT-LAMP DSe and DSp were 95.98% (92.74-98.06%)

52 and 99.99% (99.95-100%) for swabs, and 80.65% (73.54-86.54%) and 99.99% (99.95-100%) for saliva,

53 respectively.

54 The findings from these evaluations demonstrate that RT-LAMP testing of swabs and saliva is

55 applicable to a variety of different use-cases, including frequent, interval-based testing of saliva from

56 asymptomatic individuals via Direct RT-LAMP that may otherwise be missed using symptomatic testing

57 alone.

58

59

60

Page 2 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

61 Author Summary

62 Rapid diagnostic testing at scale to identify and isolate symptomatic and asymptomatic individuals 63 potentially transmitting infectious SARS-CoV-2 is an essential part of the response to the COVID-19 64 pandemic. RT-LAMP on both extracted RNA and directly on crude samples potentially provides faster 65 turnaround times than reverse-transcriptase quantitative real-time PCR testing, with a higher 66 sensitivity and specificity than antigen lateral flow devices. Increasing evidence points to potential 67 benefits of SARS-CoV-2 testing using saliva rather than nasopharyngeal/oropharyngeal swabs, leading 68 us to undertake a multi-site evaluation of an improved simple sample preparation method for Direct 69 SARS-CoV-2 RT-LAMP. Our study demonstrated that the RNA RT-LAMP assay has high sensitivity and 70 specificity, providing a rapid alternative to RT-qPCR testing with a reliance on differing reagents and 71 equipment. The simple SARS-CoV-2 Direct RT-LAMP preparation method also demonstrated high 72 sensitivity and specificity for detecting SARS-CoV-2 in saliva and naso/oropharyngeal swabs from 73 asymptomatic and symptomatic individuals, notably in saliva samples from which the individual would 74 likely be considered infectious. The findings highlight the usefulness of saliva as a simple to collect, 75 non-invasive, sample type, potentially applicable for interval-based testing of asymptomatic 76 individuals.

77

Page 3 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

78 Introduction

79 Rapid diagnostic testing to identify and isolate symptomatic and asymptomatic individuals

80 potentially transmitting infectious viral pathogens is an essential requirement of any pandemic

81 response. The novel betacoronavirus, SARS-CoV-2, initially identified after an outbreak of viral

82 pneumonia in Wuhan, China in December 2019(1), has rapidly spread throughout the world, causing

83 over 141 million confirmed cases and over 3.1 million deaths(2), (April, 2021).

84 Conventional diagnostics for SARS-CoV-2 consist of RNA enrichment followed by reverse-

85 transcriptase quantitative real-time PCR (RT-qPCR) against one or more viral gene targets(3).

86 However, this methodology requires sample inactivation, RNA extraction and RT-qPCR thermal

87 cycling, meaning that the time from sample-to-result can often be several hours, and requires

88 centralised equipment and personnel trained in Good Laboratory Practice to perform testing.

89 We have previously shown the utility of reverse-transcriptase loop mediated isothermal

90 amplification (RT-LAMP) for the detection of SARS-CoV-2 both from extracted RNA (RNA RT-LAMP)

91 and directly from nasopharyngeal/oropharyngeal swabs (Direct RT-LAMP)(4). RT-LAMP utilises a

92 rapid and stable DNA polymerase that amplifies target nucleic acids at a constant temperature. This

93 removes the requirement for conventional thermal cycling allowing RT-LAMP reactions to be

94 performed in shorter reaction times using less sophisticated platforms.

95 In a study of 196 clinical samples(4), testing of RNA extracted from nasopharyngeal/oropharyngeal

96 swabs collected into viral transport media (VTM) using RNA RT-LAMP demonstrated a diagnostic

97 sensitivity (DSe) of 97% and a diagnostic specificity (DSp) of 99% in comparison to RT-qPCR of the

98 ORF1ab region of SARS-CoV-2. For Direct RT-LAMP on crude swab samples, the DSe and DSp were

99 67% and 97%, respectively. When a cycle threshold (CT) cut-off for RT-qPCR of < 25 was considered,

100 reflecting the increased likelihood of detecting viral RNA from active viral replication, the DSe of

101 Direct RT-LAMP increased to 100% (4).

Page 4 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

102 However, the collection of a swab sample is invasive and during the time of the pandemic there have

103 been considerable shortages in swab supplies. Exploring the use of alternative sample types that are

104 both easy to collect and more of a comfortable from a sampling perspective is desirable particularly

105 when repeat sampling is performed. Saliva presents an ideal bio-fluid that fulfils both these

106 objectives and previous studies have shown that SARS-CoV-2 is readily detectable in such a sample

107 type(5–10). To improve the diagnostic sensitivity of previously described saliva Direct RT-LAMP(4),

108 optimisation of saliva preparation for the detection of SARS-CoV-2 was undertaken utilising a cohort

109 of 3100 saliva samples from an asymptomatic population(11) of healthcare workers; where saliva

110 was diluted 1:1 in MucolyseTM, followed by a 1 in 10 dilution in 10% (w/v) Chelex© 100 Resin ending

111 with a 98°C heat step prior to RT-LAMP which resulted in optimal sensitivity and specificity.

112 Despite the benefits of this optimisation, the protocol added additional steps and reagents which

113 increased chance for user error and made the automation of the process more challenging. We

114 therefore aimed to investigate a simpler process using a novel reagent, RapiLyze (OptiGene Ltd),

115 which is a sample dilution buffer, followed by a two-minute heat-step. This novel sample

116 preparation method was evaluated in combination with Direct RT-LAMP using samples collected

117 from symptomatic National Health Service (NHS) patients and symptomatic and asymptomatic

118 healthcare staff.

119

Page 5 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

120

121 Results

122 RNA RT-LAMP

123 VTM from 12,619 naso/oropharyngeal swabs were assayed. 265 swab samples were from known

124 symptomatic individuals and 2073 swab samples were from known asymptomatic individuals. The

125 clinical status of the remaining samples (n= 10,281) was unknown.

126 12,521 neat saliva samples were assayed, none of which were from known symptomatic individuals.

127 12,365 of these samples were from known asymptomatic individuals. The clinical status of the

128 remaining saliva samples (n= 156) was unknown.

129 Direct RT-LAMP

130 VTM from 559 naso/oropharyngeal swabs were assayed. 170 swab samples were from known

131 symptomatic individuals and 310 samples were from known asymptomatic individuals and the

132 clinical status of the remaining swab samples (n= 79) was unknown.

133 86,760 neat saliva samples were assayed. 93 samples were from known symptomatic individuals and

134 86,593 samples were from known asymptomatic individuals. The clinical status of the remaining

135 samples (n= 74) was unknown. In addition, 10 separate longitudinal daily saliva samples were

136 provided from one individual as a time course from development of symptoms to three days post

137 resolution of symptoms.

138

139 RNA RT-LAMP on naso/oropharyngeal swabs

140 A total of 12,619 swab samples were assayed by RNA RT-LAMP, of which 254 were RT-qPCR positive

141 and 12,365 were RT-qPCR negative. RNA RT-LAMP detected 244 of the 254 positives (Figure 1a and

142 Table 1). Only one of the 12,365 samples negative by RT-qPCR was positive by RNA RT-LAMP. 588

Page 6 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

143 samples were tested in duplicate and 12,031 were tested as single replicates. Of those samples

144 tested in duplicate seven were detected by RNA RT-LAMP in only a single replicate (CTs 27.00, 32.66,

145 33.14, 33.16, 34.07, 35.05, and 37.20 all of these had received at least one freeze thaw before

146 analysis. Overall diagnostic sensitivity (DSe) was 96.06% (95% CI 92.88-98.12) and specificity (DSp)

147 99.99% (95% CI 99.95-100.00), which is corrected to DSe 95.98% (95% CI 92.70-97.83) and DSp

148 99.99% (95% CI 99.94-100.00) after site meta-analysis Diagnostic sensitivity of samples with a CT <25

149 (n= 123) was 100.00% (95% CI 96.76-100.00) and specificity 99.99% (95% CI 99.95-100.00), and of

150 samples with a CT <33 (n=180) was 98.65% (95% CI 96.10-99.72) and specificity 99.99% (95% CI

151 99.95-100.00).

152 Table 1. Diagnostic sensitivity and specificity of RNA RT-LAMP on swabs compared with RT-qPCR

RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <45 RNA RT-LAMP Pos 244† 1 245 DSe 96.06 92.88-98.12 Swab RNA RT-LAMP Neg 10 12364 12374 DS p 99.9 9 99.95 -100 Total 254 12365 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <33 RNA RT-LAMP Pos 219 1 220 DSe 98.95 96.10-99.72 Swab RNA RT-LAMP Neg 3 12364 1236 7 DSp 99.9 99.95 -100 Total 222 12365 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <25 RNA RT-LAMP Pos 112 1 113 DSe 100 96.76-100 Swab RNA RT-LAMP Neg 0 12364 1236 4 DSp 99.9 99.95 -100 Total 112 12365 † 153 Five samples included in this number were positive by RT-qPCR but did not have an associated CT value due to being 154 assayed on a platform that did not produce a CT value. DSe: Diagnostic sensitivity. DSp: Diagnostic specificity 155

156

Page 7 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

157 Direct RT-LAMP on naso/oropharyngeal swabs

158 559 swab samples were assayed by Direct RT-LAMP of which 199 were RT-qPCR positive and 360

159 were RT-qPCR negative. Direct RT-LAMP detected 140 of the 199 samples positive by RT-qPCR

160 (Figure 1b and Table 2). 195 samples were tested in duplicate and 364 tested as single replicates.

161 Seven of 195 samples tested in duplicate were positive by Direct RT-LAMP in only one replicate (CT

162 27.51, 27.95, 28.15, 28.15, 28.87, 28.92, and 28.95) all these samples had received at least one

163 freeze thaw before analysis. Overall diagnostic sensitivity was 70.35% (95% CI 63.48-76.60) and

164 specificity 100% (95% CI 98.98-100). After correction by site meta-analysis, the DSe is corrected to

165 67.59% (95% CI 53.71-78.94). Diagnostic sensitivity of samples with a CT <25 (n= 113) was 100% (95%

166 CI96.34-100) and specificity 100% (95% CI 98.98-100), and of samples with a CT <33 (n= 182) was

167 77.78% (95% CI 70.99-83.62) and specificity 100% (95% CI 98.98-100).

168

169 Table 2. Diagnostic sensitivity and specificity of Direct RT-LAMP on swabs compared to RT-qPCR

RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <45 Direct RT-LAMP Pos 140 0 140 DSe 70.35 63.48- Swab 76.60 Direct RT-LAMP Neg 59 360 419 DSp 100 98.98-100 Total 199 360 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <33 Direct RT-LAMP Pos 140 0 140 DSe 77.78 70.99- Swab 83.62 Direct RT-LAMP Neg 40 360 400 DSp 100 98.98-100 Total 180 360 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <25 Direct RT-LAMP Pos 99 0 99 DSe 100 96.34-100 Swab Direct RT-LAMP Neg 0 360 360 DSp 100 98.98-100 Total 99 360 170 DSe: Diagnostic sensitivity. DSp: Diagnostic specificity

171

172

Page 8 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

173 RNA RT-LAMP on saliva

174 Saliva samples numbering 12,521 were assayed by RNA RT-LAMP of which 155 were RT-qPCR

175 positive and 12,366 were RT-qPCR negative. RNA RT-LAMP detected 133 of the 155 samples that

176 were positive by RT-qPCR (Figure 1c and Table 3). Only one of the 12,366 samples negative by RT-

177 qPCR was positive by RNA RT-LAMP. 44 samples were tested in duplicate and 12,477 were tested as

178 single replicates. All samples tested in duplicate were positive in both replicates. Overall diagnostic

179 sensitivity was 80.65% (95% CI 73.54-86.54) and specificity 99.99% (95% CI 99.95-100), which is

180 corrected to DSe 79.05% (95% CI 68.87 – 86.55) and DSp 99.99% (95% CI 99.74-100) after site meta-

181 analysis. Diagnostic sensitivity of samples with a CT <25 (n= 74) was 100% (95% CI 93.73-100) and

182 specificity 99.99% (95% CI 99.95-100), and of samples with a CT <33 (n= 150) was 87.32% (95% CI

183 80.71-92.31) and specificity 99.95 (95% CI 99.95-100.00).

184

185

186 Table 3. Diagnostic sensitivity and specificity of RNA RT-LAMP on saliva compared to RT-qPCR

RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <45 RNA RT-LAMP Pos 125 1 126 DSe 80.65 73.54- Saliva 86.54 RNA RT-LAMP Neg 30 12365 12395 DSp 99.99 99.95-100 Total 155 12366 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <33 RNA RT-LAMP Pos 124 1 125 DSe 87.32 80.71- Saliva 92.31 RNA RT-LAMP Neg 18 12365 12383 DSp 99.99 99.95-100 Total 142 12366 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <25 RNA RT-LAMP Pos 57 1 58 DSe 100 93.73-100 Saliva RNA RT-LAMP Neg 0 12365 12365 DSp 99.99 99.95-100 Total 57 12366 187 DSe: Diagnostic sensitivity. DSp: Diagnostic specificity

188

189

Page 9 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

190 Direct RT-LAMP on saliva

191 86,760 saliva samples were tested by Direct RT-LAMP of which 247 were RT-qPCR positive and 7,195

192 were RT-qPCR negative (79,318 were negative on RT-LAMP but were not tested by RT-qPCR) (Figure

193 4d and Table 4). Direct RT-LAMP detected 209 of the 247 samples positive by RT-qPCR. 83 samples

194 were tested in duplicate and 86,677 were tested as single replicates. Nine of the 83 samples tested

195 in duplicate were negative in one of the duplicates and all these samples had received at least one

196 freeze thaw before analysis (CT 20.27, 21.28, 22.01, 24.42, 25.85, 27.35, 28.52, and 30.37). Overall

197 diagnostic sensitivity was 84.62% (95% CI 79.50-88.88) and specificity 100% (95% CI 99.72-100).

198 After correction by site meta-analysis, DSe is corrected to 84.24% (95% CI 55.03-95.89). Diagnostic

199 specificity was calculated using only the confirmed RT-qPCR negative samples. Diagnostic sensitivity

200 of samples with a CT <25 (n= 126) was 99.01% (95% CI 94.61-99.97) and specificity 100.00% (95% CI

201 99.72-100), and of samples with a CT <33 (n= 237) was 87.61% (95% CI 82.69-91.54) and specificity

202 100% (95% CI 99.72-100).

203 Table 4. Diagnostic sensitivity and specificity of Direct RT-LAMP on saliva compared to RT-qPCR.

RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT<45 Direct RT-LAMP Pos 209 0 209 DSe 84.62 79.50- Saliva 88.88 Direct RT-LAMP Neg 38 7195* 7233 DSp 100.00 99.95- 100.00 Total 247 7195 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <33 Direct RT-LAMP Pos 205 0 205 DSe 87.61 82.69- Saliva 91.54 Direct RT-LAMP Neg 29 7195* 7224 DSp 100.0 99.95- 100.00 Total 234 7195 RT-qPCR Pos RT-qPCR Neg Total % 95% CI CT <25 Direct RT-LAMP Pos 100 0 100 DSe 99.01 94.61- Saliva 99.97 Direct RT-LAMP Neg 1 7195* 7196 DSp 100.0 99.95- 100.00 Total 101 7195 204 *85,177 samples were negative on RT-LAMP but only 7,196 were confirmed negative by RT-qPCR. Only those 205 which were confirmed negative by RT-qPCR were included in the calculations. 206

Page 10 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

207 Relationship between cycle threshold (CT) value and time to positivity (Tp)

208

209

210

211 Figure 1a-d: RT-LAMP on swabs (a: RNA RT-LAMP; b: Direct RT-LAMP) and saliva (c: RNA RT-LAMP; d: Direct

212 RT-LAMP). Time to positivity [Tp] in minutes plotted against RT-qPCR Cycle Threshold [CT]. Samples which were

213 negative by RT-qPCR are not shown. Samples which were negative by RT-LAMP are shown with 0 time to

214 positivity. Results of linear ordinary least squared regression are shown for samples which were RT-LAMP

215 positive with corresponding 95% confidence interval.

216

Page 11 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

217 The relationship between CT value and Tp was explored with the results shown in Figure 1. Whilst

218 there is a weak linear relationship between CT value and Tp across all methods and sample types, a

219 stronger linear relationship was observed in swab samples with 푅2 = 0.431 for RNA RT-LAMP and

220 푅2 = 0.462 for Direct RT-LAMP. There was a notably weaker linear relationship in saliva samples

221 푅2 = 0.201 for RNA RT-LAMP and 푅2 = 0.204 for Direct RT-LAMP. For RNA RT-LAMP, there was a

2 222 notable increase in Tp variance, 𝜎푇푝, after CT =20 across both sample types. On saliva samples,

2 2 2 223 𝜎푇푝 = 0.81 for CT <20, and 𝜎푇푝 = 20.41 for CT >20; on swabs samples, 𝜎푇푝 = 1.96 and CT <20, and

2 224 𝜎푇푝 = 15.72 for CT >20

225

226 Individual time course

227 In the time course experiment SARS-CoV-2 RNA was detected from day 5 (at the onset of symptoms)

228 up to day 12 post suspected initial exposure using Direct RT-LAMP and up to day 13 by RNA RT-

229 LAMP, encompassing the full six days where symptoms were recorded (Supplementary Information).

230

231 SARS-CoV-2 viral culture of clinical samples across a CT range

232 Although not a large sample size; a negative result via Direct RT-LAMP does seem indicate the

233 presence of culturable virus is less probable and recoverable virus CT >25 for RDRP/ORF1ab target is

234 less likely. The sensitivity of the viral culture assay is presented in Supplementary data 2 of 1 pfu/ml.

235

236

237

238

239

Page 12 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

CT values Decrease SARS- CT decrease D0 to Direct RNA in CT Genesig CoV E Sample RT- RT- VIASURE cpe from P0 D7 RDRP gene LAMP LAMP D0 to P0 gene Sarbeco D7 ORF1ab assay P1 P2 1 POS POS 19.9 18.7 17.8 + P2¶ + n/a n/a 2 POS POS 21.3 19.9 19.0 + + n/a n/a 3 POS POS 21.6 19.1 18.5 + + n/a n/a 4 POS POS 22.6 20.8 19.8 + + n/a n/a 5 POS POS 22.9 21.6 21.0 + + n/a n/a 6 POS POS 23.7 20.6 20.6 + + n/a n/a 7 NEG* POS 24.3 21.4 20.4 + + n/a n/a 8 NEG* POS 25.3 22.0 21.3 No cpe n/a n/a n/a 9 NEG* POS 26.0 23.7 23.0 + + n/a n/a 10 NEG* NEG 36.1 31.5 32.7 No cpe n/a n/a n/a 11 NEG POS - No cpe No No No 12 NEG POS 39.2 No cpe No No No 13 NEG POS 35.2 No cpe No No No 14 NEG NEG 34.6 No cpe No No No 15 NEG POS 35.4 No cpe No No No 16 NEG POS 36.2 No cpe No No No 17 POS POS 35.8 No cpe No No No 18 POS POS 34.5 No cpe No No No 19 NEG POS 35.1 No cpe No No No 20 POS POS 30.0 No cpe No No No 21 POS POS 32.3 No cpe No No No 22 NEG POS 34.6 No cpe No No No 23 POS POS 31.3 No cpe No No No 24 NEG POS 30.3 No cpe No No No 25 NEG POS 30.0 No cpe No No No 26 NEG POS 31.5 No cpe No No No 27 NEG POS 30.7 + No No No 28 POS POS 29.9 No cpe No No No 29 POS POS 29.4 No cpe No No No 30 NEG*2 POS 28.2 + Yes No No 240 Table 5: Viral culture of positive VTM from oro/pharyngeal swabs and assay results. Original sample result was 241 generated from Genesig RDRP assay at time of diagnosis. *Previously un-optimised method without lysis 242 buffer. *2 – precipitate observed in lysis mix.

243

244

Page 13 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

245 Performance of RT-LAMP across viral load groups

246

247

Page 14 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

248

249 Figure 2: Performance of the RNA RT-LAMP and Direct RT-LAMP assays on both saliva and swab samples 250 according to viral load groupings.

Page 15 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

251 The sensitivity of the RNA and Direct RT-LAMP assays across viral load groups is shown in Figure 2.

252 For RNA RT-LAMP, samples which were positive by RT-qPCR containing >105 copies/ml were

253 consistently identified as positive with no samples returning a negative result. Below this copy

254 number, sensitivity is reduced for both saliva and swab samples, reaching ~60% in swab samples

255 exclusively with viral loads <103 copies/ml, and an approximately linear drop in sensitivity from 100%

256 to 0% between viral loads of 105 and 103 copies/ml respectively in saliva samples. For Direct RT-

257 LAMP, all but one saliva sample were detected above 106 copies/ml. On swab samples, sensitivity is

258 reduced on samples containing below <105 copies/ml, dropping from 85% at viral loads of 105–106

259 copies/ml, to 30% in the 104–105range. On saliva samples, sensitivity is reduced in the 104–105 range

260 to a sensitivity of 80% but then reduces further within the 103–104 range, to 30%.

261

262

263

264

265

266

267

268

269

270

271

272

Page 16 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

273 Site meta-analysis

274

Page 17 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

275

276

Page 18 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

277

Page 19 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

278

Page 20 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

279 Figure 3: Forest plots for each method and sample type showing site heterogeneity in sensitivity and specificity, 280 with overall estimates and the resulting expected sensitivity and specificity retrieved from each respective 281 bivariate random effects model.

282

283 Site-level confusion matrices, sensitivity, and specificity per method and sample type in Figure 3.

284 Heterogeneity between sites for the specificity was minimal for all combinations of method and

285 sample type, with the random effects model matching the overall aggregated sample calculation. For

286 sensitivity, heterogeneity was minimal between sites for RNA RT-LAMP. However, for Direct RT-

2 287 LAMP, sensitivity showed significant overall heterogeneity (bivariate model variance: 𝜎푠푒 = 1.817

2 288 on saliva samples; 𝜎푠푒 = 0.228 on swab samples). Between-site variations in the viral load of the

289 samples tested contributed a minority of the heterogeneity, but sensitivity was consistently high in

290 samples with higher viral loads (i.e., >106 copies/ml, as shown in Figure 2), while being more

291 heterogeneous between sites in samples with lower viral loads. Sensitivity at lower viral loads was

292 highest in the sites with the most established testing programmes.

293

Page 21 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

294 Discussion

295 Testing of human populations for SARS-CoV-2 nucleic acid has been hampered by both logistical

296 (e.g., swab availability) and physical (e.g., discomfort from repeat swab testing) constraints. The aim

297 of this study was to evaluate an optimised sample preparation method, building upon previously

298 published methods for the extraction-free detection of SARS-CoV-2 by RT-LAMP primarily from

299 saliva(4,11). Collection of saliva is non-invasive and does not require a trained individual or specialist

300 consumables for collection of a quality sample. Utilising a non-invasive sampling method should

301 open testing to more individuals who dislike or are unable to tolerate having a

302 nasopharyngeal/oropharyngeal swab taken. The salivary glands are reported to be early targets of

303 SARS-CoV-2 infection(16),(17), and studies have demonstrated the detection of high viral loads of

304 SARS-CoV-2 from saliva, similar to those observed from nasopharyngeal/oropharyngeal

305 swabs(5,7,18),(19). Additionally, several studies have demonstrated that SARS-CoV-2 viral RNA could

306 be detected from saliva for a similar duration post onset of clinical signs when compared to

307 combined naso/oropharyngeal swabs(20–22), highlighting saliva as a valuable tool for SARS-CoV-2

308 detection.

309 Direct detection negates the requirement for RNA extraction(23),(24), for which there has previously

310 been competition for reagents and often requires expensive extraction equipment including liquid

311 handling automation. This extraction-free method decreases turnaround time from sample

312 collection to result. The Direct RT-LAMP method is straight forward and rapid, allowing the test to be

313 performed in a wide range of settings, including near-patient hospital laboratories and pop-up or

314 mobile laboratories. However, previously evaluated extraction-free sample preparation methods

315 using RT-LAMP from saliva samples have demonstrated reduced sensitivity(4,11), likely due to the

316 inhibitory factors found within saliva that may affect molecular tests such as RT-LAMP and RT-

317 qPCR(25,26). The simple sample preparation method evaluated in the study aimed to improve upon

318 these methods by utilising the addition of a novel proprietary reagent, RapiLyze©, designed to

Page 22 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

319 neutralize common sample inhibitors. A subsequent heat step of 98oC for two minutes prior to

320 addition to the RT-LAMP master mix renders SARS-CoV-2 inactive as confirmed by infectivity analysis

321 using live virus inactivation studies (See supplementary 2). Downstream steps are then able to

322 proceed outside of traditional containment level laboratory settings broadening its clinical utility.

323 Our study utilised high numbers of combined naso/oropharyngeal swabs (n= 559) and saliva samples

324 (n = 86,760) for the evaluation of this novel sample preparation method in combination with the

325 Direct RT-LAMP assay. RNA RT-LAMP was also performed on >25,000 samples for comparison,

326 providing updated values for the performance of the assay reported previuosly(4,11,27). Correlation

327 between CT value and sample viral copy number has been demonstrated within this and other

328 studies, with lower CT values CT (< 25 and < 33) indicating a higher probability that the sample

329 contains recoverable active virus, and consequently the likelihood that the individual may be

330 infectious to others4,25,(28–31). As a result, the RNA and Direct RT-LAMP assays were compared with

331 RT-qPCR results in groups with three different CT cut-off values: <45, <33 and <25. This was

332 completed so that the performance of the assays in different clinical scenarios (use case) could be

333 determined: (i) CT <45: does the RT-LAMP assay (either RNA or Direct) compare with RT-qPCR for all

334 reportable CT values?; (ii) CT <33: can the RT-LAMP assay detect those individuals that have a

335 medium-high levels of viral RNA in their specimens, with an ORF1ab target being analogous with

336 viral copy number because it is exclusively a genomic target(14); and (iii) CT <25: can the RT-LAMP

337 assay detect those individuals that have a high level of viral RNA in their specimens?

338 In our study, diagnostic sensitivity for RNA RT-LAMP on swab and saliva samples was improved when

339 compared to a previous report utilising this method (Fowler et al., 2020), with values of >96% and

340 >80%, respectively when considering all CT values, and 100% for both sample types when considering

341 CT <25 with these samples having a high probability of containing replicating virus for over 24,000

342 samples tested. Direct RT-LAMP sensitivity on swab samples was also improved from the previous

343 method with 100% sensitivity for CT <25, 77.78% for CT <33 and 70.35% for CT <45 across 559 samples

Page 23 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

344 used for this evaluation. In contrast, sensitivity for Direct RT-LAMP on saliva was in general higher

345 than that determined for swabs (CT <33 = 87.61%, CT <45 = 84.62%), apart from the group with CT

346 values below <25, which had a reported sensitivity of 99.01%. These results support previous reports

347 which demonstrate comparable performance when comparing paired swabs and saliva

348 samples(32,33), and that one sample type is not superior to the other. Interestingly, the diagnostic

349 sensitivity for RNA and Direct RT-LAMP for saliva samples was almost equivalent (80.65% and

350 84.62%, respectively) suggesting that RNA extraction may not even be required when performing

351 testing on saliva samples.

352 Previous studies have described the importance of identifying asymptomatic individuals, particularly

353 those with high viral loads(34–37). The ability of the Direct RT-LAMP assay to reliably detect

354 individuals with medium-high viral loads in a simple to collect, non-invasive sampling process

355 highlights the suitability of this assay for both symptomatic and asymptomatic population screening.

356 This is particularly important in healthcare and care home staff where the use of asymptomatic

357 COVID-19 screening would reduce the risk of onward transmission of SARS-CoV-2, consequently

358 maintaining NHS capacity and Social Care capacity and more importantly, reducing the risk to

359 vulnerable individuals present within those environments(27).

360 It is important to note that when designing surveillance strategies for asymptomatic infection testing

361 as an intervention to reduce transmission, frequency of testing and result turnaround time may be

362 considered more significant than diagnostic sensitivity(38). ‘Gold standard’ tests with high sensitivity

363 such as RT-qPCR generally need to be performed in centralised testing facilities, often resulting in

364 increased reporting times, leading to a less effective control of viral transmission(38). In contrast,

365 point of care tests such as Lateral flow tests (LFT)(39) or those requiring only a basic/mobile

366 laboratory set-up such as Direct RT-LAMP, which have the ability to produce rapid results, can be

367 performed frequently e.g., daily or multiple times per week. Consequently, the likelihood of

368 sampling an individual when their viral load is highest as seen in the early, often pre-symptomatic

Page 24 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

369 stages of infection increases, maximising the probability of rapidly detecting infectious cases,

370 allowing prompt isolation. In this use case sampling and testing frequency using a rapid assay with

371 suitable accuracy in detection of medium-high viral loads, but not necessarily optimal sensitivity over

372 the whole range including low to very low viral loads, is desirable or necessary(38,40). Frequent on-

373 site testing of asymptomatic NHS healthcare workers using Direct RT-LAMP has been successfully

374 implemented in the pilot study described here; and continues to be utilised. Direct-RT-LAMP has also

375 been used in a mass community based pilot in school and higher education settings(27), to identify

376 those individuals who may have been missed when surveillance relies only on symptomatic

377 individuals coming forward for testing. With the use of mobile or pop-up laboratories, Direct RT-

378 LAMP could also be used for risk-based mass testing, for example, targeting specific geographical

379 areas or vulnerable groups. The potential also exists for lyophilisation of the Direct RT-LAMP

380 reagents reported in other studies(41,42), which would minimise the necessity for trained personnel

381 by reducing pipetting steps and the requirement for a cold chain, allowing greater capacity of the

382 assay in multi-use case scenarios including point-of-care and in low- and middle-income countries

383 (LMICs).

384 Several experiments typical of a diagnostic performance evaluation were not performed as part of

385 this study, as they had been performed and reported previously. This included both analytical

386 specificity, which when tested against a panel of respiratory pathogens causing indistinguishable

387 clinical signs to COVID-19, demonstrated a high level of analytical specificity (100% in this case)(4)

388 and analytical sensitivity of the Direct RT-LAMP, which is reported to detect 1000 cp/ml(4,27,32).

389 Additionally, the RNA and Direct RT-LAMP assays evaluated as part of this study have been shown to

390 reliably detect the emerging variants of concern (VOC) including the B.1.1.7 alpha variant, the

391 501Y.V2 beta variant, the P1 gamma variant and the new rapidly spreading B.1.617.2 delta

392 variant(43–45). The emergence of further VOC could lead to a criticism of the RT-LAMP assay due its

393 reliance on a single target, ORF1ab, where mutations in the target region in a sample could lead to

394 false negatives. For RT-qPCR this has been observed during the current pandemic (46–48) where at

Page 25 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

395 least a dual target assay is recommended(49). However, this is less likely to occur for the RT-LAMP

396 assay used in this pilot evaluation. Firstly, due to the multiple sets of primer pairs utilised, 3 pairs

397 with two pairs within the target region. This builds in redundancy to mutation not unlike a duplex

398 RT-qPCR. Secondly, the ORF1ab region is highly conserved and crucial for viral replication and fitness

399 in SARS-CoV-2. As a result, these regions are well maintained using a proofreading system via the

400 nsp14 protein(50) resulting in a more stable genome compared to many other RNA viruses.

401 The authors highlight the importance of incorporating an inhibition control into the next iteration of

402 the RT-LAMP assays. Although, the paired RT-LAMP and RT-qPCR data from this study show a good

403 correlation and any false negative results were likely due to the analytical sensitivity of the RT-LAMP

404 assay, not sample driven inhibition. To this end, a control primer set by OptiGene Ltd was evaluated

405 (PS-0010), targeting the human ribosomal protein LO gene. Preliminary analysis of the inhibition

406 control primers showed consistent detection across 279 saliva and 381 combined

407 naso/oropharyngeal swab samples using both RNA and Direct RT-LAMP (Supplement 1).

408 Incorporation of this inhibition control into the RT-LAMP assays would alleviate a potential limitation

409 of the current assays and further support quality assurance for use within a clinical diagnostic

410 setting.

411 This study demonstrated high sensitivity and specificity for a novel sample preparation method used

412 for SARS-CoV-2 Direct RT-LAMP, particularly in samples from which the individual would likely be

413 considered infectious, highlighting the usefulness of saliva as a simple to collect, non-invasive sample

414 type. The highly sensitive RNA RT-LAMP assay provides a rapid alternative with a reliance on

415 differing reagents and equipment to RT-qPCR testing, thus providing additional diagnostic capacity

416 and redundancy through diversity. Direct RT-LAMP may complement existing surveillance tools for

417 SARS-CoV-2 testing including other point-of-care and laboratory-based diagnostics and is applicable

418 to a variety of clinical scenarios, such as frequent, interval-based testing of asymptomatic individuals

419 that may be missed when reliance is on symptomatic testing alone. However, care should be taken

Page 26 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

420 when considering frequency of testing, messaging around the role and interpretation of

421 asymptomatic rapid tests, integration of data storage and access, and the challenges faced when

422 scaling up surveillance to large populations.

423 The role out of a new testing strategy can often throw up interesting and unexpected experiences.

424 These collective experiences and lessons learnt from setting up an NHS asymptomatic staff testing

425 programme using Direct RT-LAMP will be shared in a future publication.

426

427 Methods

428 Testing sites

429 The OptiGene Ltd. SARS-CoV-2 RT-LAMP assay was evaluated in nine sites, comprising Basingstoke

430 and North Hampshire Hospital & Royal Hampshire County Hospital, Hampshire Hospitals NHS

431 Foundation Trust; University Hospital Southampton; Animal and Plant Health Agency/MRC

432 Lifecourse Epidemiology Unit (University of Southampton); Public Health Lab Manchester/CMFT;

433 Leeds Teaching Hospitals NHS Trust; University Hospitals Birmingham NHS Foundation

434 Trust/Institute of Cancer & Genomic Science University of Birmingham; High Containment

435 Microbiology, National Infection Service, Public Health England, Porton Down and Public Health

436 University Laboratory, Gibraltar Health Authority, Gibraltar, UK.

437 Clinical samples

438 Nasopharyngeal and oropharyngeal swabs were collected from asymptomatic and symptomatic

439 individuals and placed in viral transport media (VTM).

440 Drooled saliva samples were collected at the start of the day; prior to eating, drinking, teeth

441 brushing, or using a mouthwash. Saliva was transferred into the specimen pot directly or via a clean

442 teaspoon, according to a standardised protocol. Samples from UHB deposited saliva straight into the

443 collection pot.

Page 27 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

444 RNA extraction

445 RNA was extracted using a range of different methods available at each participating site:

446 Maxwell® RSC Viral Total Nucleic Acid Purification Kit

447 In a class 1 microbiological safety cabinet (MSC) within a containment level 3 laboratory, 200 µl of

448 sample was added to 223 µl of prepared lysis solution (including 5 µl per reaction of Genesig® Easy

449 RNA Internal extraction control, Primerdesign Ltd, Chandler's Ford, UK). Samples were then

450 inactivated for 10 minutes at room temperature within the MSC and 10 minutes at 56oC on a heat

451 block before automated RNA extraction using a Maxwell® RSC48 Instrument (Promega UK Ltd.,

452 Southampton, UK). RNA was eluted in 50 µl of nuclease-free water (NFW).

453 MagMAX™CORE Nucleic acid 140 purification kit

454 10 µl of sample (diluted in 190µl DEPC treated water) was added to 700 µl of prepared lysis solution.

455 Samples were then inactivated for 10 minutes at room temperature within the safety cabinet before

456 automated RNA extraction using a Kingfisher Flex (Thermofisher). RNA was eluted in 90 µl of NFW.

457 Roche FLOW system

458 RNA extraction was carried out on a MagNA Pure 96 (MP96) extraction robot using the MagNA Pure

459 96 DNA and Viral Nucleic Acid Small Volume kit (Roche) and the Pathogen 200 universal protocol

460 v4.0.

461 Qiagen QIAsymphony

462 RNA extraction was carried out using the QIASymphony Virus/Bacteria Mini Kit (Qiagen) by the

463 CellFree200 Default IC protocol with a 60 µl extract elution volume.

464

465

466

Page 28 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

467 SARS-CoV-2 Real-Time RT-qPCR

468 RNA was analysed using a range of different methods available at each site:

469 CerTest VIASURE SARS-CoV-2 real time qPCR assay

470 Single step RT-qPCR against the ORF1ab region and N1 gene target of SARS-CoV-2 was carried out

471 using the CerTest VIASURE SARS-CoV-2 real time PCR kit (CerTest Biotech SL, Zaragoza, Spain)

472 according to manufacturer’s instructions for use (IFU) on either the ThermoFisher QuantStudio 5 or

473 BioMolecular Systems MIC instruments, using 5 µl of extracted RNA per reaction. RNA extracted

474 using the Maxwell® RSC Viral Total Nucleic Acid Purification Kit was analysed using this assay.

475 COVID-19 genesig® Real-Time qPCR assay

476 Single step RT-qPCR against the ORF1ab region of SARS-CoV-2 was carried out using the COVID-19

477 genesig® Real-Time PCR assay real time PCR assay (Primerdesign Ltd, Chandler's Ford, UK) according

478 to manufacturer’s instructions for use (IFU) on BioMolecular Systems MIC instruments, using 5 µl of

479 extracted RNA per reaction. RNA extracted using the Maxwell® RSC Viral Total Nucleic Acid

480 Purification Kit was analysed using this assay.

481 Corman et al. Real-Time qPCR assay

482 Single step RT-qPCR against the E gene target of SARS-CoV-2 was carried out with the Corman et al.

483 (3) primers using the AgPath-ID™ PCR kit (Thermofisher) according to manufacturer’s instructions for

484 use (IFU) on an Aria qPCR Cycler (Agilent) and results analysed using the Agilent AriaMX 1.5

485 software, using 5 µl of extracted RNA per reaction. RNA extracted using the MagMAX™CORE Nucleic

486 acid purification kit were analysed using this assay.

487 RT-qPCR was carried out on an Applied Biosystems Fast 7500 PCR thermocycler in standard run

488 mode using the SARS-CoV-2 E gene Sarbeco assay using MS2 as an internal extraction control and

489 aliquots of SARS-CoV-2/England/2/2020 as a positive control. The master mix comprised E- gene F

490 and R primers and TM-P (400 nM, 400 nM and 200 nM final concentration respectively), MS2

Page 29 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

491 primers and TM probe (20 nM, 20 nM and 40 nM final concentration respectively), 4 x TaqMan® Fast

492 Virus 1-Step Master Mix made up with molecular-grade nuclease free water (Ambion) to a final

493 volume of 15 μl. 5 μl of AVE buffer extract was used at a template and added to the 15 μl mastermix.

494 Cycling conditions were 55°C for 10 min, followed by 94°C for 3 min and 45 cycles of 95°C for 15 s

495 and 58°C for 30 s.

496 SARS-CoV-2 (2019-nCoV) CDC qPCR Probe Assay

497 Single step RT-qPCR against the N1 and N2 gene targets of SARS-CoV-2 was carried out using

498 integrated design technologies kit (IDT; Catalogue number: 10006606) according to manufacturer’s

499 instructions for use (IFU) on either a LC480 II or ABI 7500 FAST instrument. RNA extracted on Qiagen

500 QIAsymphony and the Roche FLOW system were analysed using this RT-qPCR assay.

501

502 RT-LAMP

503 RT-LAMP assays were performed using OptiGene Ltd. (Horsham, UK) COVID-19_RT-LAMP kits, as

504 described previously(4), with the following modifications. The COVID-19_RNA RT-LAMP KIT-500 kit

505 was used for RNA RT-LAMP and the COVID-19_Direct PLUS RT-LAMP KIT-500 was used for Direct RT-

506 LAMP directly on oropharyngeal/nasopharyngeal swabs or saliva samples. The COVID-19_Direct

507 PLUS RT-LAMP KIT-500 kit also includes a sample preparation buffer, RapiLyze. For RNA RT-LAMP 5

508 μl of extracted RNA was added to the reaction. For the Direct PLUS RT-LAMP, 50 µl sample (swab

509 VTM or neat saliva) was added to 50 µl RapiLyze, vortexed and placed in a dry heat block pre-heated

510 to 98oC for 2 mins. 5 μl of the treated sample was added to each reaction.

511 The anneal temperature (Ta) that confirmed a positive result for Direct RT-LAMP was modified to

512 81.5oC and 85.99oC because of the effect of RapiLyze buffer on the reaction.

513

514

Page 30 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

515 SARS-CoV-2 viral culture of clinical samples across a CT range

516 For culture 100 µl and 100 µl of a 1 in 10 dilution of the first 10 samples (with predicted lower CT

517 values) and 100 µl from the second twenty samples (with higher predicted CT values) were added to

518 a 25 cm2 flasks containing 80% confluent Vero E6 cells and allowed to adsorb for 1 hour. Five ml of

519 Minimum Essential Medium (MEM) (Gibco) + HEPES (Gibco) + 4% foetal calf serum FCS (Sigma) + 1 x

520 antibiotic-antimycotic (Gibco) was added to each flask and incubated for 1 week at 37oC. Two

521 negative control flasks to which 100 µl MEM + 4% FCS was added in place of sample, were set up in

522 parallel. Cultures were checked visually for cytopathic effect (cpe). Where cpe was not observed

523 after 1 week, 500 µl of supernatant was passed into a fresh flask containing Vero E6 cells for a

524 further two passages. At the beginning and end of each passage 140 µl of supernatant was collected

525 for SARS-CoV-2 RT-qPCR as described before.

526 To determine the sensitivity of isolation method for SARS-CoV-2 from clinical samples, a virus stock

527 titred by plaque assay (HCM/V/53), a P3 working bank grown from SARS-CoV-2 Strain England 2,

528 from Public Health England, was diluted in MEM to give virus dilutions containing 1000 pfu to 0.01

529 pfu. Virus isolation was performed as above in duplicate. After 72 hours of incubation flasks were

530 checked for cpe, and for those where cpe was observed the supernatant was collected for RT-qPCR.

531 Any flasks not showing cpe after 7 days were passed on to fresh cells and resampled as described

532 above.

533

534 Data analysis

535 Overall diagnostic sensitivity and specificity (including 95% Clopper-Pearson confidence intervals)

536 were calculated by the aggregation of individual site data for each method (RNA and Direct RT-

537 LAMP) for each sample type (swabs and saliva). To demonstrate the effectiveness of detecting

Page 31 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

538 samples with higher viral load, confusion matrices are quoted where the threshold for positive

539 sample inclusion varies, i.e., for CT <25, only positive samples with CT <25 are included.

540 To account for site heterogeneity, a bivariate meta-analysis model is additionally applied at the site

541 level to produce a summary sensitivity and specificity for each method and sample type(12). Within-

542 study variability for sensitivity 𝜌푠푒,푖 and specificity 𝜌푠푒,푖 are assumed to follow independent binomial

543 distributions

544 푥푠푒,푖 ~ 퐵(푛푠푒,푖, 𝜌푠푒,푖) , 푥푠푝,푖 ~ 퐵(푛푠푝,푖, 𝜌푠푝,푖)

545 where 푥푠푒,푖, 푥푠푝,푖 represent the number testing positive for site 푖 respectively, and 푛푠푒,푖, 푛푠푝,푖

546 represent the number testing positive and negative by RT-qPCR for site 푖 respectively. The between-

547 study heterogeneity is represented by a bivariate normal distribution for the logit-transformed

548 sensitivity 휇푠푒,푖 and specificity 휇푠푝,푖

2 휇푠푒,푖 휇푠푒 𝜎푠푒 𝜎푠푒,푠푝 549 ( ) ~ 푁 (( ) , ( 2 )) 휇푠푝,푖 휇푠푝 𝜎푠푒,푠푝 𝜎푠푝

2 2 550 where 휇푠푒, 휇푠푝 represent the expected logit sensitivity and specificity, 𝜎푠푒,𝜎푠푝 represent the

551 between-study variance in the logit sensitivity and specificity, and 𝜎푠푒,푠푝 represents the covariance

552 between the logit sensitivity and specificity. For Direct RT-LAMP, we fit a univariate normal

553 distribution for the logit-transformed sensitivity only due to the absence of false positives across all

554 sites.

555 In addition, the sensitivity as a function of viral load was assessed for RNA RT-LAMP and Direct RT-

556 LAMP on both swab and saliva samples. This was performed through the conversion of each sample

557 CT value to viral load in gene copies/ml for all sample sets. As the relationship between CT value and

558 viral load varied according to the RT-qPCR method used; a dilution series was utilised for each

559 method to standardise these values for two of the four aforementioned RT-qPCR methods (CerTest

560 VIASURE SARS-CoV-2 real time PCR kit, and Corman et al RT-qPCR assay E gene), which was used for

Page 32 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

561 testing 100% of the swab samples, 90% of the saliva samples used for Direct RT-LAMP, and 83% of

562 the saliva samples used for RNA RT-LAMP. The logarithm of the viral load was then fitted to the CT

563 values for both methods using linear regression followed by converting the CT values to viral load

564 based on which method had been used to evaluate the samples. For the remaining samples (n= 56)

565 that utilised one of the other two RT-qPCR methods for which viral load was not standardised

566 against a CT value, the conversion derived from the CerTest VIASURE SARS-CoV-2 real time PCR kit

567 dilution series was applied, the assumption that the N gene CT values are the most similar(13–15).

568 For the CerTest VIASURE SARS-CoV-2 real time PCR kit, the following relationship between log viral

569 load and CT value was applied:

570 log10 푉 = (45.257 − 퐶푇) / 3.523

571 and similarly, for the Corman et al RT-qPCR assay:

572 log10 푉 = (45.806 − 퐶푇) / 3.717

573 where 푉 represents the viral load in copies/ml.

574 Viral load was grouped according to the following categories (in copies/ml): <103, 103-104, 104-105,

575 105-106, 106-107 and >107 then the diagnostic sensitivity was calculated according to viral load group

576 with associated Clopper-Pearson 95% confidence intervals.

577 The site meta-analysis was produced using R 3.5.3. Confusion matrices, sensitivity, specificity,

578 sensitivity as a function of viral load calculations, and the production of scatter graphs showing the

579 relationship between RT-LAMP results and CT were performed using Python 3.8.6.

580

581

582

583

Page 33 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

584 Ethical statement

585 We confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics

586 committee approvals have been obtained. National Research Ethics Service Committee West

587 Midlands - South Birmingham 2002/201 Amendment Number 4. All necessary written participant

588 consent has been obtained and the appropriate institutional forms have been archived.

589

590 Funding

591 This work was partially funded by a Department of Health and Social Care award to the University of

592 Southampton (Grant Reference Number 2020/032 (Feasibility study for city-wide testing using saliva

593 315 based LAMP testing)). The views expressed are those of the authors and not necessarily those of

594 the Department of Health and Social Care. KMG is supported by the UK Medical Research Council

595 (MC_UU_12011/4), the National Institute for Health Research (NIHR Senior Investigator (NF-SI-0515-

596 318 10042) and NIHR Southampton Biomedical Research Centre (IS-BRC-1215-20004)) and the

597 British Heart Foundation (RG/15/17/3174). For part of this project, Emma Howson was on

598 secondment at GeneSys Biotech Ltd., which was part funded by The Pirbright Institute Flexible

599 Talent Mobility Account (FTMA) under BBSRC grant BB/S507945/1. ADB is currently supported by a

600 Cancer Research UK Advanced Clinician Scientist award (C31641/A23923) and his laboratory is

601 supported by CRUK Centre Birmingham (C17422/A25154) and the Birmingham Experimental Cancer

602 Medicine Centre (C11497/A25127). Veronica Fowler, Stephen Kidd, Bryony Armson and Zandra

603 Deans were on secondment to the Department of Health and Social Care for a period during this

604 study. APHA laboratory activities and expertise was supported by both the Safe and Certain project

605 APHACSKL0085 and Defra project APHANSOM0416.

606

Page 34 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

607 Author contributions

608 Conceptualization, SPK, ADB, AW, AR, MA, NM, DP, ZD, NJC, KMG, AD, SLH, VLF; Data Curation, SPK,

609 DB, BA, ELAH, VLF; Formal Analysis SPK, DB, VLF; Investigation, SPK, BA, ADB, ELAH, AW, GS, ELW,AG,

610 ZVM, SG, JS, CC, TL, SMR, SR, JJ, PS, AB, KD, AP, CW, JF, CB, CP,AB, MK, AR, JB, HL, SF,CT, AS, HP,

611 NaM, SL, CW, RH, JP, JSJ, IB, DP, NJC, KMG, VLF; Methodology SPK, BA, ELAH, JS, CC, AB, IB, NJC, VLF;

612 Writing – Original Draft Preparation SPK, DB, AW, KMG, VLF; Writing – Review & Editing, all authors

613 contributed to critical review and editing.

614

Page 35 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

615 References 616 1. Zhang J jin, Dong X, Cao Y yuan, Yuan Y dong, Yang Y bin, Yan Y qin, et al. Clinical 617 characteristics of 140 patients infected with SARS-CoV-2 in Wuhan, China. Allergy Eur J 618 Allergy Clin Immunol. 2020;75(7):1730–41. 619 2. Johns Hopkins Coronavirus Resource Centre [Internet]. [cited 2021 Apr 19]. Available from: 620 https://coronavirus.jhu.edu/ 621 3. Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW, et al. Detection of 2019 622 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance. 2020;25(3):23–30. 623 4. Fowler VL, Armson B, Gonzales JL, Wise EL, Howson ELA, Vincent-Mistiaen Z, et al. A highly 624 effective reverse-transcription loop-mediated isothermal amplification (RT-LAMP) assay for 625 the rapid detection of SARS-CoV-2 infection. J Infect [Internet]. 2020;82(1):117–25. Available 626 from: https://doi.org/10.1016/j.jinf.2020.10.039 627 5. Zhu J, Guo J, Xu Y, Chen X. Viral dynamics of SARS-CoV-2 in saliva from infected patients. J 628 Infect. 2020;81(3):e48–50. 629 6. Ott IM, Strine MS, Watkins AE, Boot M, Kalinich CC, Harden CA, et al. Simply saliva: stability of 630 SARS-CoV-2 detection negates the need for expensive collection devices. medRxiv : the 631 preprint server for health sciences. 2020. 632 7. Azzi L, Baj A, Alberio T, Lualdi M, Veronesi G, Carcano G, et al. Rapid Salivary Test suitable for 633 a mass screening program to detect SARS-CoV-2: A diagnostic accuracy study. J Clean Prod. 634 2020;81. 635 8. Wei S, Suryawanshi H, Djandji A, Kohl E, Morgan S, Hod EA, et al. Field-deployable, rapid 636 diagnostic testing of saliva for SARS-CoV-2 [Internet]. Vol. 11, Scientific reports. Columbia 637 University Irving Medical Center, New York, NY, USA.; 2021. p. 5448. Available from: 638 http://europepmc.org/abstract/MED/33750853 639 9. Sri Santosh T, Parmar R, Anand H, Srikanth K, Saritha M. A Review of Salivary Diagnostics and 640 Its Potential Implication in Detection of Covid-19. Cureus. 2020;12(4). 641 10. Beaumont A, Raillon L, Ader F, Chatenoud L, Hueso T. Evaluation of different sample 642 treatments options in a simple and safe procedure for the detection of SARS-COV-2 in saliva. 643 2020;(January). 644 11. Howson ELA, Kidd SP, Armson B, Goring A, Sawyer J, Cassar C, et al. Preliminary optimisation 645 of a simplified sample preparation method to permit direct detection of SARS-CoV-2 within 646 saliva samples using reverse-transcription loop-mediated isothermal amplification (RT-LAMP). 647 J Virol Methods. 2021;289. 648 12. Reitsma JB, Glas AS, Rutjes AWS, Scholten RJPM, Bossuyt PM, Zwinderman AH. Bivariate 649 analysis of sensitivity and specificity produces informative summary measures in diagnostic 650 reviews. J Clin Epidemiol. 2005 Oct;58(10):982–90. 651 13. Bhargava A. Dynamic aspects of ORF1ab and N RNA cycle threshold values among COVID-19 652 patients in China. Infect Genet Evol [Internet]. 2021;87:104657. Available from: 653 https://www.sciencedirect.com/science/article/pii/S1567134820304883 654 14. Alexandersen S, Chamings A, Bhatta TR. SARS-CoV-2 genomic and subgenomic RNAs in 655 diagnostic samples are not an indicator of active replication. Nat Commun [Internet]. 656 2020;11(1):6059. Available from: https://doi.org/10.1038/s41467-020-19883-7 657 15. Xu T, Chen C, Zhu Z, Cui M, Chen C, Dai H, et al. Clinical features and dynamics of viral load in

Page 36 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

658 imported and non-imported patients with COVID-19. Int J Infect Dis IJID Off Publ Int Soc 659 Infect Dis. 2020 May;94:68–71. 660 16. Liu L, Wei Q, Alvarez X, Wang H, Du Y, Zhu H, et al. Epithelial Cells Lining Salivary Gland Ducts 661 Are Early Target Cells of Severe Acute Respiratory Syndrome Coronavirus Infection in the 662 Upper Respiratory Tracts of Rhesus Macaques. J Virol. 2011;85(8):4025–30. 663 17. Huang N, Pérez P, Kato T, Mikami Y, Okuda K, Gilmore RC, et al. SARS-CoV-2 infection of the 664 oral cavity and saliva. Nat Med. 2021 Mar; 665 18. To KKW, Tsang OTY, Leung WS, Tam AR, Wu TC, Lung DC, et al. Temporal profiles of viral load 666 in posterior oropharyngeal saliva samples and serum antibody responses during infection by 667 SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20(5):565–74. 668 19. Tan SH, Allicock O, Armstrong-Hough M, Wyllie AL. Saliva as a gold-standard sample for SARS- 669 CoV-2 detection. Lancet Respir Med [Internet]. 2021;2600(21):19–21. Available from: 670 http://www.ncbi.nlm.nih.gov/pubmed/33887248 671 20. Uwamino Y, Nagata M, Aoki W, Fujimori Y, Nakagawa T, Yokota H, et al. Accuracy and stability 672 of saliva as a sample for reverse transcription PCR detection of SARS-CoV-2. J Clin Pathol. 673 2021;74(1):67–8. 674 21. Wyllie AL, Fournier J, Casanovas-Massana A, Campbell M, Tokuyama M, Vijayakumar P, et al. 675 Saliva or Nasopharyngeal Swab Specimens for Detection of SARS-CoV-2. The New England 676 journal of medicine. 2020. 677 22. Vogels CBF, Watkins AE, Harden CA, Brackney DE, Shafer J, Wang J, et al. SalivaDirect: A 678 Simplified and Flexible Platform to Enhance SARS-CoV-2 Testing Capacity. Med. 2020;1–18. 679 23. Buck MD, Poirier EZ, Cardoso A, Frederico B, Canton J, Barrell S, et al. SARS-CoV-2 detection 680 by a clinical diagnostic RT-LAMP assay. Wellcome Open Res. 2021;6:9. 681 24. Kellner MJ, Matl M, Ross JJ, Schnabl J, Handler D, Heinen R, et al. Head-to-head comparison 682 of direct-input RT-PCR and RT-LAMP against RT-qPCR on extracted RNA for rapid SARS-CoV-2 683 diagnostics. medRxiv [Internet]. 2021;2021.01.19.21250079. Available from: 684 https://doi.org/10.1101/2021.01.19.21250079 685 25. Ochert AS, Boulter AW, Birnbaum W, Johnson NW, Teo CG. Inhibitory effect of salivary fluids 686 on PCR: Potency and removal. PCR Methods Appl. 1994;3(6):365–8. 687 26. Wilson IG. Inhibition and facilitation of nucleic acid amplification. Appl Environ Microbiol. 688 1997;63(10):3741–51. 689 27. DHSC. Rapid evaluation of OptiGene RT-LAMP assay (direct and RNA formats). Department of 690 Health and Social Care. . 2020. 691 28. La Scola B, Le Bideau M, Andreani J, Hoang VT, Grimaldier C, Colson P, et al. Viral RNA load as 692 determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from 693 infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39(6):1059–61. 694 29. Bullard J, Dust K, Funk D, Strong JE, Alexander D, Garnett L, et al. Predicting Infectious Severe 695 Acute Respiratory Syndrome Coronavirus 2 From Diagnostic Samples. Clin Infect Dis. 696 2020;71(10):2663–6. 697 30. Wölfel R, Corman VM, Guggemos W, Seilmaier M, Zange S, Müller MA, et al. Virological 698 assessment of hospitalized patients with COVID-2019. Nature. 2020;581(7809):465–9. 699 31. Marc A, Kerioui M, Blanquart F, Bertrand J, Mitjà O, Corbacho-Monné M, et al. Quantifying

Page 37 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

700 the relationship between SARS-CoV-2 viral load and infectiousness. medRxiv [Internet]. 701 2021;2021.05.07.21256341. Available from: https://doi.org/10.1101/2021.05.07.21256341 702 32. Fowler VL, Douglas A, Godfrey KM, Williams A, Beggs A, Kidd SP, et al. Critical evaluation of 703 the methodology used by Wilson-Davies et al., (2020) entitled “Concerning the Optigene 704 Direct LAMP assay, and it`s use in at-risk groups and hospital staff.” J Infect. 2021; 705 33. Hanson KE, Barker AP, Hillyard DR, Gilmore N, Barrett JW, Orlandi RR, et al. Self-collected 706 anterior nasal and saliva specimens versus healthcare worker-collected nasopharyngeal 707 swabs for the molecular detection of SARS-CoV-2. J Clin Microbiol. 2020;(July):1–5. 708 34. Nikolai LA, Meyer CG, Kremsner PG, Velavan TP. Since January 2020 Elsevier has created a 709 COVID-19 resource centre with free information in English and Mandarin on the novel 710 coronavirus COVID- 19 . The COVID-19 resource centre is hosted on Elsevier Connect , the 711 company ’ s public news and information . 2020;(January). 712 35. Marks M, Millat P, Ouchi D, Roberts C, Alemany A, Corbacho-Monné M, et al. Transmission of 713 COVID-19 in 282 clusters in Catalonia, Spain: A cohort study. medRxiv. 2020;3099(20):1–8. 714 36. Byambasuren O, Cardona M, Bell K, Clark J, McLaws ML, Glasziou P. Estimating the extent of 715 asymptomatic COVID-19 and its potential for community transmission: Systematic review and 716 meta-analysis. J Assoc Med Microbiol Infect Dis Canada. 2020;5(4):223–34. 717 37. Buitrago-Garcia D, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Ipekci AM, et al. 718 Occurrence and transmission potential of asymptomatic and presymptomatic SARSCoV-2 719 : A living systematic review and meta-analysis. PLoS Med. 2020;17(9):1–25. 720 38. Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, et al. Test sensitivity is 721 secondary to frequency and turnaround time for COVID-19 screening. Sci Adv. 2021;7(1):1– 722 11. 723 39. Lee LYW, Rozmanowski S, Pang M, Charlett A, Anderson C, Hughes GJ, et al. An observational 724 study of SARS-CoV-2 infectivity by viral load and demographic factors and the utility lateral 725 flow devices to prevent transmission. Preprint. 726 40. Kissler SM, Fauver JR, Mack C, Tai C, Shiue KY, Kalinich CC, et al. Viral dynamics of SARS-CoV-2 727 infection and the predictive value of repeat testing. medRxiv. 2020;1–13. 728 41. Howson ELA, Armson B, Madi M, Kasanga CJ, Kandusi S, Sallu R, et al. Evaluation of Two 729 Lyophilized Molecular Assays to Rapidly Detect Foot-and-Mouth Disease Virus Directly from 730 Clinical Samples in Field Settings. Transbound Emerg Dis. 2017;64(3):861–71. 731 42. Armson B, Walsh C, Morant N, Fowler VL, Knowles NJ, Clark D. The development of two field- 732 ready reverse transcription loop-mediated isothermal amplification assays for the rapid 733 detection of Seneca Valley virus 1. Transbound Emerg Dis. 2019;66(1):497–504. 734 43. Horby P, Huntley C, Davies N, Edmunds J, Ferguson N, Medley G, et al. NERVTAG note on 735 B.1.1.7 severity. 2021. p. 5–8. 736 44. Tegally H, Wilkinson E, Giovanetti M, Iranzadeh A, Fonseca V, Giandhari J, et al. Emergence 737 and rapid spread of a new severe acute respiratory syndrome-related coronavirus 2 (SARS- 738 CoV-2) lineage with multiple spike mutations in South Africa. medRxiv. 2020;2. 739 45. Public Health England. COVID-19 (SARS-CoV-2) variants [Internet]. 11/06/2021. [cited 2021 740 Jun 17]. Available from: https://www.gov.uk/government/collections/new-sars-cov-2-variant 741 46. Vanaerschot M, Mann SA, Webber JT, Kamm J, Bell SM, Bell J, et al. Identification of a 742 Polymorphism in the N Gene of SARS-CoV-2 That Adversely Impacts Detection by Reverse

Page 38 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

743 Transcription-PCR. Caliendo AM, editor. J Clin Microbiol [Internet]. 2020 Dec 744 17;59(1):e02369-20. Available from: http://jcm.asm.org/content/59/1/e02369-20.abstract 745 47. Hasan MR, Sundararaju S, Manickam C, Mirza F, Al-Hail H, Lorenz S, et al. A Novel Point 746 Mutation in the N Gene of SARS-CoV-2 May Affect the Detection of the Virus by Reverse 747 Transcription-Quantitative PCR. McAdam AJ, editor. J Clin Microbiol [Internet]. 2021 Mar 748 19;59(4):e03278-20. Available from: http://jcm.asm.org/content/59/4/e03278-20.abstract 749 48. Artesi M, Bontems S, Göbbels P, Franckh M, Maes P, Boreux R, et al. A Recurrent Mutation at 750 Position 26340 of SARS-CoV-2 Is Associated with Failure of the E Gene Quantitative Reverse 751 Transcription-PCR Utilized in a Commercial Dual-Target Diagnostic Assay. Caliendo AM, 752 editor. J Clin Microbiol [Internet]. 2020 Sep 22;58(10):e01598-20. Available from: 753 http://jcm.asm.org/content/58/10/e01598-20.abstract 754 49. Wang R, Hozumi Y, Yin C, Wei G-W. Mutations on COVID-19 diagnostic targets. Genomics 755 [Internet]. 2020;112(6):5204–13. Available from: 756 https://www.sciencedirect.com/science/article/pii/S0888754320306546 757 50. Rausch JW, Capoferri AA, Katusiime MG, Patro SC, Kearney MF. Low genetic diversity may be 758 an Achilles heel of SARS-CoV-2. Proc Natl Acad Sci [Internet]. 2020 Oct 6;117(40):24614 LP – 759 24616. Available from: http://www.pnas.org/content/117/40/24614.abstract 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779

Page 39 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

780 Supplementary Information 1

781 Log reduction of SARS-CoV-2 for the heat and lysis steps used independently and sequentially

782

783 We have determined the viral inactivation kinetics of the best sample preparation condition(s), 784 evaluating the effect of the heat and lysis steps on the viral inactivation of SARS-CoV-2 as determined 785 by infectivity assays. All inactivation experiments had to be conducted under Containment Level 3 786 Containment and as such was undertaken at APHA.

787 Heat inactivation experiments were conducted utilising high titre live SARS-CoV-2 virus spiked into 788 pools of saliva collected from APHA staff or in tissue culture supernatant (TCSN). Early experiments 789 demonstrated that saliva had a high toxicity for tissue culture cells, even after heat inactivation 790 demonstrating that toxicity was likely not enzymatic. As such further inactivation was undertaken on 791 live virus TSCN. These heat inactivation experiments demonstrated that SARS-Cov-2 was completely 792 inactivated by heating at 60°C (20 min plus) or ≥70°C (after 2, 5 or 10 min). Importantly optimised 793 RapiLyze Sample Lysis Buffer did not inactivate live virus on its own without a heat step. Further, 794 inactivation at 56°C was not 100% effective at shorter incubation times, and additionally showed a 795 loss in sensitivity following a 4 x 2-fold dilution (See table 2, P07102) at 10 and 30 minutes.

796

P07553 (CT19) 1:2 1:4 1:8 1:16 1:36 1:64 1:128 1:256 1:512 1:1024 1:2048

VTM 1:1 into D D D D D D D D D D D ° Lysis + 98 C D D D D D D D D D D D

56°C 10 mins D D D D D D D D D D ND pre-treat 1:1 VTM into lysis D D D D D D D D D D ND +98°C

56°C 30 mins D D D D D D D ND D ND ND pre-treat 1:1 VTM into lysis D D D D D D D D ND ND ND +98°C

797 Table 1: Serial dilution of Patient VTM (CT 19) 1:1 VTM into Lysis Buffer and 98°C heat treatment without and 798 without heat pre-treatment at 56°C for 10 or 30 minutes. D – RNA Detected, ND – RNA Not Detected, by Direct 799 RT-LAMP.

800

801

Page 40 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

P07553 P01127 P07102 P07392 P01071 Patient VTM (CT 19) (CT 23.97) (CT 32.08) (CT 24.55) (CT 20.54)

D D D D D VTM into 1:1 Lysis + 98°C D D D D D

56°C 30 mins pre-treat D D ND D D ° 1:1 VTM into lysis + 98 C D D ND D D

802 Table 2: Serial dilution of Patient VTM (CT 19.00 to 32.08) 1:1 VTM into Lysis Buffer and 98°C heat treatment 803 without and without heat pre-treatment at 56°C for 10 or 30 minutes. D – RNA Detected, ND – RNA Not 804 Detected, by Direct RT-LAMP.

805

806 Interestingly, following optimisation of heat inactivation of live virus, pre-treatment of samples was 807 assessed to determine any impact of pre-treatment on assay sensitivity. A pre-treatment 70°C for 5 808 mins carried out on spiked samples prior to the proposed direct RT-LAMP assay has no effect on 809 subsequent LAMP or PCR results. Further experiments to test the effect of this pre-treatment on 810 positive patient samples will be carried out to confirm this result. It recommended that even if a pre- 811 treatment is effective in inactivating the virus that downstream processes are carried out in UV 812 hoods or with effective air-flow management to prevent cross contamination of the direct RT-LAMP 813 assay.

814 Comparison of Betapropiolactone (BPL) inactivated virus and live virus have demonstrated that BPL 815 inactivation has resulted in lower sensitivity of detection using direct RT-LAMP. BPL inactivated virus 816 is not an ideal substitute for live virus in spiking experiments. Any conclusions on assay sensitivity or 817 performance have therefore been drawn from experiments on spiking of live virus in TCSN or saliva 818 carried out in containment. Spiking of live virus into pooled saliva has demonstrated that direct

819 detection by RT-LAMP is possible in samples that give a CT below 25/26 with extraction and PCR.

820

821

Page 41 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

822 Supplementary Information 2

823

824 Sensitivity of the viral culture assay – 1 pfu/ml

825

826 The virus was diluted and a set number of pfu of virus (1000, 100, 10, 1 and 0.1) was added to duplicate 827 flasks containing Vero E6 cells and also AVL. Flasks were viewed for cpe. Supernatant from flasks that 828 showed no cpe were passed on twice. No cpe was observed in the flasks inoculated with 0.1 or 0.01 829 pfu after the two passes. AVL samples were taken from the flasks at the beginning and end of each

830 passage and the CT values of the extracted nucleic acids shown below.

831

832

833

834

835

836

837

838

839

840

841

842

843

Page 42 of 43

medRxiv preprint doi: https://doi.org/10.1101/2021.06.28.21259398; this version posted August 20, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license .

844 Supplementary Information 3

845

846

847 Table 5. RT-LAMP results of time course from symptom onset

Days post Direct RT-LAMP RNA RT-LAMP RT-qPCR CT suspected Observed Symptoms exposure Tp 1 Tp 2 Result Tp 1 Tp 2 Result ORF1ab N 5 09:18 09:32 POS 11:09 10:50 POS 23.31 26.47 Onset: Sore throat. Blocked nose. Headache. Lack of appetite. Fever. 6 10:32 11:34 POS 10:34 10:40 POS 21.16 24.03 Sore throat. Headache. Restless sleeping. Tired 7 10:19 13:40 POS 11:39 09:59 POS 24.47 27.30 Headache. Restless sleeping. Tired. Loss of smell and taste. 9 09:31 09:14 POS 08:35 09:37 POS 28.55 31.89 Tired. Loss of smell and taste. 11 13:14 11:47 POS 16:44 16:39 POS 26.44 29.06 Tired. Loss of smell and taste. 12 09:10 10:09 POS 12:42 12:01 POS 26.13 29.19 Tired. Improvement in smell and taste. 13 NEG NEG NEG 14:06 12:56 POS 28.16 30.62 Significant improvement in all symptoms 14 NEG NEG NEG NEG NEG NEG 38.05 40.73 None 16 NEG NEG NEG NEG NEG NEG 36.11 NEG None 17 NEG NEG NEG NEG NEG NEG NEG NEG None

848 Time to positivity in minutes [Tp]; Cycle Threshold [CT]; Negative [NEG]; positive [POS]

849

850

851

Page 43 of 43