Comparison of SARS-CoV-2 detection from nasopharyngeal swab samples by the Roche cobas 6800 SARS-CoV-2 test and a laboratory-developed real-time RT-PCR test

The urgent need to implement and rapidly expand testing for severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) infection has led to the development of multiple assays. How these tests perform relative to one another is poorly understood. We evaluated the concordance between the Roche Diagnostics cobas 6800 SARS-CoV-2 test and a laboratory-developed test (LDT) real-time reverse transcription-polymerase chain reaction based on a modified Centers for Disease Control and Prevention protocol, for the detection of SARS-CoV-2 in samples submitted to the Clinical Laboratories of the Mount Sinai Health System. A total of 1006 nasopharyngeal swabs in universal transport medium from persons under investigation were tested for SARS-CoV-2 as part of routine clinical care using the cobas SARS-CoV-2 test with subsequent evaluation by the LDT. Cycle threshold values were analyzed and interpreted as either positive (“detected” or “presumptive positive”), negative (not detected), inconclusive, or invalid. Statistical analysis was performed using GraphPad Prism 8. The cobas SARS-CoV-2 test reported 706 positive and 300 negative results. The LDT reported 640 positive, 323 negative, 34 inconclusive, and 9 invalid results. When excluding inconclusive and invalid results, the overall percent agreement between the two platforms was 95.8%. Cohen's κ coefficient was 0.904 (95% confidence interval, 0.875-0.933), suggesting almost perfect agreement between both platforms. An overall discordance rate of 4.2% between the two systems may reflect differences in primer sequences, assay limit of detection, or other factors, highlighting the importance of comparing the performance of different testing platforms.