Robust Combination Testing: Methods and Application to COVID-19 Detection

References

• Adams ER, Ainsworth M, Anand R, Andersson MI, Auckland K, Baillie JK, Barnes E, et al. (2020) Antibody testing for COVID-19: A report from the national COVID scientific advisory panel. Wellcome Open Res. 5:139.Crossref, Google Scholar
• Alagoz O, Chhatwal J, Burnside ES (2013) Optimal policies for reducing unnecessary follow-up mammography exams in breast cancer diagnosis. Decision Anal. 10(3):200–224.Link, Google Scholar
• Alizamir S, De Véricourt F, Sun P (2013) Diagnostic accuracy under congestion. Management Sci. 59(1):157–171.Link, Google Scholar
• Aprahamian H, Bish DR, Bish EK (2019) Optimal risk-based group testing. Management Sci. 65(9):4365–4384.Link, Google Scholar
• Armstrong S (2020) Why COVID-19 antibody tests are not the game changer the UK government claims. BMJ 369:m2469.Crossref, Google Scholar
• Barreno M, Cardenas A, Tygar JD (2007) Optimal ROC curve for a combination of classifiers. Platt J, Koller D, Singer Y, Roweis S, eds. Adv. Neural Inform. Processing Systems 20 (Curran Associates, Inc., New York), 57–64.Google Scholar
• Bastani H, Drakopoulos K, Gupta V, Vlachogiannis I, Hadjicristodoulou C, Lagiou P, Magiorkinis G, Paraskevis D, Tsiodras S (2021) Efficient and targeted COVID-19 border testing via reinforcement learning. Nature 599(7883):108–113.Crossref, Google Scholar
• Ben-Tal A, den Hertog D, De Waegenaere A, Melenberg B, Rennen G (2013) Robust solutions of optimization problems affected by uncertain probabilities. Management Sci. 59(2):341–357.Link, Google Scholar
• Bertsimas D, Den Hertog D, Pauphilet J (2021) Probabilistic guarantees in robust optimization. SIAM J. Optim. 31(4):2893–2920.Crossref, Google Scholar
• Blacksell SD, Jarman RG, Bailey MS, Tanganuchitcharnchai A, Jenjaroen K, Gibbons RV, Paris DH, et al. (2011) Evaluation of six commercial point-of-care tests for diagnosis of acute dengue infections: The need for combining NS1 antigen and IgM/IgG antibody detection to achieve acceptable levels of accuracy. Clinical Vaccine Immunology 18(12):2095–2101.Crossref, Google Scholar
• Böger B, Fachi MM, Vilhena RO, de Fátima Cobre A, Tonin FS, Pontarolo R (2021) Systematic review with meta-analysis of the accuracy of diagnostic tests for COVID-19. Amer. J. Infection Control 49(1):21–29.Crossref, Google Scholar
• Breiman L (1996) Bagging predictors. Machine Learn. 24(2):123–140.Crossref, Google Scholar
• Bubar KM, Reinholt K, Kissler SM, Lipsitch M, Cobey S, Grad YH, Larremore DB (2021) Model-informed COVID-19 vaccine prioritization strategies by age and serostatus. Science 371(6532):916–921.Crossref, Google Scholar
• Buhat CAH, Duero JCC, Felix EFO, Rabajante JF, Mamplata JB (2021) Optimal allocation of COVID-19 test kits among accredited testing centers in the Philippines. J. Healthcare Informatics Res. 5(1):54–69.Crossref, Google Scholar
• Calabrese JM, Demers J (2022) How optimal allocation of limited testing capacity changes epidemic dynamics. J. Theoret. Biology 538:111017.Crossref, Google Scholar
• Cheng J, Delage E, Lisser A (2014) Distributionally robust stochastic knapsack problem. SIAM J. Optim. 24(3):1485–1506.Crossref, Google Scholar
• Corman VM, Haage VC, Bleicker T, Schmidt ML, Mühlemann B, Zuchowski M, Jo WK, et al. (2021) Comparison of seven commercial SARS-CoV-2 rapid point-of-care antigen tests: A single-centre laboratory evaluation study. Lancet Microbe 2(7):e311–e319.Crossref, Google Scholar
• Dai T, Singh S (2023) Overdiagnosis and undertesting for infectious diseases. Preprint, submitted March 17, http://dx.doi.org/10.2139/ssrn.3725057.Google Scholar
• Dantzig GB (1957) Discrete-variable extremum problems. Oper. Res. 5(2):266–288.Link, Google Scholar
• Deeks J, Raffle A, Gill M (2021) COVID-19: Government must urgently rethink lateral flow test roll out. BMJ Opinion (January 12), https://blogs.bmj.com/bmj/2021/01/12/covid-19-government-must-urgently-rethink-lateral-flow-test-roll-out/.Google Scholar
• Drakopoulos K, Randhawa RS (2021) Why perfect tests may not be worth waiting for: Information as a commodity. Management Sci. 67(11):6678–6693.Link, Google Scholar
• Džeroski S, Ženko B (2004) Is combining classifiers with stacking better than selecting the best one? Machine Learn. 54(3):255–273.Crossref, Google Scholar
• Food and Drug Administration (2020) Coronavirus (COVID-19) update: FDA authorizes antigen test as first over-the-counter fully at-home diagnostic test for COVID-19. U.S. Food and Drug Administration News Release, U.S. Food and Drug Administration, Washington, DC.Google Scholar
• Fitzpatrick MC, Pandey A, Wells CR, Sah P, Galvani AP (2021) Buyer beware: Inflated claims of sensitivity for rapid COVID-19 tests. Lancet 397(10268):24–25.Crossref, Google Scholar
• Gelman A, Hill J (2006) Data Analysis Using Regression and Multilevel/Hierarchical Models (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Gibani MM, Toumazou C, Sohbati M, Sahoo R, Karvela M, Hon T-K, De Mateo S, et al. (2020) Assessing a novel, laboratory-free, point-of-care test for SARS-CoV-2 (CovidNudge): A diagnostic accuracy study. Lancet Microbe 1(7):e300–e307.Crossref, Google Scholar
• Gupta N, Augustine S, Narayan T, O’Riordan A, Das A, Kumar D, Luong JHT, Malhotra BD (2021) Point-of-care PCR assays for COVID-19 detection. Biosensors (Basel) 11(5):141.Crossref, Google Scholar
• Hershey JC, Cebul RD, Williams SV (1986) Clinical guidelines for using two dichotomous tests. Medical Decision Making 6(2):68–78.Crossref, Google Scholar
• Huber PJ (1965) A robust version of the probability ratio test. Ann. Math. Statist. 36(6):1753–1758.Crossref, Google Scholar
• Huber PJ, Strassen V (1973) Minimax tests and the Neyman-Pearson lemma for capacities. Ann. Statist. 1(2):251–263.Crossref, Google Scholar
• International Air Transport Association (2021) High testing costs could stall the recovery. Accessed May 4, 2021, https://www.iata.org/en/pressroom/pressroom-archive/2021-releases/2021-05-04-03/.Google Scholar
• Kasy M, Teytelboym A (2020) Adaptive targeted infectious disease testing. Oxford Rev. Econom. Policy 36(Suppl 1):S77–S93.Crossref, Google Scholar
• Kremer M, de Véricourt F (2022) Mismanaging diagnostic accuracy under congestion. Oper. Res., ePub ahead of print May 6, https://doi.org/10.1287/opre.2022.2292.Link, Google Scholar
• Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, Tambe M, Mina MJ, Parker R (2021) Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening. Sci. Adv. 7(1):eabd5393.Crossref, Google Scholar
• Levi R, Magnanti T, Shaposhnik Y (2019) Scheduling with testing. Management Sci. 65(2):776–793.Link, Google Scholar
• Marshall RJ (1989) The predictive value of simple rules for combining two diagnostic tests. Biometrics 45(4):1213–1222.Crossref, Google Scholar
• McCall JJ (1965) Maintenance policies for stochastically failing equipment: A survey. Management Sci. 11(5):493–524.Link, Google Scholar
• McIntosh MW, Pepe MS (2002) Combining several screening tests: Optimality of the risk score. Biometrics 58(3):657–664.Crossref, Google Scholar
• Meinshausen N, Bühlmann P (2010) Stability selection. J. Roy. Statist. Soc. Series B Statist. Methodology 72(4):417–473.Crossref, Google Scholar
• Mina MJ, Parker R, Larremore DB (2020) Rethinking COVID-19 test sensitivity—A strategy for containment. New England J. Medicine 383(22):e120.Crossref, Google Scholar
• Monaci M, Pferschy U (2013) On the robust knapsack problem. SIAM J. Optim. 23(4):1956–1982.Crossref, Google Scholar
• National Audit Office (2020) The government’s approach to test and trace in England—Interim report. Accessed December 11, 2020, https://www.nao.org.uk/wp-content/uploads/2020/12/The-governments-approach-to-test-and-trace-in-England-interim-report.pdf.Google Scholar
• Newcombe RG (1998) Two-sided confidence intervals for the single proportion: Comparison of seven methods. Statist. Medicine 17(8):857–872.Crossref, Google Scholar
• Neyman J, Pearson ES (1933) IX. On the problem of the most efficient tests of statistical hypotheses. Philos. Trans. Roy. Soc. London Series A 231(694–706):289–337.Crossref, Google Scholar
• Paltiel AD, Zheng A, Walensky RP (2020) Assessment of SARS-CoV-2 screening strategies to permit the safe reopening of college campuses in the United States. JAMA Network Open 3(7):e2016818.Crossref, Google Scholar
• Petherick A (2020) Developing antibody tests for SARS-CoV-2. Lancet 395(10230):1101–1102.Crossref, Google Scholar
• Politico (2021) Vaccines’ success could undercut Biden’s multibillion-dollar school testing plans. Accessed May 23, 2021, https://www.politico.com/news/2021/05/23/covid-vaccine-testing-schools-490213.Google Scholar
• Pulia MS, O’Brien TP, Hou PC, Schuman A, Sambursky R (2020) Multi-tiered screening and diagnosis strategy for COVID-19: A model for sustainable testing capacity in response to pandemic. Ann. Medicine 52(5):207–214.Crossref, Google Scholar
• Ramdas K, Darzi A, Jain S (2020) “Test, re-test, re-test”: Using inaccurate tests to greatly increase the accuracy of COVID-19 testing. Nature Medicine 26(6):810–811.Crossref, Google Scholar
• Rubin R (2020) The challenges of expanding rapid tests to curb COVID-19. JAMA 324(18):1813–1815.Crossref, Google Scholar
• Shuren J, Stenzel T (2021) The FDA’s experience with COVID-19 antibody tests. New England J. Medicine 384(7):592–594.Crossref, Google Scholar
• Smith RL, Gibson LL, Martinez PP, Ke R, Mirza A, Conte M, Gallagher N (2021) Longitudinal assessment of diagnostic test performance over the course of acute SARS-CoV-2 infection. J. Infectious Diseases 224(6):976–982.Crossref, Google Scholar
• Sox HC, Higgins MC, Owenst DK (2013) Medical Decision Making, 2nd ed. (Wiley, New York).Crossref, Google Scholar
• The Economic Times (2021) Labs in Dehli halt services over delay in giving out tests results amid COVID-19 spike. Accessed April 21, 2021, https://economictimes.indiatimes.com/news/india/labs-in-delhi-halt-services-over-delay-in-giving-out-test-results-amid-covid-19-spike/articleshow/82173036.cms.Google Scholar
• Transportation Security Agency (2021) TSA checkpoint travel numbers. Accessed June 28, 2021, https://www.tsa.gov/coronavirus/passenger-throughput.Google Scholar
• UK Department of Education (2021) Attendance in education and early years settings during the coronavirus (COVID-19) outbreak. Accessed June 28, 2021, https://explore-education-statistics.service.gov.uk/find-statistics/attendance-in-education-and-early-years-settings-during-the-coronavirus-covid-19-outbreak/2021-week-26.Google Scholar
• Van Parys BPG, Esfahani PM, Kuhn D (2021) From data to decisions: Distributionally robust optimization is optimal. Management Sci. 67(6):3387–3402.Link, Google Scholar
• Veyrenche N, Bolloré K, Pisoni A, Bedin A-S, Mondain A-M, Ducos J, Segondy M, et al. (2021) Diagnosis value of SARS-CoV-2 antigen/antibody combined testing using rapid diagnostic tests at hospital admission. J. Medical Virology 93(5):3069–3076.Crossref, Google Scholar
• Wang H (2002) A survey of maintenance policies of deteriorating systems. Eur. J. Oper. Res. 139(3):469–489.Crossref, Google Scholar
• Weinstein MC, Fineberg HV (1980) Clinical Decision Analysis (W. B. Saunders Co., Philadelphia).Google Scholar
• Wise J (2020) COVID-19: Safety of lateral flow tests questioned after they are found to miss half of cases. BMJ 371:m4744.Crossref, Google Scholar
• Wolpert DH (1992) Stacked generalization. Neural Networks 5(2):241–259.Crossref, Google Scholar
• Xiao R, Rathi VK (2021) Price transparency for COVID-19 testing among top us hospitals. J. General Internal Medical 36(1):245–247.Crossref, Google Scholar
• Yang L, Cui S, Wang Z (2022) Design of COVID-19 testing queues. Production Oper. Management 31(5):2204–2221.Crossref, Google Scholar