A Knowledge Gradient Policy for Sequencing Experiments to Identify the Structure of RNA Molecules Using a Sparse Additive Belief Model

References

• Auer P, Cesa-Bianchi N, Fischer P (2002) Finite-time analysis of the multiarmed bandit problem. Machine Learn. 47(2–3):235–256.Crossref, Google Scholar
• Bennett CF, Swayze EE (2010) RNA targeting therapeutics: Molecular mechanisms of antisense oligonucleotides as a therapeutic platform. Ann. Rev. Pharmacol. Toxicol. 50:259–293.Crossref, Google Scholar
• Brochu E, Brochu T, de Freitas N (2010) A Bayesian interactive optimization approach to procedural animation design. Otaduy M, Popovic Z, eds. Proc. 2010 ACM SIGGRAPH/Eurographics Sympos. Comput. Animation (Eurographics Association), 103–112.Google Scholar
• Bubeck S, Cesa-Bianchi N (2012) Regret analysis of stochastic and nonstochastic multi-armed bandit problems. Foundations Trends Machine Learn. 5:1–122.Crossref, Google Scholar
• Cech TR, Zaug AJ, Grabowski PJ (1981) In vitro splicing of the ribosomal RNA precursor of Tetrahymena: Involvement of a guanosine nucleotide in the excision of the intervening sequence. Cell 27(3):487–496.Crossref, Google Scholar
• Chan JH, Lim S, Wong WS (2006) Antisense oligonucleotides: From design to therapeutic application. Clin. Experiment. Pharmacol. Physiol. 33(5–6):533–540.Crossref, Google Scholar
• Chen C (2010) Stochastic Simulation Optimization: An Optimal Computing Budget Allocation, Vol. 1 (World Scientific, Singapore).Crossref, Google Scholar
• Chen X, Lin Q, Pena J (2012) Optimal regularized dual averaging methods for stochastic optimization. Pereira F, Burges CJC, Bottou L, Weinberger KQ, eds. Adv. Neural Inform. Process Systems, Vol. 25, 404–412.Google Scholar
• Chen Y, Hero AO (2012) Recursive group Lasso. IEEE Trans. Signal Processing 60(8):3978–3987.Crossref, Google Scholar
• Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J. Artificial Intell. Res. 4:129–145.Crossref, Google Scholar
• Cressie N (2015) Statistics for Spatial Data (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Currin C, Mitchell T, Morris M, Ylvisaker D (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J. Amer. Statist. Assoc. 86(416):953–963.Crossref, Google Scholar
• De Jong H (2002) Modeling and simulation of genetic regulatory systems: A literature review. J. Comput. Biol. 9(1):67–103.Crossref, Google Scholar
• DeVos SL, Miller TM (2013) Antisense oligonucleotides: Treating neurodegeneration at the level of RNA. Neurotherapeutics 10(3): 486–497.Crossref, Google Scholar
• Ding Y, Tang Y, Kwok CK, Zhang Y, Bevilacqua PC, Assmann SM (2014) In vivo genome-wide profiling of RNA secondary structure reveals novel regulatory features. Nature 505(7485):696–700.Crossref, Google Scholar
• Federer WTet al. (1955) Experimental design. Experiment. Design (Wiley, Oxford, UK).Google Scholar
• Frazier PI, Powell WB, Dayanik S (2008) A knowledge-gradient policy for sequential information collection. SIAM J. Control Optim. 47(5):2410–2439.Crossref, Google Scholar
• Frazier PI, Powell WB, Dayanik S (2009) The knowledge-gradient policy for correlated normal beliefs. INFORMS J. Comput. 21(4):599–613.Link, Google Scholar
• Garrigues P, El Ghaoui L (2008) An homotopy algorithm for the Lasso with online observations. Koller D, Schuurmans D, Bengio Y, Bottou L, eds. Adv. Neural Inform. Process Systems, Vol. 21, 489–496.Google Scholar
• Gelderman G, Contreras LM (2013) Discovery of post-transcriptional regulatory RNAs using next generation sequencing technologies. Gelderman G, Contreras LM, eds. Systems Metabolic Engineering (Humana Press, Totowa, NJ), 269–295.Crossref, Google Scholar
• Gittins J, Glazebrook K, Weber R (2011) Multi-Armed Bandit Allocation Indices (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Gold L, Polisky B, Uhlenbeck O, Yarus M (1995) Diversity of oligonucleotide functions. Annual Rev. Biochem. 64(1):763–797.Crossref, Google Scholar
• Gupta SS, Miescke KJ (1996) Bayesian look ahead one-stage sampling allocations for selection of the best population. J. Statist. Planning Inference 54(2):229–244.Crossref, Google Scholar
• Haning K, Cho SH, Contreras LM (2015) Strain engineering via regulatory noncoding RNAs: Not a one-blueprint fits all. Curr. Opin. Chem. Engrg. 10:25–34.Crossref, Google Scholar
• Huang D, Allen TT, Notz WI, Miller RA (2006b) Sequential kriging optimization using multiple-fidelity evaluations. Structural Multidisciplinary Optim. 32(5):369–382.Crossref, Google Scholar
• Huang D, Allen TT, Notz WI, Zeng N (2006a) Global optimization of stochastic black-box systems via sequential kriging meta-models. J. Global Optim. 34(3):441–466.Crossref, Google Scholar
• Jones DM, Gittins JC (1972) A Dynamic Allocation Index for the Sequential Design of Experiments (Department of Engineering, University of Cambridge, Cambridge, UK).Google Scholar
• Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4):455–492.Crossref, Google Scholar
• Kennedy MC, O’Hagan A (2001) Bayesian calibration of computer models. J. Roy. Statist. Soc. Ser. B-Statist. Methodol. 63(3):425–464.Crossref, Google Scholar
• Kertesz M, Iovino N, Unnerstall U, Gaul U, Segal E (2007) The role of site accessibility in microRNA target recognition. Nature Genetics 39(10):1278–1284.Crossref, Google Scholar
• Kertesz M, Wan Y, Mazor E, Rinn JL, Nutter RC, Chang HY, Segal E (2010) Genome-wide measurement of RNA secondary structure in yeast. Nature 467(7311):103–107.Crossref, Google Scholar
• Laing C, Schlick T (2011) Computational approaches to RNA structure prediction, analysis, and design. Current Opinion Structural Biol. 21(3):306–318.Crossref, Google Scholar
• Li Y, Liu H, Powell WB (2015) The knowledge gradient policy using a sparse additive belief model. Working paper, Princeton University, Princeton, NJ.Google Scholar
• Li Y, Liu H, Powell WB (2016) A Lasso-based sparse knowledge gradient policy for sequential optimal learning. Internat. Conf. Artificial Intelligence Statist., Vol. 51, 417–425.Google Scholar
• Negoescu DM, Frazier PI, Powell WB (2011) The knowledge-gradient algorithm for sequencing experiments in drug discovery. INFORMS J. Comput. 23(3):346–363.Link, Google Scholar
• Pain A, Ott A, Amine H, Rochat T, Bouloc P, Gautheret D (2015) An assessment of bacterial small RNA target prediction programs. RNA Biol. 12(5):509–513.Crossref, Google Scholar
• Powell WB, Ryzhov IO (2012) Optimal Learning (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Rodrigo G, Landrain TE, Majer E, Daros JA, Jaramillo A (2013) Full design automation of multi-state RNA devices to program gene expression using energy-based optimization. PLoS Comput. Biol. 9(8):e1003172.Crossref, Google Scholar
• Russell R, Das R, Suh H, Travers KJ, Laederach A, Engelhardt MA, Herschlag D (2006) The paradoxical behavior of a highly structured misfolded intermediate in RNA folding. J. Mol. Biol. 363(2):531–544.Crossref, Google Scholar
• Ryzhov IO, Powell WB, Frazier PI (2012) The knowledge gradient algorithm for a general class of online learning problems. Oper. Res. 60(1):180–195.Link, Google Scholar
• Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Statist. Sci. 4(4):409–423.Crossref, Google Scholar
• SantaLucia J (1998) A unified view of polymer, dumbbell, and oligonucleotide DNA nearest-neighbor thermodynamics. Proc. Natl. Acad. Sci. USA 95(4):1460–1465.Crossref, Google Scholar
• Settles B (2010) Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin–Madison, Madison.Google Scholar
• Sowa SW, Vazquez-Anderson J, Clark CA, De La Peña R, Dunn K, Fung EK, Khoury MJ, Contreras LM (2015) Exploiting post-transcriptional regulation to probe RNA structures in vivo via fluorescence. Nucleic Acids Res. 43(2):e13–e13.Crossref, Google Scholar
• Spall JC (2005) Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control, Vol. 65 (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Swisher JR, Jacobson SH, Yücesan E (2003) Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey. ACM Trans. Model. Comput. Simul. 13(2):134–154.Crossref, Google Scholar
• Tibshirani R (1996) Regression shrinkage and selection via the Lasso. J. Roy. Statist. Soc. Ser. B-Statist. Methodol. 58(1):267–288.Google Scholar
• Vazquez E, Bect J (2010) Convergence properties of the expected improvement algorithm with fixed mean and covariance functions. J. Statist. Plan. Inference 140(11):3088–3095.Crossref, Google Scholar
• Vazquez-Anderson J, Contreras LM (2013) Regulatory RNAs: Charming gene management styles for synthetic biology applications. RNA Biol. 10(12):1778–1797.Crossref, Google Scholar
• Vazquez-Anderson J, Mihailovic MK, Baldridge KC, Reyes KG, Haning K, Cho SH, Amador Pet al. (2017) Optimization of a novel biophysical model using large scale in vivo antisense hybridization data displays improved prediction capabilities of structurally accessible RNA regions. Nucleic Acids Res. 45(9):5523–5538.Crossref, Google Scholar
• Wang Y, Reyes KG, Brown KA, Mirkin CA, Powell WB (2015) Nested-batch-mode learning and stochastic optimization with an application to sequential multistage testing in materials science. SIAM J. Sci. Comput. 37(3):B361–B381.Crossref, Google Scholar
• Whittle P (1980) Multi-armed bandits and the gittins index. J. Roy. Statist. Soc. Ser. B-Statist. Methodol. 42(2):143–149.Google Scholar
• Winer BJ, Brown DR, Michels KM (1971) Statistical Principles in Experimental Design, Vol. 2 (McGraw-Hill, New York).Google Scholar
• Xia T, SantaLucia J, Burkard ME, Kierzek R, Schroeder SJ, Jiao X, Cox C, Turner DH (1998) Thermodynamic parameters for an expanded nearest-neighbor model for formation of RNA duplexes with Watson-Crick base pairs. Biochemistry 37(42):14719–14735.Crossref, Google Scholar