Sequential Adversarial Anomaly Detection for One-Class Event Data

References

• Abbeel P, Ng AY (2004) Apprenticeship learning via inverse reinforcement learning. Proc. 21st Internat. Conf. on Machine Learn. (ACM, New York).Google Scholar
• Bolton RJ, Hand DJ (2002) Statistical fraud detection: A review. Statist. Sci. 17(3):235–255.Google Scholar
• Bolton RJ, Hand DJ (2001) Unsupervised profiling methods for fraud detection. Credit Research Centre, University of Edinburgh, 235–255.Google Scholar
• Breunig M, Kriegel HP, Ng RT, Sander J (2000) LOF: Identifying density-based local outliers. Proc. ACM SIGMOD Internat. Conf. on Management of Data (ACM, New York), 93–104.Google Scholar
• Chalapathy R, Menon AK, Chawla S (2017) Robust, deep and inductive anomaly detection. Ceci M, Hollmén J, Todorovski L, Vens C, Dzeroski S, eds. Proc. Eur. Conf. on Machine Learn. and Knowledge Discovery in Databases, Lecture Notes in Computer Science, vol. 10534 (Springer, Berlin), 36–51.Google Scholar
• Chalapathy R, Menon AK, Chawla S (2018) Anomaly detection using one-class neural networks. Preprint, submitted February 18, https://arxiv.org/abs/1802.06360.Google Scholar
• Chandola V, Banerjee A, Kumar V (2010) Anomaly detection for discrete sequences: A survey. IEEE Trans. Knowledge Data Engrg. 24(5):823–839.Google Scholar
• Chung J, Kastner K, Dinh L, Goel K, Courville AC, Bengio Y (2015) A recurrent latent variable model for sequential data. Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R, eds. Advances in Neural Information Processing Systems, vol. 28 (Curran Associates, Red Hook, NY), 2980–2988.Google Scholar
• Clifton DA, Hugueny S, Tarassenko L (2011) Novelty detection with multivariate extreme value statistics. J. Signal Processing Systems 65(3):371–389.Google Scholar
• Devlin J, Chang M, Lee K, Toutanova K (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. Burstein J, Doran C, Solorio T, eds. Proc. Conf. of the North American Chapter of the Assoc. for Comput. Linguistics: Human Language Tech (Association for Computational Linguistics, Stroudsburg, PA), 4171–4186.Google Scholar
• Doshi K, Yilmaz Y (2020) Any-shot sequential anomaly detection in surveillance videos. Proc. IEEE/CVF Conf. on Computer Vision and Pattern Recognition Workshops (IEEE, Piscataway, NJ), 934–935.Google Scholar
• Du N, Dai H, Trivedi R, Upadhyay U, Gomez-Rodriguez M, Song L (2016) Recurrent marked temporal point processes: Embedding event history to vector. Proc. 22nd ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining (ACM, New York), 1555–1564.Google Scholar
• Embrechts P, Mikosch T, Klüppelberg C (1997) Modelling Extremal Events: For Insurance and Finance (Springer-Verlag, Berlin).Google Scholar
• FBI (2021) Credit card fraud. https://www.fbi.gov/scams-and-safety/common-scams-and-crimes/credit-card-fraud.Google Scholar
• Ghosh S, Reilly DL (1994) Credit card fraud detection with a neural-network. Proc. 27th Hawaii Internat. Conf. on Systems Sci., vol. 3 (IEEE, Piscataway, NJ), 621–630.Google Scholar
• Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, et al. (2014) Generative adversarial nets. Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ, eds. Advances in Neural Information Processing Systems, vol. 27 (Curran Associates, Red Hook, NY), 2672–2680.Google Scholar
• Goodfellow IJ (2014) On distinguishability criteria for estimating generative models. Preprint, submitted December 14, https://arxiv.org/abs/1412.6515.Google Scholar
• Gretton A, Borgwardt KM, Rasch MJ, Schölkopf B, Smola A (2012) A kernel two-sample test. J. Machine Learn. Res. 13(25):723–773.Google Scholar
• Hawkes AG (1971) Spectra of some self-exciting and mutually exciting point processes. Biometrika 58(1):83–90.Google Scholar
• Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput. 9(8):1735–1780.Google Scholar
• Hussein A, Gaber MM, Elyan E, Jayne C (2017) Imitation learning: A survey of learning methods. ACM Comput. Survey 50(2):1–35.Google Scholar
• Kou Y, Lu CT, Sirwongwattana S, Huang YP (2004) Survey of fraud detection techniques. Proc. IEEE Internat. Conf. on Networking, Sensing and Control, vol. 2 (IEEE, Piscataway, NJ), 749–754.Google Scholar
• LeCun Y, Bengio Y (1995) Convolutional networks for images, speech, and time series. Handbook Brain Theory Neural Networks 3361(10):1995.Google Scholar
• Li M, Zhang T, Chen Y, Smola AJ (2014) Efficient mini-batch training for stochastic optimization. Proc. 20th ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining (ACM, New York), 661–670.Google Scholar
• Li S, Xiao S, Zhu S, Du N, Xie Y, Song L (2018) Learning temporal point processes via reinforcement learning. Proc. 32nd Internat. Conf. on Neural Information Processing Systems (Curran Associates, Red Hook, NY), 10804–10814.Google Scholar
• Li S, Xie Y, Farajtabar M, Verma A, Song L (2017) Detecting changes in dynamic events over networks. IEEE Trans. Signal Inform. Processing Networks 3(2):346–359.Google Scholar
• Luca S, Karsmakers P, Cuppens K, Croonenborghs T, de Vel AV, Ceulemans B, Lagae L, et al. (2014) Detecting rare events using extreme value statistics applied to epileptic convulsions in children. Artificial Intelligence Medicine 60(2):89–96.Google Scholar
• Luo W, Liu W, Gao S (2017) Remembering history with convolutional LSTM for anomaly detection. Proc. IEEE Internat. Conf. on Multimedia and Expo (IEEE, Piscataway, NJ), 439–444.Google Scholar
• Maes S, Tuyls K, Vanschoenwinkel B, Manderick B (2002) Credit card fraud detection using Bayesian and neural networks. Proc. 1st Internat. NAISO Congress on Neuro Fuzzy Technologies, 261–270.Google Scholar
• Malhotra P, Ramakrishnan A, Anand G, Vig L, Agarwal P, Shroff G (2016) LSTM-based encoder-decoder for multi-sensor anomaly detection. Preprint, submitted July 1, https://arxiv.org/abs/1607.00148.Google Scholar
• Malini N, Pushpa M (2017) Analysis on credit card fraud identification techniques based on knn and outlier detection. Proc. 3rd Internat. Conf. on Advances in Electrical, Electronics, Inform., Comm. and Bio-Informatics (IEEE, Piscataway, NJ), 255–258.Google Scholar
• Mei H, Eisner J (2017) The neural Hawkes process: A neurally self-modulating multivariate point process. Proc. 31st Internat. Conf. on Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 6757–6767.Google Scholar
• Michael S, George K, Vipin K (2002) A comparison of document clustering techniques. Proc. KDD Workshop on Text Mining.Google Scholar
• Mohri M, Rostamizadeh A, Talwalkar A (2012) Foundations of Machine Learning (MIT Press, Cambridge, MA).Google Scholar
• Nanduri A, Sherry L (2016) Anomaly detection in aircraft data using recurrent neural networks (RNN). Proc. Integrated Communications Navigation and Surveillance (IEEE, Piscataway, NJ), 5C2-1–5C2-8.Google Scholar
• Ng AY, Russell S (2000) Algorithms for inverse reinforcement learning. Proc. 17th Internat. Conf. on Machine Learn. (Morgan Kaufmann, Burlington, MA), 663–670.Google Scholar
• Oh Mh, Iyengar G (2019) Sequential anomaly detection using inverse reinforcement learning. Proc. 25th ACM SIGKDD Internat. Conf. on Knowledge Discovery & Data Mining (ACM, New York), 1480–1490.Google Scholar
• Page ES (1954) Continuous inspection schemes. Biometrika 41(1/2):100–115.Google Scholar
• Rahimi A, Recht B (2008) Random features for large-scale kernel machines. Platt JC, Koller D, Singer Y, Roweis ST, eds. Advances in Neural Information Processing Systems, vol. 20 (Curran Associates, Red Hook, NY), 1177–1184.Google Scholar
• Rambaldi M, Filimonov V, Lillo F (2018) Detection of intensity bursts using Hawkes processes: An application to high frequency financial data. J. Phys. Rev. E 97(3):032318.Google Scholar
• Reinhart A (2018) A review of self-exciting spatio-temporal point processes and their applications. J. Statist. Sci. 33(3):299–318.Google Scholar
• Rudin W (1962) Fourier Analysis on Groups, vol. 121967 (Wiley Online Library, New York).Google Scholar
• Ruff L, Vandermeulen R, Goernitz N, Deecke L, Siddiqui SA, Binder A, Müller E, Kloft M (2018) Deep one-class classification. Dy J, Krause A, eds. Proc. 35th Internat. Conf. on Machine Learn., vol. 80 (PMLR), 4393–4402.Google Scholar
• Sahin Y, Duman E (2011) Detecting credit card fraud by ANN and logistic regression. Proc. Internat. Sympos. on Innovations in Intelligent Systems and Appl. (IEEE, Piscataway, NJ), 315–319.Google Scholar
• Siegmund D (1985) Sequential Analysis: Tests and Confidence Intervals. Springer Series in Statistics (Springer, Berlin).Google Scholar
• Srivastava A, Kundu A, Sural S, Majumdar A (2008) Credit card fraud detection using hidden Markov model. IEEE Trans. Dependent Secure Comput. 5(1):37–48.Google Scholar
• Syed U, Schapire RE (2007) A game-theoretic approach to apprenticeship learning. Proc. 20th Internat. Conf. on Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 1449–1456.Google Scholar
• The Nilson Report (2019) Payment card fraud losses reach $27.85 billion. https://nilsonreport.com/mention/407/1link/.Google Scholar
• Tran PH, Tran KP, Huong TT, Heuchenne C, HienTran P, Le TMH (2018) Real time data-driven approaches for credit card fraud detection. Proc. Internat. Conf. on E-Bus. and Appl. (ACM, New York), 6–9.Google Scholar
• Upadhyay U, De A, Gomez-Rodriguez M (2018) Deep reinforcement learning of marked temporal point processes. Proc. 32nd Internat. Conf. on Neural Inform. Processing Systems (NIPS′18) (Curran Associates, Red Hook, NY), 3172–3182.Google Scholar
• Wang T, Rudin C, Wagner D, Sevieri R (2015) Finding patterns with a rotten core: Data mining for crime series with cores. Big Data 3(1):3–21.Google Scholar
• Wang Y, Xu W (2018) Leveraging deep learning with LDA-based text analytics to detect automobile insurance fraud. Decision Support Systems 105:87–95.Google Scholar
• Xiao S, Yan J, Yang X, Zha H, Chu SM (2017a) Modeling the intensity function of point process via recurrent neural networks. Proc. 31st AAAI Conf. on Artificial Intelligence (AAAI Press, Palo Alto, CA), 1597–1603.Google Scholar
• Xiao S, Farajtabar M, Ye X, Yan J, Song L, Zha H (2017b) Wasserstein learning of deep generative point process models. Proc. 31st Internat. Conf. on Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 3250–3259.Google Scholar
• Xu X (2010) Sequential anomaly detection based on temporal-difference learning: Principles, models and case studies. Appl. Soft Comput. 10(3):859–867.Google Scholar
• Zhang R, Zhang S, Muthuraman S, Jiang J (2007) One class support vector machine for anomaly detection in the communication network performance data. Proc. 5th Conf. on Appl. Electromagnetics, Wireless and Optical Comm (WSEAS, Stevens Point, WI), 31–37.Google Scholar
• Zhu S, Xie Y (2018) Crime incidents embedding using restricted Boltzmann machines. Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (IEEE, Piscataway, NJ), 2376–2380.Google Scholar
• Zhu S, Xie Y (2019a) Crime event embedding with unsupervised feature selection. Proc. ICASSP IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (IEEE, Piscataway, NJ), 3922–3926.Google Scholar
• Zhu S, Xie Y (2019b) Spatial-temporal-textual point processes for crime linkage detection. Preprint, submitted February 1, https://arxiv.org/abs/1902.00440.Google Scholar
• Zhu S, Yuchi HS, Xie Y (2020) Adversarial anomaly detection for marked spatio-temporal streaming data. Proc. ICASSP IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (IEEE, Piscataway, NJ), 8921–8925.Google Scholar
• Zhu S, Li S, Peng Z, Xie Y (2021a) Imitation learning of neural spatio-temporal point processes. IEEE Trans. Knowledge Data Engrg. 34(11):5391–5402.Google Scholar
• Zhu S, Zhang M, Ding R, Xie Y (2021b) Deep Fourier kernel for self-attentive point processes. Banerjee A, Fukumizu K, eds. Proc. 24th Internat. Conf. on Artificial Intelligence and Statist., vol. 130 (PLMR), 856–864.Google Scholar
• Zhu S, Wang H, Dong Z, Cheng X, Xie Y (2021c) Neural spectral marked point processes. Preprint, submitted June 20, https://arxiv.org/abs/2106.10773.Google Scholar
• Ziebart BD, Maas A, Bagnell JA, Dey AK (2008) Maximum entropy inverse reinforcement learning. Proc. 23rd National Conf. on Artificial Intelligence, vol. 3 (AAAI Press, Palo Alto, CA), 1433–1438.Google Scholar