Training a convolutional neural network for real–bogus classification in the ATLAS survey

Journal article

We present a convolutional neural network (CNN) for use in the real–bogus classification of transient detections made by the Asteroid Terrestrial-impact Last Alert System (ATLAS) and subsequent efforts to improve performance since initial development. In transient detection surveys, the number of alerts made outstrips the capacity for human scanning, necessitating the use of machine learning aids to reduce the number of false positives presented to annotators. We take a sample of recently annotated data from each of the three operating ATLAS telescope with 340 000 real (known transients) and 1030 000 bogus detections per model. We retrained the CNN architecture with these data specific to each ATLAS unit, achieving a median false positive rate (FPR) of 0.72 per cent for a 1.00 per cent missed detection rate. Further investigations indicate that if we reduce the input image size it results in increased FPR. Finally architecture adjustments and comparisons to contemporary CNNs indicate that our retrained classifier is providing an optimal FPR. We conclude that the periodic retraining and readjustment of classification models on survey data can yield significant improvements as data drift arising from changes in the optical and detector performance can lead to new features in the model and subsequent deteriorations in performance.

Authors: Weston, JG; Smith, KW; Smartt, SJ; Tonry, JL; Stevance, HF

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Oxford University Press
• Journal: RAS Techniques and Instruments
• Volume: 3
• Issue: 1
• Pages: 385-399
• Publication date: 2024-07-12
• Acceptance date: 2024-07-08
• DOI: 10.1093/rasti/rzae027
• EISSN: 2752-8200
• Language: English
• Keywords: Classification; Supernovae; Convolutional Neural Networks; Data Methods; Algorithms; Machine Learning