Augmenting data with GANs for firearms detection in cargo x-ray images

Phawis Thammasorn; Basak Oztan

doi:10.1117/12.2618887

3 June 2022 Augmenting data with GANs for firearms detection in cargo x-ray images

Phawis Thammasorn, Basak Oztan

Proceedings Volume 12104, Anomaly Detection and Imaging with X-Rays (ADIX) VII; 1210406 (2022) https://doi.org/10.1117/12.2618887
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

We propose a framework and impact of applying Machine Learning-based generated imagery to augment data variations for firearm detection in cargo x-ray images. Deep learning-based approaches for object detection have rapidly become the state-of-art and crucial technology for non-intrusive inspection (NII) based on x-ray radiography. The technology is widely employed to reduce or replace tedious labor-intensive inspection to verify cargo content and intercept potential threats at border crossings, ports, and other critical infrastructure facilities. However, the need for variations in the threat cargo content makes accumulating training data for such a system an increasing development cost. Even though threat image projection (TIP) is widely employed to simplify the process into artificially projecting the known threat, a considerable amount of threat object appearances is still needed. To further reduce the cost, we explore the use of GenerativeAdversarial-Network (GAN) to aid dataset creation. GAN is a successful deep learning technique for generating photo-real imagery in many domains. We propose a three-stage training framework dedicated to firearm detection. First, GAN is trained to generate variations of X-ray firearm appearance from binary masks for better image quality compared to the commonly used random noise. Second, the detection training dataset is created in combinations of generated images and actual firearms using TIP. Finally, the dataset is used to train RetinaNet for the detection. Our evaluations reveal that GAN can reduce the training cost in increase detection performance as using the combination of the real and generated firearms increase performance for unseen firearms detection.

Conference Presentation

Citation Download Citation

Phawis Thammasorn and Basak Oztan "Augmenting data with GANs for firearms detection in cargo x-ray images", Proc. SPIE 12104, Anomaly Detection and Imaging with X-Rays (ADIX) VII, 1210406 (3 June 2022); https://doi.org/10.1117/12.2618887

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available