Real-time detection of drones at large distances with 25 megapixel cameras

Thomas Perschke; Konrad Moren; Thomas Müller

doi:10.1117/12.2324678

4 October 2018 Real-time detection of drones at large distances with 25 megapixel cameras

Thomas Perschke, Konrad Moren, Thomas Müller

Proceedings Volume 10799, Emerging Imaging and Sensing Technologies for Security and Defence III; and Unmanned Sensors, Systems, and Countermeasures; 107990N (2018) https://doi.org/10.1117/12.2324678
Event: SPIE Security + Defence, 2018, Berlin, Germany

Abstract

To detect drones in real-time at large distances, using high-resolution visual(VIS) cameras, requires a careful system design. In our setup we use four 10-bit 25 Megapixels@25fps cameras to detect drones. This means a theoretical raw data throughput of about 33 GB/sec for the system from the VIS cameras alone. We implemented a small-object detection algorithm on two different platforms. The algorithm is based on a point-detector with a subsequent clustering step. One platform is a Xilinx Kintex-7 FPGA, the other a Nvidia GeForce GTX 1080 GPU. We explain, how the small-object detection algorithm, based on a software reference implementation, has been ported to a FPGA version. It is shown, that the FPGA implementation of the point-detector reaches the optimal throughput and we show, that the clustering can be done in a streaming fashion. Using the FPGA implementation, the camera can be used in free-running mode, processing the camera data in real time. The CUDA implementation of the algorithm shows, that the computing capabilities of modern GPGPUs allow an easy port of the algorithm to this platform to reach real-time performance with 68fps. The use of four high-resolution cameras requires a careful overall system design. We present our hardware system design and the central data distribution system. As the small-object detections may be used by different processes like the tracking process or display processes, a fast, safe and robust distribution system must be provided. We describe our approach using the Boost Interprocess library to provide a portable data distribution system.

Citation Download Citation

Thomas Perschke, Konrad Moren, and Thomas Müller "Real-time detection of drones at large distances with 25 megapixel cameras", Proc. SPIE 10799, Emerging Imaging and Sensing Technologies for Security and Defence III; and Unmanned Sensors, Systems, and Countermeasures, 107990N (4 October 2018); https://doi.org/10.1117/12.2324678

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available