Multi-channel free space optical convolutions with incoherent light

Alexander Song; Sai Nikhilesh Murty Kottapalli; Bernhard Schölkopf; Peer Fischer

doi:10.1117/12.2692291

13 March 2024 Multi-channel free space optical convolutions with incoherent light

Alexander Song, Sai Nikhilesh Murty Kottapalli, Bernhard Schölkopf, Peer Fischer

Proceedings Volume PC12903, AI and Optical Data Sciences V; PC129030I (2024) https://doi.org/10.1117/12.2692291
Event: SPIE OPTO, 2024, San Francisco, California, United States

Abstract

Convolutional layers are a critical feature of modern neural networks and require significant computational resources. Recently, researchers have developed optical accelerators as a low-energy, high-bandwidth approach for performing large-scale convolutions. Existing approaches perform convolutions on only one input channel to one or more output channels. Here we develop an optical convolution approach that simultaneously convolves multiple input channels each with their own set of convolutional kernels onto multiple output channels. Our approach uses a microlens array to redirect light from a 2D light emitter array through convolutional kernels encoded on an amplitude mask onto a camera. We experimentally test our multi-channel free space optical convolution approach and evaluate its performance using ray-tracing simulations. This work solves a major constraint of existing optical convolutional approaches, as modern convolutional networks use large numbers of input and output channels in convolutional layers.

Conference Presentation

Citation Download Citation

Alexander Song, Sai Nikhilesh Murty Kottapalli, Bernhard Schölkopf, and Peer Fischer "Multi-channel free space optical convolutions with incoherent light", Proc. SPIE PC12903, AI and Optical Data Sciences V, PC129030I (13 March 2024); https://doi.org/10.1117/12.2692291

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available