Deep reinforcement learning with artificial microswimmers

Ravi Pradip; Frank Cichos

doi:10.1117/12.2633774

3 October 2022 Deep reinforcement learning with artificial microswimmers

Ravi Pradip, Frank Cichos

Proceedings Volume 12204, Emerging Topics in Artificial Intelligence (ETAI) 2022; 122040F (2022) https://doi.org/10.1117/12.2633774
Event: SPIE Nanoscience + Engineering, 2022, San Diego, California, United States

Abstract

Artificial microswimmers are active particles designed to mimic the behavior of living microorganisms. The adaptive behavior of the latter is based on the experience they gain through interactions with the environment. They are also subjected to Brownian motion at these length scales which randomizes their position and propulsion direction making it a key feature in the adaptation process. However, artificial systems are limited in their ability to adapt to such noise and environmental stimuli. In this work, we combine artificial microswimmers with a reinforcement learning algorithm to explore their adaptive behavior in a noisy environment. These self-thermophoretic active particles are propelled and steered by generating thermal gradients on their surface with a tightly focused laser beam. They are also imaged under a microscope in real-time to monitor their dynamics. With such a versatile platform capable of real-time control and monitoring, we demonstrated the solution to a standard navigation problem under the inevitable influence of Brownian motion by introducing deep reinforcement learning, specifically deep-Q-learning. We also identified different noises in the system and how they affected the learning speed and navigation strategies picked up by the microswimmer.

Conference Presentation

Citation Download Citation

Ravi Pradip and Frank Cichos "Deep reinforcement learning with artificial microswimmers", Proc. SPIE 12204, Emerging Topics in Artificial Intelligence (ETAI) 2022, 122040F (3 October 2022); https://doi.org/10.1117/12.2633774

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available