An improved memristor-based 3D convolutional neural network for action recognition

Yining Wang; Ke Li; Siyuan Shen; Shukai Duan

doi:10.1117/12.2681142

8 June 2023 An improved memristor-based 3D convolutional neural network for action recognition

Yining Wang, Ke Li, Siyuan Shen, Shukai Duan

Proceedings Volume 12707, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023); 127071U (2023) https://doi.org/10.1117/12.2681142
Event: International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023), 2023, Changsha, China

Abstract

The Memristor has become one of the best devices for hardware realization of neural networks due to its nanometer size, low power consumption, fast reading and writing speed, and variable resistance. This paper proposes a memristor crossbar structure for processing 3D convolutional neural networks, which can realize the function of action recognition. The 3D convolutional neural network can extract features from the space and temporal dimensions simultaneously, thereby obtaining the coding information in multiple adjacent frames, and is widely used in video processing. At the same time, based on the advantages of the 3×3×3 convolution kernel, we built a memristor crossbar to realize the function of video recognition. This structure has good flexibility and anti-interference ability and can reduce floor space. Finally, we implemented the network on the Weizmann datasets and achieved 85% accuracy. The results show that the Memristor can realize the task of classifying human action behaviours and can realize more extensive and complex neural networks to process complex applications.

Citation Download Citation

Yining Wang, Ke Li, Siyuan Shen, and Shukai Duan "An improved memristor-based 3D convolutional neural network for action recognition", Proc. SPIE 12707, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023), 127071U (8 June 2023); https://doi.org/10.1117/12.2681142

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Action recognition

Convolution

Neural networks

Convolutional neural networks

3D image processing

Artificial neural networks

Show All Keywords

Keywords/Phrases

Search In:

Publication Years