Research on the product recommendation algorithm based on PySpark and Jupyter notebook

Yixian Lu; Haoming Wu; Hao Che

doi:10.1117/12.2670415

8 March 2023 Research on the product recommendation algorithm based on PySpark and Jupyter notebook

Yixian Lu, Haoming Wu, Hao Che

Proceedings Volume 12586, Second International Conference on Green Communication, Network, and Internet of Things (CNIoT 2022); 1258613 (2023) https://doi.org/10.1117/12.2670415
Event: Second International Conference on Green Communication, Network, and Internet of Things (CNIoT 2022), 2022, Xiangtan, China

Abstract

Due to the problems caused by the development of the Internet, such as information redundancy and junk information overflow, it is crucial that e-commercial companies utilize recommendation algorithms to personalize their online shopping system for every user in order to promote sales. After discussing the pros and cons of demographic filtering, content-based filtering and collaborative filtering, the authors mainly focused on collaborative filtering. This article elaborated on how to design the collaborative filtering algorithm and improve its efficiency. Compared to other recommendation algorithms, collaborative filtering can help customers discover potential interests. Moreover, the system only needs feedback matrixes to train the matrix decomposition model and requires no additional relevant features. One major defect of collaborative filtering is called cold start, which means if a new item is added during training, the system cannot create embedding and make a prediction for it. The technology called WALS projection can solve this problem to some degree.

Citation Download Citation

Yixian Lu, Haoming Wu, and Hao Che "Research on the product recommendation algorithm based on PySpark and Jupyter notebook", Proc. SPIE 12586, Second International Conference on Green Communication, Network, and Internet of Things (CNIoT 2022), 1258613 (8 March 2023); https://doi.org/10.1117/12.2670415

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available