An ensemble multilingual model for toxic comment classification

Gaofei Xie

doi:10.1117/12.2636419

6 May 2022 An ensemble multilingual model for toxic comment classification

Gaofei Xie

Proceedings Volume 12176, International Conference on Algorithms, Microchips and Network Applications; 121761P (2022) https://doi.org/10.1117/12.2636419
Event: International Conference on Algorithms, Microchips, and Network Applications 2022, 2022, Zhuhai, China

Abstract

The online toxic comments cause enormous harm to the society, where toxicity is defined as anything rude, disrespectful or otherwise likely to make someone leave a discussion. To have a safer, more collaborative internet, grateful contributions are made by a main area of focus on machine learning models to identify toxicity in English, whereas part of misinformation disseminates in other languages. Over the past year, pretraining multilingual language models give rise to impressive gains for cross lingual toxicity classification. This paper presents an approach to build toxicity models applying the Jigsaw Multilingual Toxic Comment Classification dataset provided by Kaggle. We set our ensemble model in three parts based on Besides, we implement subsample, Pseudo-labeling with open-subtitles, translating non-English languages to English language, and Post Processing to improve the classification accuracy indispensably. Our final model achieved an AUC of 0.9469 for the training set and 0.9485 for the validation set, demonstrating the effectiveness of performance under cross-lingual toxicity detectors.

Citation Download Citation

Gaofei Xie "An ensemble multilingual model for toxic comment classification", Proc. SPIE 12176, International Conference on Algorithms, Microchips and Network Applications, 121761P (6 May 2022); https://doi.org/10.1117/12.2636419

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available