Recent advances in machine learning have made forged video and audio more convincing. This poses a threat to the security of individuals, societies and nations. To address this threat, the ASVspoof initiative was conceived to spearhead research on Automatic Speaker Verification (ASV) for anti-spoofing. Currently, most research on ASVspoof has focused on detecting whether speech has been tampered with. However, little attention has been paid to the recognition of speech forgery algorithms. Moreover, in the real world, new forgery algorithms keep emerging, making it difficult to adapt forgery algorithm recognition models trained under closed-set conditions to realistic open-set scenarios. Therefore, we propose a method based on prototype learning and adaptive thresholding for recognizing speech forgery algorithms in open-set. The method uses manifold mixup and dummy prototypes to simulate and recognize unknown speech forgery algorithms. Prototype classification improves the ability to recognize speech forgery algorithms with high similarity. At the same time, it has the advantage of preventing catastrophic forgetting and facilitates subsequent incremental training using samples of newly recognized forgery algorithms. Thus, our method increases the number of recognized categories for forgery algorithms. Experimental results show that our method is effective. The codes are available at https://github.com/multimedia-security/open-set-recognization.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.