计算机与现代化 ›› 2022, Vol. 0 ›› Issue (03): 13-17.

• 人工智能 • 上一篇    下一篇

基于非线性堆叠双向网络的端到端声纹识别

  

  1. (1.西安工程大学电子信息学院,陕西西安710699; 2.西北工业大学航海学院,陕西西安710072)
  • 出版日期:2022-04-29 发布日期:2022-04-29
  • 作者简介:王芷悦(1998—),女,安徽临泉人,硕士研究生,研究方向:语音信号处理,深度学习,E-mail: 864940295@qq.com; 崔琳(1984—),女,内蒙古包头人,硕士生导师,博士,研究方向:信号与信息处理,语音信号处理,阵列信号处理,E-mail: cuilin789@163.com。
  • 基金资助:
    国家自然科学基金青年项目(61901347)

End to End Voiceprint Recognition Based on Nonlinear Stacked Bidirectional Network

  1. (1.School of Electronic Information, Xi’an Polytechnic University, Xi’an 710699, China;
    2.School of Marine Science and Technology, Northwestern Polytechnical University, Xi’an 710072, China)
  • Online:2022-04-29 Published:2022-04-29

摘要: 传统声纹识别方法过程繁琐且识别率低,现有的深度学习方法所使用的神经网络对语音信号没有针对性从而导致识别精度不够。针对上述问题,本文提出一种基于非线性堆叠双向LSTM的端到端声纹识别方法。首先,对原始语音文件提取出Fbank特征用于网络模型的输入。然后,针对语音信号连续且前后关联性强的特点,构建双向长短时记忆网络处理语音数据提取深度特征,为进一步增强网络的非线性表达能力,利用堆叠多层双向LSTM层和多层非线性层实现对语音信号更深层次抽象特征的提取。最后,使用SGD优化器优化训练方式。实验结果表明提出的方法能够充分利用语音序列信号特征,具有较强的时序全面性和非线性表达能力,所构造模型整体性强,比GRU和LSTM等模型具有更好的识别效果。

关键词: 声纹识别, 端到端, 时序特征, 长短时记忆, 堆叠网络, 非线性

Abstract: The traditional voiceprint recognition method is cumbersome and has a low recognition rate. The neural network used in the existing deep learning method is not specific to the speech signal, resulting in insufficient recognition accuracy. To solve the above problems, this paper proposes an end-to-end voiceprint recognition method based on nonlinear stacked bidirectional LSTM. Firstly, the Fbank features are extracted from the original voice files for the input of the network model. Then, in view of the continuous and strong relevance of the voice signal, a bidirectional long and short-term memory network is constructed to process the voice data to extract deep features. In order to further enhance the nonlinear expression ability of the network, stacking multi-layer bidirectional LSTM layer and multi-layer nonlinear layer are used to extract the deeper abstract features of the speech signal. Finally, the SGD optimizer is used to optimize the training mode. The experimental results show that the proposed method can make full use of the characteristics of the speech sequence signal and has strong time series comprehensiveness and nonlinear expression ability. The constructed model has strong integrity and better recognition effect than GRU and LSTM models.

Key words: voiceprint recognition, end to end, sequential characteristic, long short-term memory, stacked network, nonlinear