论文标题
基于分布式神经网络的鸟类物种分类和声学特征选择,并具有两个短期特征的两个阶段窗口
Bird Species Classification And Acoustic Features Selection Based on Distributed Neural Network with Two Stage Windowing of Short-Term Features
论文作者
论文摘要
从音频记录中识别鸟类物种是由于在相同的记录中存在多个物种,背景中的噪声和长期记录,这是具有挑战性的任务之一。此外,从鸟类分类的音频记录中选择适当的声学特征是另一个问题。在本文中,一种混合方法代表了传统的信号处理和一种基于深度学习的方法,可以从各种来源和类型的音频记录中对鸟类进行分类。此外,具有34个不同功能的详细研究有助于选择适当的功能集,以用于实时应用中的分类和分析。此外,拟议的深神经网络同时使用声学和时间特征学习。所提出的方法首先从原始信号检测语音活动,然后使用50 ms(25ms重叠)的时间窗口从处理的记录中提取短期特征。后来,使用第二阶段(非重叠)窗口重塑短期特征,该窗口通过分布式的2D卷积神经网络(CNN)进行训练,该窗口将输出功能转发到长期和短期内存(LSTM)网络。然后,最终的致密层将鸟类分类。对于10类分类器,对于由13个MEL频率sepstral系数(MFCC)和12个色度矢量组成的功能集的最高精度为90.45 \%。相应的特异性和AUC得分分别为98.94 \%和94.09 \%。
Identification of bird species from audio records is one of the challenging tasks due to the existence of multiple species in the same recording, noise in the background, and long-term recording. Besides, choosing a proper acoustic feature from audio recording for bird species classification is another problem. In this paper, a hybrid method is represented comprising both traditional signal processing and a deep learning-based approach to classify bird species from audio recordings of diverse sources and types. Besides, a detailed study with 34 different features helps to select the proper feature set for classification and analysis in real-time applications. Moreover, the proposed deep neural network uses both acoustic and temporal feature learning. The proposed method starts with detecting voice activity from the raw signal, followed by extracting short-term features from the processed recording using 50 ms (with 25ms overlapping) time windows. Later, the short-term features are reshaped using second stage (non-overlapping) windowing to be trained through a distributed 2D Convolutional Neural Network (CNN) that forwards the output features to a Long and Short Term Memory (LSTM) Network. Then a final dense layer classifies the bird species. For the 10 class classifier, the highest accuracy achieved was 90.45\% for a feature set consisting of 13 Mel Frequency Cepstral Coefficients (MFCCs) and 12 Chroma Vectors. The corresponding specificity and AUC scores are 98.94\% and 94.09\%, respectively.