TIMIT and NTIMIT phone recognition using convolutional neural networks - Télécom Paris Access content directly
Book Sections Year : 2019

TIMIT and NTIMIT phone recognition using convolutional neural networks


A novel application of convolutional neural networks to phone recognition is presented in this paper. Both the TIMIT and NTIMIT speech corpora have been employed. The phonetic transcriptions of these corpora have been used to label spectrogram segments for training the convolutional neural network. A sliding window extracted fixed sized images from the spectrograms produced for the TIMIT and NTIMIT utterances. These images were assigned to the appropriate phone class by parsing the TIMIT and NTIMIT phone transcriptions. The GoogLeNet convolutional neural network was implemented and trained using stochastic gradient descent with mini batches. Post training, phonetic rescoring was performed to map each phone set to the smaller standard set, i.e. the 61 phone set was mapped to the 39 phone set. Benchmark results of both datasets are presented for comparison to other state-of-the-art approaches. It will be shown that this convolutional neural network approach is particularly well suited to network noise and the distortion of speech data, as demonstrated by the state-of-the-art benchmark results for NTIMIT.
No file

Dates and versions

hal-02287997 , version 1 (13-09-2019)



Cornelius Glackin, Julie Wall, Gérard Chollet, Nazim Dugan, Nigel Cannings. TIMIT and NTIMIT phone recognition using convolutional neural networks. International Conference on Pattern Recognition Applications and Methods, Springer, pp.89-100, 2019, 978-3-030-05499-1. ⟨10.1007/978-3-030-05499-1_5⟩. ⟨hal-02287997⟩
119 View
0 Download



Gmail Facebook X LinkedIn More