Publication:
An auditory saliency pooling-based LSTM model for speech intelligibility classification

Loading...
Thumbnail Image

Advisors

Tutors

Editor

Publication date

Defense date

Journal Title

Journal ISSN

Volume Title

Publisher

MDPI

publication.page.ispartofseries

Impact
Google Scholar
Export

Research Projects

Research Projects

Organizational Units

Journal Issue

To cite this item, use the following identifier: https://hdl.handle.net/10016/33706

Abstract

Speech intelligibility is a crucial element in oral communication that can be influenced by multiple elements, such as noise, channel characteristics, or speech disorders. In this paper, we address the task of speech intelligibility classification (SIC) in this last circumstance. Taking our previous works, a SIC system based on an attentional long short-term memory (LSTM) network, as a starting point, we deal with the problem of the inadequate learning of the attention weights due to training data scarcity. For overcoming this issue, the main contribution of this paper is a novel type of weighted pooling (WP) mechanism, called saliency pooling where the WP weights are not automatically learned during the training process of the network, but are obtained from an external source of information, the Kalinli’s auditory saliency model. In this way, it is intended to take advantage of the apparent symmetry between the human auditory attention mechanism and the attentional models integrated into deep learning networks. The developed systems are assessed on the UA-speech dataset that comprises speech uttered by subjects with several dysarthria levels. Results show that all the systems with saliency pooling significantly outperform a reference support vector machine (SVM)-based system and LSTM-based systems with mean pooling and attention pooling, suggesting that Kalinli’s saliency can be successfully incorporated into the LSTM architecture as an external cue for the estimation of the speech intelligibility level.

Note

This article belongs to the Section Computer and Engineering Science and Symmetry/Asymmetry.

Bibliographic citation

Gallardo-Antolín, A. & Montero, J. M. (2021a). An Auditory Saliency Pooling-Based LSTM Model for Speech Intelligibility Classification. Symmetry, 13(9), 1728.

Table of contents

Has version

Is version of

Related dataset

Related Publication

Is part of

Collections