Beta
160439

Arabic Automatic Speech Recognition Based on Emotion Detection

Article

Last updated: 24 Dec 2024

Subjects

-

Tags

-

Abstract

This work presents a novel emotion recognition via automatic speech recognition (ASR) using a deep feed-forward neural network (DFFNN) for Arabic speech. We present results for the recognition of the three emotions happy, angry, and surprised. The Arabic natural audio dataset (ANAD) is used. Twenty-five low-level descriptors (LLDs) are extracted from the audio signals. Different combination of extracted features is examined. Also, the effect of using the principal component analysis (PCA) technique for dimensionality reduction is examined. For the classification stage, DFFNN is used. Also, the problem of imbalances samples in the dataset is managed by using the borderline-synthetic minority over-sampling technique (B-SMOTE). It is shown from the results that the best accuracy is obtained when applying PCA on the extracted features is 98.56 %. Also, the accuracy is 98.33 % when using the combination of all the extracted features. This result is not too much different from the accuracy of using PCA. It is followed by the accuracy of using MFCC and LSF which is 97.79 %. It is noticed that the accuracy is 95.63 % when using LSF features which shows that they are dominant features. The obtained results showed an improvement compared to previous studies.

DOI

10.21608/ejle.2020.49690.1016

Keywords

Arabic speech emotion recognition, Arabic natural audio dataset, deep feed-forward neural network, borderline- synthetic minority over-sampling technique, PCA

Authors

First Name

Engy

Last Name

Abdelmaksoud

MiddleName

Ragaei

Affiliation

Basic science, Faculty of Computers and Informayion, Fayoum University

Email

era00@fayoum.edu.eg

City

Fayoum

Orcid

-

Volume

8

Article Issue

1

Related Issue

23421

Issue Date

2021-04-01

Receive Date

2020-11-13

Publish Date

2021-04-01

Page Start

17

Page End

26

Print ISSN

2356-8208

Online ISSN

2356-8216

Link

https://ejle.journals.ekb.eg/article_160439.html

Detail API

https://ejle.journals.ekb.eg/service?article_code=160439

Order

2

Type

Original Article

Type Code

1,039

Publication Type

Journal

Publication Title

The Egyptian Journal of Language Engineering

Publication Link

https://ejle.journals.ekb.eg/

MainTitle

Arabic Automatic Speech Recognition Based on Emotion Detection

Details

Type

Article

Created At

22 Jan 2023