Beta
336203

A Novel Image-Based Arabic Hand Gestures Recognition Approach Using YOLOv7 and ArSL21L

Article

Last updated: 24 Dec 2024

Subjects

-

Tags

-

Abstract

Recognizing and documenting Arabic sign language has recently received much attention because it enhances communication between deaf persons and normal people. The development of automatic sign language recognition (SLR) systems to allow communication with deaf persons is the primary goal of SLR. Until recently, Arabic SLR (ArSLR) received little attention. Building an automatic Arabic hand gesture recognition system is a challenging task. This work presents a novel image-based ArSL recognition approach where You Only Look Once v7 (YOLOv7) is used to build an accurate ArSL alphabet detector and classifier utilizing ArSL21L: Arabic Sign Language Letter Dataset. The proposed YOLOv7 medium model has achieved the highest mAP0.5 and mAP0.5:0.95 scores of 0.9909 and 0.8306, respectively. It has outperformed not only YOLOv5m but also YOLOv5l in terms of mAP0.5 and mAP0.5:0.95 scores. Furthermore, regarding mAP0.5 and mAP0.5:0.95 scores, the YOLOv7-tiny model has not only surpassed YOLOv5s but additionally YOLOv5m. YOLOv5s, on the other hand, has the lowest mAP0.5 and mAP0.5:0.95 scores of 0.9408 and 0.7661, respectively

DOI

10.21608/fuje.2023.216182.1050

Keywords

Arabic Sign Language Letter Dataset (ArSL21L), Convolutional neural network, YOLOv7, YOLOv5, Arabic Sign Language Recognition (ArSLR)

Authors

First Name

Fatma

Last Name

Mazen

MiddleName

M. A.

Affiliation

Electronics and Communication Engineering Department, Faculty of Engineering, Fayoum University,Fayoum, Egypt

Email

fma04@fayoum.edu.eg

City

-

Orcid

0000-0002-0429-6609

First Name

Mai

Last Name

Ezz-Eldin

MiddleName

-

Affiliation

Electrical Engineering Department, Future High Institute for Engineering, Fayoum, Egypt

Email

mai.ezz@fief.edu.eg

City

-

Orcid

-

Volume

7

Article Issue

1

Related Issue

45522

Issue Date

2024-01-01

Receive Date

2023-06-07

Publish Date

2024-01-01

Page Start

40

Page End

48

Print ISSN

2537-0626

Online ISSN

2537-0634

Link

https://fuje.journals.ekb.eg/article_336203.html

Detail API

https://fuje.journals.ekb.eg/service?article_code=336203

Order

336,203

Type

Original Article

Type Code

651

Publication Type

Journal

Publication Title

Fayoum University Journal of Engineering

Publication Link

https://fuje.journals.ekb.eg/

MainTitle

A Novel Image-Based Arabic Hand Gestures Recognition Approach Using YOLOv7 and ArSL21L

Details

Type

Article

Created At

24 Dec 2024