Beta
376718

Virtual Keyboard-Mouse in Real-Time using Hand Gesture and Voice Assistant

Article

Last updated: 27 Dec 2024

Subjects

-

Tags

Image & speech Processing

Abstract

The development of computer applications has made our daily tasks more convenient and efficient. One of the latest trends in this area is the integration of voice assistants and virtual input devices. This approach is particularly useful for individuals with mobility impairments or for situations where manual interaction with a computer is not possible. The application of computer vision and AI technologies has made this possible. Computer vision enables machines to interpret and understand visual data, such as the movements of the human body, while AI provides the decision-making abilities required to execute commands based on the input received. The integration of voice assistants and virtual input devices into computer applications has the potential to revolutionize the way we interact with technology. The combination of computer vision and AI technologies is driving this innovation, and it will be interesting to see how it continues to evolve in the future. This desktop application offers a comprehensive solution for users seeking a more accessible and efficient computing experience. By integrating a voice assistant, virtual mouse, and virtual keyboard, it enables individuals with physical disabilities or those preferring alternative input methods to fully utilize their computers, improving productivity and enhancing their overall digital experience. We use Python, Media Pipe, and OpenCV. The Media-Pipe library provides features that boost the model's efficacy and is especially useful for AI projects. The user will be able to control the computer cursor using different hand gestures, type on the virtual keyboard while holding colored caps or tapes and left-click and drag items.

DOI

10.21608/asc.2024.376718

Keywords

Hand Gesture, virtual mouse, virtual keyboard, Voice Assistant

Authors

First Name

shimaa

Last Name

Osman

MiddleName

-

Affiliation

Higher Institute of Computers and Information Technology, Computer Depart., El. Shorouk Academy, Cairo, Egypt

Email

dr.shimaa.osman@sha.edu.eg

City

-

Orcid

-

Volume

15

Article Issue

1

Related Issue

50083

Issue Date

2024-06-01

Receive Date

2024-08-28

Publish Date

2024-06-01

Page Start

13

Page End

24

Print ISSN

1687-8515

Online ISSN

2682-3578

Link

https://asc.journals.ekb.eg/article_376718.html

Detail API

https://asc.journals.ekb.eg/service?article_code=376718

Order

1

Type

Original Article

Type Code

1,549

Publication Type

Journal

Publication Title

Journal of the ACS Advances in Computer Science

Publication Link

https://asc.journals.ekb.eg/

MainTitle

Virtual Keyboard-Mouse in Real-Time using Hand Gesture and Voice Assistant

Details

Type

Article

Created At

27 Dec 2024