Beta
317839

A New XAI Evaluation Metric for Classification

Article

Last updated: 04 Jan 2025

Subjects

-

Tags

-

Abstract

Explainable AI (XAI) has become a hot topic

across multiple sectors. In practical applications, classification

models are severely constrained by the absence of

transparency, which undermines trust and has a black-box

nature, leading to a range of problems. Classification models

necessitate the use of XAI approaches to address these

limitations effectively. The Mean Evaluation of Metrics

Change (MEMC) is a novel metric introduced in this research

for evaluating the performance of Explainable AI techniques

on a global scale, like post-hoc and intrinsic XAI for

classification techniques on tabular data. The

proposed MEMC metric is formed from a combination of the

existing standard evaluation measures used for evaluating

classification. The proposed MEMC has proven to be the

convenient metric for determining the best explainer for a

produced classification. The proposed MEMC metric is

validated using a heart dataset from the healthcare sector. The

experimental results show that the Artificial Neural Network

(ANN) approach performed effectively on the heart dataset as

an intrinsic XAI in machine learning. Deep Neural Network

(DNN) also performs better as an intrinsic XAI technique

when applied to this dataset. Furthermore, ANCHORS has

shown strong performance as a post-hoc XAI technique when

Random Forest (RF) and XG-Boost are used as classification

models.

DOI

10.21608/ijci.2023.236156.1132

Keywords

Explainable AI (XAI), MEMC, Intrinsic XAI, Post-hoc XAI, Anchors

Authors

First Name

Asmaa

Last Name

M El-gezawy

MiddleName

M

Affiliation

information systems, faculty of computers and information, menoufia university, shebin-elkom, EL-menoufia

Email

asma.elgezawy@gmail.com

City

Tanta

Orcid

-

First Name

Hatem

Last Name

Abdel-Kader

MiddleName

-

Affiliation

Information SystemsDepartment Faculty of Computers and Information Menoufia University, Egypt

Email

hatem.abdelkader@ci.menofia.edu.eg

City

-

Orcid

-

First Name

Asmaa

Last Name

Ali

MiddleName

H

Affiliation

Information System, faculty of computer and information, Menoufia University, Shebin El Kom, Menofia, Egypt

Email

asmaa.elsayed@ci.menofia.edu.eg

City

Shebin elkom

Orcid

-

Volume

10

Article Issue

3

Related Issue

43466

Issue Date

2023-11-01

Receive Date

2023-09-18

Publish Date

2023-11-01

Page Start

58

Page End

62

Print ISSN

1687-7853

Online ISSN

2735-3257

Link

https://ijci.journals.ekb.eg/article_317839.html

Detail API

https://ijci.journals.ekb.eg/service?article_code=317839

Order

9

Type

Original Article

Type Code

877

Publication Type

Journal

Publication Title

IJCI. International Journal of Computers and Information

Publication Link

https://ijci.journals.ekb.eg/

MainTitle

A New XAI Evaluation Metric for Classification

Details

Type

Article

Created At

24 Dec 2024