Beta
309318

Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability

Article

Last updated: 24 Dec 2024

Subjects

-

Tags

-

Abstract

Generative adversarial networks (GANs) are a powerful deep learning model for synthesizing realistic images; however, they can be difficult to train and are prone to instability and mode collapse. This paper presents a modified deep learning model called Identity Generative Adversarial Network (IGAN) to address the challenges of training and instability faced by generative adversarial models in synthesizing realistic images. The IGAN model includes three modifications to improve the performance of DCGAN: a non-linear identity block to ease complex data fitting and reduce training time; a modified loss function with label smoothing to smooth the standard GAN loss function; and minibatch training to use other examples from the same minibatch as side information for better quality and variety of generated images. The effectiveness of IGAN was evaluated and compared with other state-of-the-art generative models using the inception score (IS) and Fréchet inception distance (FID) on CelebA and stacked MNIST datasets. The experiments demonstrated that IGAN outperformed the other models in terms of convergence speed, stability, and diversity of results. Specifically, in 200 epochs, IGAN achieved an IS of 13.6 and an FID of 46.2. Furthermore, the IGAN collapsed modes were compared with other generative models using a stacked MNIST dataset, showing the superiority of IGAN in producing all the modes while the other models failed to do so. These results demonstrate that the modifications implemented in IGAN can significantly enhance the performance of GANs in synthesizing realistic images, providing a more stable, high-quality, and diverse output.

DOI

10.21608/ijci.2023.200402.1101

Keywords

Generative adversarial network, Deep learning, mode collapse, label smoothing, identity block

Authors

First Name

Mohamed

Last Name

salem

MiddleName

Fathallah

Affiliation

Department of Computer Science, Faculty of Computers and Information, Kafr El-Sheikh University, Kafr El-Sheikh 33511, Egypt

Email

mohamedfathallah777@gmail.com

City

-

Orcid

0000-0003-4382-9217

First Name

Mohamed

Last Name

Sakr

MiddleName

-

Affiliation

Department of Computer Science, Faculty of Computers and Information, Menoufia University, Menoufia 32511, Egypt

Email

mohamed.sakr@ci.menofia.edu.eg

City

-

Orcid

-

First Name

Sherif

Last Name

eletriby

MiddleName

-

Affiliation

Department of Computer Science, Faculty of Computers and Information, Menoufia University, Menoufia 32511, Egypt

Email

sherif.eletriby@ci.menofia.edu.eg

City

-

Orcid

0000-0001-8103-3071

Volume

10

Article Issue

2

Related Issue

42584

Issue Date

2023-09-01

Receive Date

2023-03-15

Publish Date

2023-09-01

Page Start

66

Page End

79

Print ISSN

1687-7853

Online ISSN

2735-3257

Link

https://ijci.journals.ekb.eg/article_309318.html

Detail API

https://ijci.journals.ekb.eg/service?article_code=309318

Order

7

Type

Original Article

Type Code

877

Publication Type

Journal

Publication Title

IJCI. International Journal of Computers and Information

Publication Link

https://ijci.journals.ekb.eg/

MainTitle

Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability

Details

Type

Article

Created At

24 Dec 2024