COVID-19 has caused a myriad of public mental health issues, including distress reactions (sleep disorders, rage, and intense fear), health risks, and diminished perceived health. This study aims to investigate COVID-19 phobia and its impact on quality of life (QoL) in a sample of 306 members of the general population of Saudi Arabia. A descriptive, cross-sectional research design study is conducted, simultaneously, in Saudi Arabia during the COVID-19 pandemic. Data are gathered as online responses to a questionnaire that incorporates a sociodemographic datasheet, COVID-19 experiences, the COVID-19 Phobia Scale (C19P-SE), and the COVID-19 Impact on QoL (COV19-QoL). The results show that the highest percentage of the participants are female, more than two-thirds are aged 20 to 29 years (84% and 68%, respectively), and slightly more than three-quarters have a university education and are single (75.5% and 79.4%, respectively). Furthermore, COVID-19 has a low impact on the highest percentage of participants' QoL, and there is a highly statistically significant direct correlation between COV-19-QoL scores and COVID-19 phobia scores for all factors, which means that an increased impact on QoL is associated with an increased level of coronaphobia. Thus, it is recommended that the development of intervention and psychoeducational programs encompassing different populations in more cities throughout the kingdom is necessary to mitigate the psychological impact of the COVID-19 pandemic.