Psychometric Properties and Factor Structure of the Hamilton Anxiety Rating Scale among Korean University Students during COVID-19
Abstract
Background
The Hamilton Anxiety Rating Scale (HAM-A) is a 14-item instrument that is extensively used in clinical and epidemiological studies to determine the presence of anxiety symptoms. Despite the widespread application of the HAM-A in research, it remains unclear whether the instrument’s construct is best represented as uni- or multidimensional. This study aimed to assess the reliability and construct validity of the Korean version of the HAM-A through its factor structure.
Methods
Accordingly, a cross-sectional design was employed to conduct an online survey with 252 university students enrolled in an undergraduate degree program for 4 years in South Korea during the recent coronavirus (COVID-19) pandemic. Confirmatory factor analyses (CFAs) were employed to identify the two-factorial structure of the instrument, i.e., psychic/psychological and somatic.
Results
The results revealed that the reliability and item characteristics were favorable. Confirmatory factor analyses identified a two-factorial structure of psychic/psychological and somatic with a moderate correlation between the two latent constructs, thus suggesting a single overarching construct of anxiety.
Conclusion
Our findings suggest that the Korean version of HAM-A was found to be a valid and reliable instrument that can be employed to screen Korean university students for anxiety.
1. INTRODUCTION
Anxiety disorders, which are characterized primarily by excessive fear and worry, are the most common set of psychiatric disorders and are known to have considerable individual and societal costs [1]. According to the DSM-5, anxiety disorders include generalized anxiety disorder, panic disorder, social anxiety disorder, separation anxiety disorder, selective mutism, and specific phobias [2]. If left untreated, anxiety disorders may become chronic and be associated with cognitive impairment, depression, disability, and poor quality of life [3]. In South Korea, the estimated lifetime prevalence of anxiety disorders was 9.3% and the annual prevalence rate in 2021 was 3.1%. While the highest prevalence occurred in those between 18 and 29 years of age, anxiety disorders were more common in females (4.7%) than in males (1.6%) [4].
Students can experience emotional and academic challenges when they enroll in university programs because they must adapt to a new learning environment, manage tuition fees, assume self-responsibility, develop a career, and attain independence [5]. Although the developmental period of emerging adulthood may be regarded as a period of personal growth, it can also be marked by increased vulnerability and distress. In comparison to other adult age groups, self-reported mental health issues are most prevalent among young adults between the ages of 18 and 29 [6, 7]. Thus, emerging adulthood may present significant mental health risks. Adams et al. [6] found that mental health issues that affect university students include depression, anxiety, and substance abuse. Furthermore, it has become increasingly apparent that the outbreak of the pandemic has posed a threat to university students’ mental health. Because of the mandatory physical distancing measures associated with the pandemic, many students have been confronted with additional challenges, including campus closures and online and distance learning, which have led to a sense of uncertainty related to academic success as well as increasing fear about the uncertainty of their overall learning [8].
The COVID-19 pandemic made anxiety among university students a growing global public concern. Some studies conducted in Korea have also examined the impact of the pandemic on the psychological states of university students. Jung et al. [9] revealed that 20% of a sample of 209 university students experienced severe stress, anxiety, and depression due to COVID-19. Chen et al. [10] found that Korean students decreased their daily activities, visited fewer places, suffered more worry, and reported low levels of happiness. The anxieties experienced by university students are characteristically related to academic failure, criticism, and physical appearance [11]. Therefore, they could differ from the types of anxiety sensed by other general populations including adolescents and older adults, or by vulnerable populations such as clinical patients. Thus, it is imperative to devise accurate screening tools for anxiety disorders to assess the anxieties experienced by university students. These screening instruments would facilitate early intervention in mental health settings on campuses. However, scant screening tools designed to detect the presence and severity of anxiety symptoms exist in Korea owing to the paucity of psychometric validation research [12].
The 14-item Hamilton Anxiety Rating Scale (HAM-A) was developed by Hamilton in 1959 to detect symptoms of anxiety in clinical populations [13]. HAM-A has since been translated into several languages in different cultures. Available studies have attested to the instrument’s robust psychometric properties, including excellent reliability and construct validity in multicultural populations [14-16], psychiatric patients [17, 18] and adolescents [19]. Although the HAM-A is beneficial in determining anxiety in clinical and nonclinical samples, there is no clear consensus about the instrument’s factor structure. While some studies have demonstrated that data favored an optimal two-factor structure [14, 16, 19], others have recommended an optimal three-factor structure [17, 18]. Somatic anxiety symptoms constitute a separate factor in two- and three-factor structures. However, anxiety and depressive symptoms have either represented a unitary factor in two-factor models or denoted as distinctive factors in three-factor models [18].
These differences, however, have partially been due to the use of specific subgroups of individuals that may limit generalizability. Given the controversial conclusions of international studies in relation to the dimensionality of the HAM-A, its factor structure warrants further examination. Moreover, despite the relatively high prevalence of anxiety disorders among university students, this instrument has not been employed among Korean university students. Furthermore, no study to date has examined the factor structure among Korean populations. Accordingly, the purpose of this study was to provide a comprehensive validation of the HAM-A for Koreans. Specifically, the objectives of the study were: (1) to explore the factor structure of the Korean version of HAM-A by employing confirmatory factor analysis (CFA) and (2) to examine the reliability of the Korean version of the HAM-A among Korean university students.
2. METHODS
2.1. Participants
Convenience sampling was employed to recruit 252 university students (80 male and 172 female) from a four-year university in a central region of Korea. Specifically, the participants were recruited from the Department of Culinary Arts, Child Education, Social Work, and Public Health. The mean age of the sample was 20.6 (SD = 4.68) and that of the male and female participants was 20.2 (SD = 2.31) and 20.8 (SD = 5.44), respectively.
2.2. Procedures
After obtaining research ethical approval ((Protocol Code: 1041549-230117-SB-155), an online cross-sectional survey was conducted during the COVID-19 pandemic between December 26, 2022 and May 1, 2023. Google platform was employed to conduct the survey. An anonymous survey invitation and its link were sent via email to instructors in the university’s different faculties who subsequently forwarded it to their students. The purpose of the study as well as its voluntary and confidential nature were explained in the email. Before completing the survey, the participants were required to provide consent online. The survey was accessible for a four-week period and thereafter automatically disabled. However, two reminders were emailed to potential participants during this time.
2.3. Instrument
The HAM-A is a 14-item instrument developed to measure the severity of anxiety. Each item is evaluated on a five-point Likert-type scale, ranging from 0 (symptoms not present) to 4 (very severe symptoms). The total HAMA score ranges from 0 to 56 points, with scores above 30 indicating severe anxiety symptoms. While a score between 0 and 14 is indicative of mild anxiety, a score between 18 and 24 suggests moderate anxiety and one greater than 24 severe anxiety. Half of the items (items 1 to 6 and 14) address psychic/psychological anxiety, that is, mental agitation and psychological distress whereas the remaining seven items (items 7 to 13) measure somatic anxiety, namely, physical complaints related to anxiety. The Korean version of HAM-A, as translated and validated by Kim [20], was employed in this study
2.4. Statistical Analyses
IBM SPSS Statistics (Version 23.0) was employed to perform all the statistical analyses. The CFA was conducted in IBM AMOS 20. Prior to the analyses, the data for the 14 items of the HAM-A were examined for any deviations from missing values and normality. The items’ missing values were replaced by employing expectation maximization. The number of missing value was less than 1% of the total number of cases. The overall response rate was 97% (252 of 260). Cronbach’s alpha (ɑ) was used to evaluate the internal consistency reliability.
Subsequently, covariance matrices and the maximum likelihood estimation method were employed to conduct CFA. The CFA examined three models: (1) a unidimensional model, with all 14 anxiety items loaded as the single latent variable (2), the original two-factor model developed by Hamilton [13], with seven psychic anxiety items loaded on one factor and seven somatic anxiety items loaded on another and (3) a correlated three-factor model proposed by Leentjens et al. [17], with separate anxiety, depression, and somatic symptoms as the latent variables. The models were deemed acceptable if they met the following goodness-of-fit criteria: the chi-square test divided by degrees of freedom (χ2/DF) < 5 [21]; a comparative fit index (CFI) of ≥ .90; a goodness-of-fit index (GFI) of ≥ .90; a root mean square error of approximation (RMSEA) of ≤ .060 and its 90% confidence interval (90% CI); a standardized root mean square residual (SRMR) of ≤ .080 [21, 22]; and Akaike’s information criterion (AIC). Plausible models were compared, with lower values indicating a better model fit.
Although no clear consensus has been reached regarding the acceptable sample size for factor analysis. One suggested guideline is to use the ratio of 10:1 (sample to variable ratio) [23], while other studies have indicated that n >200 is an adequate sample size for CFA [24]. Our sample was large enough for the intended analysis since the n of 252 for 14 items meets both the n > 200 and 10:1 requirements.
3. RESULTS
3.1. Descriptive Statistics
The mean scores and standard deviations for the individual HAM-A item scores are displayed in Tables 1 and 2. The participants’ mean total score was 9.25 (SD = 8.68), suggesting that overall they suffered mild symptoms of anxiety. While the highest average score was achieved for the psychic/ psychological anxiety scale, the lowest average score was obtained for the somatic anxiety scale.
3.2. Confirmatory Factor Analysis
The CFA results of the three models are summarized in Table 3. CFA was performed with the one-, two-, and three-factor models to examine the theoretical foundation of the HAM-A. Of the three theoretical models, the one-factor model had the poorest fit, with values for CFI, GFI, RMSEA, and SRMR that were outside the recommended cut-offs (χ2 = 385.2, df = 77; χ2 /df = 5.0; CFI = 0.81; GFI = 0.85; RMSEA = 0.126 (90% CI =.114–.139); SRMR = 0.804). The original two-factor model recommended by Hamilton better fit the data as the chi-square value; further, the CFI, GFI, RMSEA, and SRMR statistics significantly improved and all statistical values were incorporated within the good fit range (χ2 = 168.3, df = 74; χ2 /df = 2.3; CFI = 0.94; GFI = 0.97; RMSEA = 0.056 (90% CI = 0.049– 0.072); SRMR = 0.050). The two factors were moderately correlated (0.52). Finally, the three-factor model did not fit the data as well as both the two factor models (χ2 = 242.7, df = 76; χ2 /df = 3.2; CFI = 0.89; GFI = 0.92; RMSEA = 0.091 (90% CI = 0.098– 0.109); SRMR = 0.074). Thus, the original two-factor model was the best-fitting model. In this model, factor loadings for the HAM-A items ranged from 0.44 to 0.79. The AIC of 230.3, which was lower than the other models tested in the study, further confirmed the superior fit of Hamilton’s two-factor model. Overall, the two-factor model provided the best fit for the data obtained in our study.
Item | M | SD |
---|---|---|
1. Anxious mood | 1.22 | 1.08 |
2. Tension | 1.34 | 1.19 |
1. Fears | .76 | .97 |
2. Insomnia | .93 | 1.17 |
3. Intellectual | .80 | 1.05 |
4. Depressed mood | .88 | 1.07 |
5. Somatic (Muscular) | .55 | .91 |
6. Somatic (Sensory) | .52 | .90 |
7. Cardiovascular symptoms | .23 | .60 |
8. Respiratory symptoms | .13 | .48 |
9. Gastrointestinal symptoms | .62 | .64 |
10. Genitourinary symptoms | .25 | .66 |
11. Autonomic symptoms | .50 | .90 |
12. Behavior at interview | .51 | .88 |
Total score | 9.25 | 8.68 |
Model | k | χ2 | df | χ2/df | CFI | GFI | RMSEA (90% CI) | SRMR | AIC |
---|---|---|---|---|---|---|---|---|---|
Model 1 | 14 | 385.2 | 77 | 5.0 | .81 | .85 | .126 (.117-.139) | .080 | 441.2 |
Model 2 | 14 | 168.3 | 74 | 2.3 | .94 | .97 | .056 (.049-.072) | .050 | 230.3 |
Model 3 | 14 | 242.7 | 76 | 3.2 | .89 | .92 | .091 (.081-.109) | .074 | 300.7 |
*p < .01.
Model 1 is a one-factor model.
Model 2 is based on Hamilton’s two-factor model.
Model 3 is based on Rodriguez-Seijas et al.’s three-factor model.
- | Factor 1 | Factor 2 |
---|---|---|
1. Anxious mood | .67 | - |
2. Tension | .49 | - |
3. Fears | .52 | - |
4. Insomnia | .60 | - |
5. Intellectual | .79 | - |
6. Depressed mood | .71 | - |
7. Somatic (Muscular) | - | .52 |
8. Somatic (Sensory) | - | .73 |
9. Cardiovascular symptoms | - | .44 |
10. Respiratory symptoms | - | .46 |
11. Gastrointestinal symptoms | - | .52 |
12. Genitourinary symptoms | - | .57 |
13. Autonomic symptoms | - | .69 |
14. Behavior at interview .58 | .58 | - |
Factor 1 = Psychic/ Psychological items; Factor 2 = somatic items.
3.3. Reliability and Item Analysis
Cronbach’s alpha coefficients were employed to assess reliability. Item properties were assessed in accordance with corrected-item-total correlations and coefficients and variations in Cronbach’s alpha coefficients if items had been deleted. Cronbach’s alpha (ɑ) of all 14 items of the HAM-A and two factors were .90, .88, and .82, respectively. Correcteditem–total correlations for individual HAM-A items ranged from 0.44 to 0.72. The obtained Cronbach’s alpha coefficients if the item was deleted were found to be high (>0.80), and the alpha did not substantially change by more than 0.05 with the exclusion of any item.
4. DISCUSSION
This study examined the construct validity of the HAM-A 14 by exploring the instrument’s factor structure with a sample of Korean university students. The HAM-A exhibited satisfactory internal consistency and construct validity, thus revealing its utility for measuring anxiety in this population. This is the first study in which factor analytic findings for the HAM-A have been provided in a nonclinical sample in Korea. The Korean university students who completed the survey belonged to the frequently studied group who suffer myriad stressors, including university transition, academic demands independence/autonomy, intimate relationships, and responsibility that can lead to anxiety [25]. It is imperative that more effort needs to be expended to detect anxiety and implement treatment among university students timeously because they are particularly at risk for psychiatric disorders in comparison to other adult age groups [6, 7].
The study results on the scale’s dimensionality suggest a two-factor structure for the HAM-A as evidenced by CFA. These findings concur with previous findings that the HAM-A is best understood as a multidimensional factor structure [14, 16-19], representing the psychic/ psychological and somatic dimensions of anxiety (i.e., the two-factor model). Moreover, the results of exploring the HAM-A factor structure were similar to those of studies that have included general adult populations [18, 20]. Although this study’s findings challenge Leentjens et al.’s assertion that a unidimensional or one-factor model was a better fit than two- or three-factor models, these contra- dictory findings may be attributed to the fact that the student sample in this study may have differed significantly from clinical samples of Parkinson’s disease in Leentjens et al. [17].
Classifying anxiety into the two separate factors of the psychic/psychological and somatic moderately correlated constructs may provide a useful model to investigate the impact of interventions for anxiety such as psycho- pharmacological treatment [16]. Although the medication could have an effect on the psychological dimension of anxiety, it may not affect the cognitive dimension of anxiety. An exploration of how different therapeutic dimensions of anxiety may facilitate a comprehensive understanding of effective treatment, identify predictors of relapse, enhance the identification of individuals at increased risk, and inform new approaches to prevent it or discontinue treatment [16].
Regarding estimates of internal consistency for the HAM-A, the scale scores were in the good to excellent range. In particular, the high estimates of internal consistency reliability for the two scales and total scores in both community and clinical samples have ranged between good and excellent and concur with those reported for the HAM-A [14-18]. These findings suggest that the HAM-A exhibits good internal consistency across different populations and languages. Simultaneously, with the exception of Cronbach’s alpha of individual items, the coefficient values were lower than the total coefficient value. This indicates that removing any item may decrease the overall credibility value of the scale. Thus, one may deduce that each item of the HAM-A scale is essential and of equal importance to assess the symptoms of anxiety in Korean university students.
Although the prevalence of anxiety was relatively higher in this study than that reported in nonclinical samples [26, 27], it was lower than that of a clinical sample of patients [28, 29]. Because our online survey was conducted during the COVID-19 pandemic in Korea when the campus was closed and social distancing restrictions were still in place, this is expected. The stresses and restrictions associated with the pandemic may have caused many students to suffer heightened levels of anxiety. However, these findings should be cautiously interpreted with due consideration to the prevalence of COVID-19 in Korea when the data for the study were collected.
This study has several limitations. First, as our sample consisted of undergraduate students, it is not clear whether the pattern of findings and the factorial structure can be generalized across populations of different ages and backgrounds. Also, it is uncertain whether our findings can be generalizable over time even after the pandemic. Although our study supported the two-factor model of the HAM-A as a valid and reliable measure for young adults, the competing two-factor models may be more feasible for other populations. Nevertheless, future research must replicate the study across diverse samples. Second, a cross-sectional design was employed in this study and thus, a causal relationship could not be determined. Prospective follow-up studies may help to address the issues of causality. Third, because the data had to be collected by means of an online survey due to COVID-19, those without internet access may have been unable to participate [8]. However, as the target population was university students, this limitation possibly only influenced the results slightly.
CONCLUSION
The factor structure of the Korean version of the HAM-A was explored so as to provide more empirical data for the development of the HAM-A and the advancement of mental health measurement. The findings support Hamilton’s original theoretical model that revealed two distinct categories of psychic/psychological and somatic symptoms. The items of the Korean version of HAM-A were also found to have high internal consistency and be psychometrically sound. The availability of the Korean version of the HAM-A for clinical and campus outreach screening can enhance the identification of students who need assistance.
ABBREVIATIONS
CFAs | = Confirmatory factor analyses |
HAM-A | = Hamilton Anxiety Rating Scale |
ETHICS APPROVAL AND CONSENT TO PARTICIPATE
The research ethical was approved by Woosong University, South Korea (Protocol Code: 1041549-230117-SB-155).
HUMAN AND ANIMAL RIGHTS
No animals were used that are the basis of this study. All procedures performed in studies involving human participants were in accordance with the ethical standards of institutional and/or research committees and with the 1975 Declaration of Helsinki, as revised in 2013.
CONSENT FOR PUBLICATION
Informed consent was obtained from all participants of this study.
STANDARDS OF REPORTING
STROBE guidelines were followed.
AVAILABILITY OF DATA AND MATERIALS
The research data supporti ng the fi ndings of this study will be available upon request from corresponding author [B.L].
FUNDING
The research was funded by Woosong University (Grant number: 2023031-1922-15-WB).
CONFLICT OF INTEREST
The authors declare no conflict of interest financial or otherwise.
ACKNOWLEDGEMENTS
Declared none.