Introduction

In recent history, the impact of climate change has been hard to ignore. Earthquakes, hurricanes, floods and increasing records of the highest heat levels in human history are remarkably intrusive consequences of ecological shifts that have contributed to worsening mental health1. A scoping review found that these events were associated with psychological distress, poor well-being and increased hospitalizations in psychiatric units2. Another systematic review highlighted the importance of the long-term and short-term effects of climate change and psychological health, which could also be explicit or implicit3. As a result, an increase in research about psychological variables relating to the environmental and ecological changes has been witnessed, including the concepts of Eco guilt and Eco grief3.

In the past, tools were developed to measure emotions related to climate change such as the Climate Change Worry Scale (CCWS), a scale containing 10 items designed to determine worry related to the environment4, and the Climate Change Anxiety Questionnaire, a 22-item scale measuring aspects related to ecological anxiety5. Both scales focus on negative emotions related to the environment, but do not assess the psychological consequences of these emotions. For that reason, the Eco guilt (EGuiQ) and Eco grief (EGriQ) scales were designed and validated by Ágoston et al. as measures of the psychological outcomes of negative emotional responses (i.e., grief and guilt) to climate change6. Both scales showed good psychometric qualities6.

Eco guilt refers to a person’s perceived inability to meet personal or societal standards related to the environment. Subsequently, individuals contemplate environmentally polluting activities that they do, which produces a feeling of guilt. The individual experiences remorse regarding implicit or explicit actions that do not abide by environmental norms7. Previous research shows that individuals’ guilt could stem from their belief that their personal or country’s ecological footprint is significantly higher than the norm8. Eco grief represents another psychological concept related to the environment. It is experienced when the person observes or expects ecological repercussions that have resulted from important environmental change, which impacts mental health9. The mass death of species, the destruction of ecosystems and landscapes can produce Eco grief9. Eco grief is related to a feeling of loss regarding one’s identity, as the environment is a prominent element of who a person is and produces attachment emotions and behaviors10. On the other hand, Eco grief can produce prosocial behavior including personal and collective change, and advocacy related to environmental behavior11.

Ágoston et al.6 were the first to develop scales to assess Eco guilt and Eco grief, named EGuiQ and EGriQ respectively. Participants were recruited using purposive interviewing of individuals whose lives might have been affected by ecological changes6. Subsequently, a snowball sampling technique was adopted when recruited participants would recommend further affected interviewees6. In the original study, females exhibited higher scores of both Eco guilt and Eco grief6. As for age, no association was found with Eco grief while a negative association was found with Eco guilt (p < .01)6. The one-factor structured EGuiQ consists of 11 items while the EGriQ includes 6 items and fits a single-factor structure as well6. Recently, both scales were validated in a German version and demonstrated good psychometric properties12. The German EGuiQ-11 exhibited a unidimensional structure, and the German EGriQ showed a two-dimensional structure in contrast with the original version of the scale12. To the best of our knowledge, no other studies validating the EGuiQ-11 and the EGriQ-6 exist at the moment.

In Lebanon, attention given to ecological concern is majorly lacking and focuses on specific ecosystems, as opposed to eliciting personal and public action to preserve the environment and prevent or mitigate the effects of environmental change13,14,15. Except for a few very recent studies on the topic showing negative impact of climate change on mental health (e.g16). , , many of the studies investigating the status of Lebanese ecological systems and the environment are incredibly outdated17,18,19. This gap in the literature is likely to cause ambiguity about the current ecological situation in Lebanon. Adding to that, action regarding environmental concerns is heavily contingent on governmental awareness and call for action from the relevant ministries, which is relatively non-existent due to the country being plagued by political, economic and societal uncertainty. These factors have caused ecological impact to become an unexplored element in local psychological health. For these reasons, the aim of the study is to validate the EGuiQ-11 and the EGriQ-6 scales for the Lebanese Arabic-speaking population. We hypothesize that both scales will show a unidimensional factor structure invariant across gender as well as a good internal consistency reliability, and will have a significant positive relationship with psychological distress and climate anxiety measures.

Methods

Sample and procedure

This study had a cross-sectional design. A snowball sampling technique was used to recruit participants. Noting that the snowball sampling was chosen for this study to efficiently access a hard-to-reach population, as participants can refer others who meet the study’s criteria, helping researchers build a sample quickly and effectively.

The data was collected during September 2023 through an online questionnaire on Google Forms. It was distributed through social media platforms and messaging applications. The participants eligible for the study needed to be older than 18 years. Exclusion criteria included the following: (1) refusal to participate in the study, and (2) being unable to read and understand the Arabic language. At the beginning of the questionnaire, participants have been presented with the relevant information about the study, including anonymity, confidentiality, and contact details of the research team. Then, it was made clear that by proceeding with the study, the respondent is providing informed consent to participate. The data was stored safely with the principal investigator (SH), protected by a username and password and adhering with all privacy regulations.

Ethics approval and consent to participate

Ethics approval for this study was obtained from the ethics committee of the School of Pharmacy at the Lebanese International University (Reference # 2023RC-021-LIUSOP). Written informed consent was obtained from all subjects; the online submission of the soft copy was considered equivalent to receiving a written informed consent. All methods were performed in accordance with the relevant guidelines and regulations.

Measures

The Eco guilt scale (EGuiQ-11)

This tool by Ágoston et al. assesses the degree of guilt a person experiences due to the perceived harmful ecological actions committed by them or their country. It consists of 11 items that are reported on a scale from 1, reflecting the highest level of agreement, to 4, indicating the lowest degree of agreement6. Higher scores reflect higher ecological guilt (α = 0.89)6.

The Eco grief scale (EGriQ-6)

The EGriQ-6 by Ágoston et al. is a measure that evaluates to what extent individuals feel grief about the negative consequences witnessed in the environment. There are 6 statements that participants rate on a Likert-type scale from 1 (strongly agree) to 4 (strongly disagree)6. The internal consistency of the scale is good (α = 0.77)6.

The climate change anxiety scale (CCAS)

This instrument estimated to what extent an individual might exhibit fear and worry about the future of the ecological situation. It includes 13 items such as “My concerns about climate change make it hard for me to have fun with my family or friends.” and “I try to reduce my behaviors that contribute to climate change”5. The items are scored from 1 (never) to 5 (almost always) (α = 0.87)5. The Arabic version of the scale was recently validated in a Lebanese sample (α = 0.96)20.

The depression anxiety stress scales-8 (DASS-8)

This scale, validated in Arabic, includes 8 items evaluating the level of depression, anxiety and stress21. The items are divided as follows: 3 items for depression, 3 items for anxiety and 2 items for stress. The participants score the statements on a Likert scale of 4 levels, 0 being “did not apply to me at all, and 3 indicating “applied to me very much or most or the time”. The higher the scores, the higher the severity of psychological distress. This scale showed excellent reliability (α = .90)21.

Demographics

Participants were asked to provide their demographic details consisting of age, sex, marital status, highest level of education and socioeconomic status, calculated via the household crowding index by dividing the number of persons by the number of rooms in the house except the kitchen and bathrooms22.

Minimal sample size calculation

The needed sample for the EGuiQ-11 was 55 to 100 participants in order to conduct the Exploratory Factor Analysis (EFA), which is based on 5 to 10 participants for the scale’s items23. Meanwhile, the sample needed for the confirmatory factor analysis (CFA) was 33 to 220 participants according to the suggested minimum sample of a previous study, which was from 3 to 20 times the number of the scale’s variables24. As for the EGriQ-6, the minimum samples needed were 30 to 60 and 18 to 160 participants for EFA and CFA respectively.

Translation procedure

According to Beaton guidelines25, and before their use in the current study, the EGuiQ-11 and the EGriQ-6 scales were translated and adapted to the Arabic language and context (English items of both scales can be find in Table S1 in the Supplementary material and Arabic items of both scales can be find in Table S2 in the Related files). To this end, it was translated to the Arabic language with the purpose of achieving semantic equivalence between measures in their original and Arabic versions following international norms and recommendations26. For this, the forward and backward translation method was applied. The English version was translated to Arabic by a Lebanese translator who was completely unrelated to the study. Afterwards, a Lebanese psychologist with a full working proficiency in English, translated the Arabic version back to English. The translation team ensured that any specific and/or literal translation was balanced. The initial and translated English versions were compared to detect/eliminate any inconsistencies and guarantee the accuracy of the translation. The translation committee was composed of two psychiatrists and one psychologist, in addition to the research team and the two translators27. An adaptation of the measure to our specific context was performed. It sought to determine any misunderstanding of the items wording as well as the ease of items interpretation. This procedure was done to ensure the conceptual equivalence of the original and Arabic scales in both contexts28. After the translation and adaptation of the scale, a pilot study was done on 30 patients to ensure all questions were well understood. No changes were made after the pilot study.

Data analysis

A CFA was conducted on the total sample to confirm the one-dimensionality of both scales. Maximum Likelihood was used as the method of estimation. The following fit indices were calculated to check the adequacy of the model: the Steiger-Lind root mean square error of approximation (RMSEA), the Tucker-Lewis Index (TLI) and the comparative fit index (CFI). Values ≤ 0.05 for SRMR, ≤ 0.08 for RMSEA, and 0.90 for CFI and TLI indicate good fit of the model to the data29. At first, multivariate normality was not verified (Bollen-Stine bootstrap p = .008). Subsequently, non-parametric bootstrapping procedure was performed. Correlation between residuals was inserted in case of high modification indices. The average variance extracted (AVE) was used to assess evidence of convergent validity, with values of ≥ 0.50 considered adequate30.

Gender invariance

A multi-group CFA using the total sample was performed to evaluate gender invariance of the EGuiQ-11 and the EGriQ-6 scores31. We assessed measurement invariance at the configural, metric, and scalar levels32. As per international recommendations33, we accepted ΔCFI ≤ 0.010 and ΔRMSEA ≤ 0.015 or ΔSRMR ≤ 0.010 as evidence of invariance34.

The Cronbach’s α and McDonald’s ω coefficients were used to examine reliability, with values greater than 0.70 reflecting adequate composite reliability. The EGuiQ-11 and the EGriQ-6 scores were considered normally distributed according to their skewness and kurtosis values varying between ± 135. Then, we used the Student t test to compare two means. In addition, we used the Pearson test to correlate those scores with psychological distress and climate anxiety scores. Based on Cohen36, correlation coefficient values ≤ 0.10 were considered weak, ~ 0.30 were considered moderate, and ~ 0.50 were considered strong correlations.

Results

Seven hundred sixty-three adults filled the survey, with a mean age of 28.46 ± 11.09 years and 63.4% females. Other details about the sample are provided in Table 1.

Table 1 Sociodemographic and other characteristics of the sample (N = 763).

Concurrent validity

Higher EGuiQ-11 scores were significantly associated with higher psychological distress (r = .30; p < .001) and higher climate anxiety (r = .56; p < .001). In addition, higher EGriQ-6 scores were significantly associated with more psychological distress (r = .26; p < .001) and higher climate anxiety (r = .43; p < .001). Higher EGuiQ-11 scores were significantly and positively associated with higher EGriQ-6 scores (r = .70; p < .001).

Confirmatory factor analysis (CFA) of the EGuiQ-11

The unidimensional model was tested via a CFA. Results indicated that the fit of the scale was modest: RMSEA = 0.102 (90% CI 0.093, 0.111), SRMR = 0.039, CFI = 0.939, TLI = 0.923. When adding correlations between residuals of items 8–10 and 9–11, the indices improved: RMSEA = 0.086 (90% CI 0.077, 0.096), SRMR = 0.033, CFI = 0.958, TLI = 0.945. The AVE value was adequate as well (= 0.58) (Fig. 1). The reliability was excellent as shown via the alpha coefficient (= 0.94) and the omega coefficient (= 0.94).

Confirmatory factor analysis (CFA) of the EGriQ-6

CFA indicated that the fit of the factor-structure of the scale was modest: RMSEA = 0.097 (90% CI 0.078, 0.119), SRMR = 0.024, CFI = 0.974, TLI = 0.957. The AVE value was adequate as well (= 0.58). The reliability was excellent as shown via the alpha coefficient (= 0.90) and the omega coefficient (= 0.90) (Fig. 2). Table 2 shows the loading factors obtained from CFA for the both scales.

Table 2 Standardized estimates of factor loadings from the Confirmatory Factor Analysis of the EGuiQ-11 and the EGriQ-6.
Fig. 1
figure 1

Standardized Estimates of Factor Loadings from the Confirmatory Factor Analysis of the EGuiQ-11.

Fig. 2
figure 2

Standardized Estimates of Factor Loadings from the Confirmatory Factor Analysis of the EGriQ-6.

Gender invariance of the EGuiQ-11 and the EGriQ-6

We were able to show the invariance across gender at the configural, metric, and scalar levels for both the EGuiQ-11 and the EGriQ-6 scales (Table 3). No statistically significant difference between males and females was found in terms of EGuiQ-11 scores (M = 23.05, SD = 7.24 vs. M = 23.42, SD = 7.38, t(761) = -0.67, p = .505) and EGriQ-6 scores (M = 13.37, SD = 4.24 vs. M = 13.74, SD = 4.31, t(761) = -1.15, p = .250).

Table 3 Measurement invariance of the EGuiQ-11 and the EGriQ-6 scales across gender in the total sample.

Discussion

In the present study, one of the central aims was to validate the EGuiQ-11 scale in order to assess Eco guilt among Lebanese adults. We conducted the EFA of the scale, which confirmed that all items measured Eco guilt. Having said that, 3 items were deemed as doublets and removed. Consequently, the final validated scale consisted of 11 items. The findings indicate excellent reliability (α = 0.92; ω = 0.92) in agreement with the original scale’s results (α = 0.89)6 and a version validated for the German-speaking population (α = 0.93)12.

Similarly, the study aimed to validate the EGriQ-6 scale to evaluate Eco grief among Lebanese adults. As a result of the EFA of the scale, 2 items were identified as doublets and omitted from the final validated version, which was made up of 4 items. The results also showed excellent reliability (α = 0.83; ω = 0.83) in comparison with the original scale’s outcome (α = 0.77)6 and the German validated version (α = 0.82)12. In both the original6 and the German12 validated versions, EFA showed good fit for a single-factor solution. Meanwhile, the current findings show that the EFA for Eco grief indicated a unidimensional model, similar to the original scale6. This might be an indicator of the homogeneity of the Eco grief measure, as it assesses general grief related to the environment. Overall, the current results indicate that the validated EGuiQ-11 and the EGriQ-6 scales into Arabic are accurate means of assessment of the mentioned concepts within the Lebanese Arabic-speaking adult population.

Having said that, the RMSEA values were suboptimal for the EGuiQ-11 and the EGriQ-6 in our study (Table 3). The content of the items could be ambiguous for some participants given that ecological awareness in Lebanon is limited. Findings have shown that ecological activities in educational institutions are often followed without critically evaluating the reasons behind such incentives37. Ecological awareness could be predominantly constricted by limited local ecological knowledge, which can differ from one subculture to another38. Moreover, Lebanese individuals’ awareness of the ecological situation is challenged by political and security instability39, shifting their attention to basic human needs. These cultural and socio-political reasons can also aid in explaining the gender invariance found in our study in terms of Eco Guilt and Eco Grief scores. The original study hypothesized that females, being more environmentally conscious, would score higher on Eco guilt and Eco grief scales6. This hypothesis was later confirmed; however, gender was deemed to be a minimally influential factor when it comes to Eco guilt and Eco grief6. Similar results were found in the study validating the EGuiQ-11 and the EGriQ-6 scales for the German population, with females scoring slightly higher than males12. Environmental awareness and action are heavily dependent on a country’s economic power and governmental policies, which is the case in Lebanon40. In fact, some major environmental issues in Lebanon are caused by the lack of economic measures41, potentially affecting knowledge and call for action regarding environmental concerns. It is fair to assume that the absence of economic resources and current governmental strategies, such as national awareness campaigns, might affect the overall Lebanese population’s stance on pro-environmental beliefs and behaviors irrespective of gender. As a result, this could contribute to the absence of significant gender differences in Eco guilt and Eco grief scores in the present sample.

In line with the initial study by Ágoston et al.6, we found that the correlation between Eco guilt and Eco grief was positive and significant (r = .70; p < .001), indicating that feelings of guilt regarding environmental actions and experiencing grief as a result of observing negative environmental outcomes are interrelated. Eco guilt is characterized by being blaming oneself for failing in one’s individual responsibility towards the environment, being critical of others’ actions impacting the environment negatively and feeling chronic guilt about one’s current and previous actions42. Meanwhile, Eco grief involves feelings of sadness and distress towards the loss of species and expecting more losses in the future42. This prompts prospective research regarding Eco guilt and Eco grief scores within the Lebanese population to examine the possibility of a significant relationship. According to Abraham Maslow, humans have needs that exist in a hierarchical system, and one must be achieved before elevating to the next category43. The first category consists of basic physiological needs including food, water, shelter, and breathable air, which can be compromised in the case of ecological disasters such as floods, wildfires and deforestation44. As a consequence, a deficiency in or absence of the components essential for achieving physiological needs may cause psychopathology, psychological distress resulting from variables such as Eco guilt and Eco grief, and hinder humans from reaching higher-order needs. Andrew and Smith previously introduced the term “Emotional Geography” stating that humans are emotionally impacted by their environments45. Based on the theory of Emotional Geography, humans experience grief when observing the ecological disasters occurring due to their behaviors and feel guilty45. Similarly, a model of moral emotions defines guilt as the product of less than favorable moral evaluation of oneself46. As a result, grief caused by loss of ecological resources might exacerbate feelings of moral guilt47.

Adding to the current findings, Eco guilt showed a positive association with psychological distress (r = .30; p < .001) and climate anxiety (r = .56; p < .001). In general, feelings and intensity of guilt are positively correlated with depression (95%-CI = 26.2–48.7)48. Moreover, ecological anxiety was related to ecological emotions49, which could possibly include Eco guilt. In a similar study, Eco guilt had a positive relationship with climate anxiety (p < .01)12. It can be hypothesized that ecological emotions such as guilt can be rooted in moral distress, which is also connected to overall psychological distress50. Also, Eco grief had a positive correlation with psychological distress (r = .26; p < .001) and climate anxiety (r = .43; p < .001). First, it was suggested that Eco grief is a normative reaction to environmental change that can affect mental health9. In the past, different factors were associated with Eco grief such as anxiety and distress related to climate51. Likewise, it has been established that Eco grief and ecological anxiety are closely related52. Therefore, the results of our study are in accordance with previous research. A model previously suggested that depression is a stage of grieving when witnessing detrimental ecological events, where the individual experiences upset and distress53, which could explain this study’s results.

Some limitations should be noted. First, the EGuiQ-11 and EGriQ-6 scales have only been validated once to another population, apart from the original study making the scales. This means that the literature does not offer significant content to compare previous validations with the current validation of the scale for the Lebanese population. Second, the data was collected from a self-administered online questionnaire, which increases the probability of response bias. Furthermore, the use of an online questionnaire also limits the ability for participants who do not have Internet access to take part in the study. A snowball sampling method was used in this study, making the sample less representative. In addition, the sample’s mean age (28.46 years) and the gender distribution (63.4% females) may not accurately reflect the population of Lebanese adults, limiting the study’s external validity. Also, adult participants from the general population who were included in this study could have intellectual, developmental or learning disabilities that affect the quality of responses. Future studies need to consider these conditions as exclusion criteria. Lastly, only two professionals conducted the translation process for the EGuiQ-11 and EGriQ-6 scales due to lack of funds.

In this study, the EGuiQ-11 for Eco guilt and EGriQ-6 for Eco grief scales were validated for the Arabic-speaking Lebanese population. No gender variance was found for both scales. In addition, higher Eco guilt levels were significantly associated with more depression, anxiety and stress, as well as higher climate anxiety. Similar results were found for Eco grief scores as it had a positive correlation with psychological distress and climate anxiety. These results enable researchers to use scales assessing emotions related to the environment for future studies in Lebanon. It also clarifies the association between the possible effects of environmental change on mental health.

Practical implications

The current findings call attention to a topic that is not well-researched in Lebanon. It also provides a validation for reliable scales assessing emotions related to the environment, the EGuiQ-11 for Eco guilt and EGriQ-6 for Eco grief. Moreover, it highlights the importance of investigating ecologically-related emotions in the clinical setting as it might have an impact on psychological distress. This reinforces the value of evaluating the psychological outcomes of climate change and utilizing it in guiding prosocial behavior to address ecological concerns, which can potentially improve the general population’s mental well-being.

Future directions

The current findings show the importance of creating interventions that resonate with people. It is essential to invite citizens to critically think about the ecological situation in Lebanon instead of merely participating in environmentally-friendly behavior. The government must put policies in action by making awareness campaigns that educate the Lebanese people, showing them how environmental changes impacts their psychological and physical health. These policies accompanied by awareness campaigns and call for action could generate habitual behavior that can actually make a change. Scientists in the mental health field should be employed by governmental agencies to research the tremendous significance of ecological changes on human behavior, thoughts and emotions as a first step towards ecological awareness.