Skip to main content

The psychometric properties of the child anxiety and depression life interference scale (CADLIS)

Abstract

Objective

Life interference is a key diagnostic feature for anxiety and depressive disorders. Measures focusing on life interference caused by anxiety and depressive disorders in children and adolescents have received minimal attention. This study evaluated the psychometric properties of the Child Anxiety and Depression Life Interference Scale (CADLIS), a brief child (CADLIS-C) and parent-report (CADLIS-P) measure designed to assess life interference from anxiety and depressive disorders in both the child and parent’s life.

Method

A total of 672 parents of children aged 4–18 years completed the CADLIS-P, and 627 children aged 7–18 years completed the CADLIS-C.

Results

The proposed two-factor CADLIS-C model was not supported, instead, due to high inter-factor covariance a one-factor model of life interference was proposed. The one-factor model demonstrated better model fit. The proposed three-factor model for the CADLIS-P was not supported, instead, an exploratory factor analysis found a two-factor model differentiating life interference into child and parent life interference a better model fit. The CADLIS demonstrated excellent internal consistency, good convergent and divergent validity, interrater correlations and was able to differentiate between children with and without clinical levels of anxiety and depressive symptoms.

Limitations

Limitations of the study included the sample population which consisted of a small clinical sample, an over-representation of high-income families and the use of a panel provider.

Conclusions

Overall, the CADLIS demonstrated sound psychometric properties. The CADLIS is a reliable measure that demonstrates evidence of convergent validity for the assessment of life interference associated with anxiety and depressive symptoms in children.

Anxiety and depressive disorders constitute some of the most common psychological disorders in children and young people [1,2,3,4]. Research indicates that depressive disorders are highly comorbid with anxiety disorders, particularly for adolescents [5, 6]. Symptoms associated with anxiety and depressive disorders can cause significant life interference also known as impairment for children and their parents in various contexts such as their social, academic and family functioning [7]. Life interference is the degree to which symptoms interfere with daily life [8]. Interference is an essential diagnostic criterion within the Diagnostic and Statistical Manual of Mental Disorders [9] and is used to differentiate between normative childhood worries, low mood and irritability and clinically significant anxiety and depressive disorders [10, 11]. Reductions in life interference are associated with a stronger sense of treatment satisfaction as life interference is often a key motivator to seek treatment [12, 13].

Individually both anxiety and depressive disorders cause considerable life interference, but when combined, the life interference experienced is more significant than the interference from a single disorder [11, 14]. In children with anxiety and depressive disorders high rates of school absenteeism, low rates of participation in extracurricular activities, poorer school performance, poorer family functioning and more significant peer problems [15,16,17,18].

The significant life interference from childhood anxiety and depressive disorders has led to a strong focus on the early identification, assessment and treatment of these disorders, resulting in numerous psychometrically sound assessment measures of symptoms that capture both the parent and child's perspectives [19]. However, life interference resulting from childhood disorders has received less attention, as there are no validated measures to assess the life interference of comorbid child anxiety and depressive disorders [13]. Creswell et al. [20] recommends that within the assessment of child anxiety disorders, a measure of life interference should be used. This is because interference measures, as opposed to symptom measures, align better with diagnostic criteria and outcomes such as treatment satisfaction [21, 22].

Pre-existing measures of life interference include The Child Sheehan Disability Scale (CSDS) [8], the Child Anxiety Impact Scale– Parent Version (CAIS-P) [23], Adolescent Life Interference Scale for Internalizing Symptom (ALIS-I) [24] and The Child Anxiety Life Interference Scale (CALIS) [13]. Whilst the CSDS, ALIS-I and the CAIS-P have many strengths, there are limitations concerning their assessment of life interference. These include i) the use of a global measure rather than a specific life interference measure; ii) the combination of symptomatology, distress, severity and interference, iii) failure to capture reports from multiple informants and iv) the sole focus on anxiety disorders v) the ALIS-I is designed for adolescents not children.

The CALIS [13] measures life interference related to anxiety disorders in children using both parent and child self-report measures. It is a brief measure that assesses interference in a child’s life and their parents’ life in various domains, such as in home and out of home interference as well as interference in the parent’s life. It also includes an item on distress. The CALIS is a reliable and valid tool for assessing life interference as it has both adequate reliability and moderate-to-high test–retest and inter-rater reliability, and is sensitive to treatment change [13]. A working group established by the International Consortium of Health Outcome Measures (ICHOM) determined the CALIS to be an ideal measure for use within the standard set of measures for the assessment of anxiety and depression in children and young people (4–24 years). However, the working group highlighted the limitation of the measure’s focus on anxiety. In addition to the high comorbidity between clinical depressive and anxiety disorders, it is common for sub-clinical levels of depressive symptoms to also be reported alongside anxiety symptoms [25, 26]. Anxious children with comorbid depression are more likely to report more severe impairment and show more severe anxiety and specific depressive symptoms (e.g., negative mood, anhedonia) than anxious children without comorbid depression [14, 27]. Diagnostically, there is also significant overlap between the symptoms of anxiety and depressive disorders, such as negative affect [28] and the rumination of negative thoughts [29]. This overlap can make it difficult for children to differentiate between anxiety and depressive symptoms, as well as to describe their differential impact. For some children, these symptoms are experienced holistically, and the interference they cause is often analogous. Due to the significant impairment resulting from comorbid anxiety and depressive disorders, it is important to be able to measure interference from both anxiety and depressive disorders in children. There is currently no measure that adequately assesses interference from anxiety and or depression symptoms in children and adolescents.

In direct response to the measurement gap identified by the ICHOM working group, we sought to develop a new brief measure of life interference of anxiety and depressive symptoms. Adapting the widely used CALIS measure, we developed the Child Anxiety and Depression Life Interference Scale (CADLIS) to assess life interference of depressive and anxiety disorders in children and adolescents. Based on previous validation studies of the CALIS, it was hypothesised that CADLIS would demonstrate good psychometric properties through adequate internal consistency, convergent and divergent validity, and display a two-factor model of in the home interference and outside the home interference for both the parent and child measure.

Method

Participants

A total number of 1299 participants (672 parents and 627 children) participated in the study. Data on 1130 children were analysed: 503 from parent-only reports, 458 from child-only reports and 169 from matched parent and child reports. Across the total sample, children (n = 1130) were aged between 4 and 18 and had a mean age of 12.46 years (SD = 3.63), and there was an even split of secondary school (50.5%) and primary school students (49.5%). Participants were from across Australia and a small number of participants were international. Just under half of the sample resided in NSW (47%) including regional and rural areas, with 24% from Victoria, 13% from Queensland and a small fraction (0.6%) of participants reported living outside of Australia. 78% of parents reported that their family were self-isolating to some extent due to the COVID19 pandemic. Descriptive statistics for the total sample are presented in Table 1.

Table 1 Demographic characteristics of children and parents

To achieve a large and diverse sample, participants were recruited from four channels: schools (n = 320), clinic (n = 41), panel (n = 483) and community (n = 290).

School sample

Children and their parents were recruited from independent primary and high schools from the Greater Sydney area. Eight schools were invited to participate via email, two consented to participate. Parents were sent information about the study and an opt-out consent form; with a two-week turnaround. Students completed the survey online during class under the supervision of a teacher and the researchers during Term 3 2020. Each student provided informed consent. Parents were sent the online survey link via the school to complete in their own time.

Community sample

The community sample was obtained through advertisements on social media. Parents provided consent for themselves and their child. Children 14 and above could provide their own consent without parental consent to participate.

Panel sample

The panel sample was obtained through a panel provider CINT.com. The survey link was distributed through the platform, and parents provided consent for themselves and their child to participate.

Clinic sample

The clinical sample was obtained through families seeking treatment for anxiety at the Centre for Emotional Health, Macquarie University. Clinicians provided information on the study to the family during the assessment. If consent was provided, the survey was then included into their assessment package. Children were assisted by the researcher to complete the survey. The family’s clinic ID was used to match parent–child responses.

Measures

Child anxiety and depression life interference scale (CADLIS)

The CADLIS is an adapted measure of the CALIS [13]. The CADLIS assesses the interference from anxiety and depressive disorders in a child's life and their parent’s life and includes two versions for primary school children aged 7–12 (CADLIS-C- PS) and secondary school students aged 12–18 (CADLIS-C-SS) and a parent measure for children aged 4–18 (CADLIS-P). It is brief and designed to be used independently or to be used in conjunction with other symptom measures. Through consultations with the International Consortium for Health Outcomes Measurement and the authors of the CALIS, additional changes were made to the measure to include items specific to depressive disorders such as an anhedonia and sleep item, so interference from depressive disorders was adequately captured. (Note: the distress item was removed to enable the measure to be specific to life interference). Further changes were made to make the scale applicable across cultures by rewording three items, the first to include extended family, the second to rephrase “mates” to “friends” and lastly to reword “recess and lunch” to “at school”.

A pilot study was conducted with 18 children aged 7–17 recruited via a convenience sample to examine the face validity of using the statement ‘feeling anxious and depressed’ accompanied by an image that contained a textbox with the feelings associated with anxiety and depression. The results of the pilot study revealed that the statement ‘feeling anxious and depressed’ accompanied by the age-appropriate picture description was adequately comprehended by all ages surveyed.

The CADLIS-C includes nine items that examine interference related to their family, social and academic functioning, e.g. “make it difficult for you to get your schoolwork done”. Children rated the extent to which each item was true for them on a five-point scale (Not at all, only a little, some, quite a lot, a great deal). The CADLIS-P includes 16 items related to interference in the child’s life and parent’s life, using the stem question "How much does anxiety and depression interfere with your child's everyday life in the following areas?" and "How much does your child's anxiety and depression interfere with your everyday life in the following areas", followed by sub-questions that related to family, social and occupational functioning. Parents rated the extent to which each item was true for them and their child on the same five-point scale. A total score is calculated by summing the items, with higher scores indicating higher levels of interference. Child scores range from 0–36 and parent scores range from 0- 64.

Revised child anxiety and depression scale (RCADS-25)

The RCADS-25 [31] measures anxiety and depressive symptoms in children. Both the parent and child report have 25 items, with two subscales measuring anxiety and depression, respectively. The RCADS-25 assesses the frequency of symptoms, with children and parents responding to items on a four-point Likert Scale the frequency of symptoms for them/their child (Never, sometimes, often, always). The total score is calculated by summing the 25 items and then converting the raw score into a t-score standardised for gender and grade, with higher scores indicating a higher frequency of symptoms. For this study, high RCADS-25 scores were characterised by scores of 65 and above [32]. The measure has proven to correlate with DSM diagnoses of anxiety and depression and demonstrate high reliability in samples of children and adolescents across clinical and community samples [33]. Cronbach’s alpha for this study was high for both child and parent reports (α C = 0.95, α P = 0.93).

Sheehan disability scale (CSDS/-P)

The CSDS/-P [8] is a measure which assesses impairment in three domains: work/school, family and social functioning in addition to the parents functioning. It is an adaptation of the original SDS [34]. The parent report has five items, and the child report has three items. Both children and parents rate the extent to which each item is true for them/their child on an eleven-point scale of 0 (Not at all) to 10 (Extremely). The total score is calculated by summing the item ratings with higher scores associated with more significant impairment. The CSDS/-P has shown strong construct validity in measuring interference from internalising disorders as it is significantly and positively related to anxiety symptoms, and not significantly related to externalising disorders [8]. The CSDS/-P demonstrated high internal consistency for both parent and child reports (P α = 0.95, C α = 0.90) consistent with prior studies using the measure [8]. Child scores range from 0 to 30, parents’ scores range from 0 to 50.

Strengths and difficulties questionnaire (SDQ-P/C)

The SDQ-P/C [35] measures psychopathology and prosocial behaviour in children through five dimensions; emotional symptoms, hyperactivity-inattention, conduct problems, peer problems and prosocial behaviour. It is a brief 25-item measure in which parents and children rate on a three-point scale the extent to which items are true for them/their child (Not true, Somewhat true, Certainly True). For this study, the externalising subscale (10 items) and emotional subscale (five items) were used. The externalising subscale is calculated by summing the hyperactivity and conduct subscale together and is recommended for use in community samples [36]. Higher scores are associated with higher emotional and conduct problems respectively. It has moderate reliability and discriminant validity, thus can be used for screening for internalising and externalising symptoms [35]. For this study the emotional and externalising subscales demonstrated high reliability (α CEm = 0.85 CExtern = 0.75, α PEm = 0.85, PExtern = 0.82).

Demographics and attention checks

Child participants reported demographic information, including their grade, age, gender and ethnicity. Parent participants reported the same demographic information for their child and their own age, gender, ethnicity, income, postcode and isolation status, as the study was conducted during the COVID-19 pandemic. Embedded in the questionnaire was an attention check which asked participants to select ‘sometimes’.

Procedure

Ethics approval was granted by the Macquarie University Human Research Ethics Committee. Each sample population had a separate recruitment and consent procedure. The inclusion criteria for the study were based on parental status and child age: Parents who had a child aged 4–18 were invited to participate as were children aged 7–18. Although the study was advertised to families living in Australia, location did not serve as an exclusion criterion. The survey was conducted online via LimeSurvey. All participant information was de-identified, a secret code was created for each child to link with their parent’s report. Upon completion of the survey, parents and children were provided with a debrief statement that provided mental health resources. Participants from the school, community and clinic samples had the opportunity to enter a draw to win an iPad whereas the panel sample was provided monetary reimbursement via the panel provider. All participants were free to withdraw at any time without penalty.

Data analysis strategy

A confirmatory factor analysis (CFA) was applied to support the underlying factor structure of the CADLIS based on previous results from the CALIS. The CFA was conducted with maximum likelihood estimation, and the participant-to-parameter ratio of 25.08 indicated adequate sample size [37]. A two-factor structure was predicted (inside and outside the home) based on prior factor structure of the CALIS [13]. Model fit was assessed with multiple indices, with the following indicating acceptable fit: comparative fit index (CFI) > 0.90 [38], Tucker-Lewis index (TLI) > 0.95 (Bentler [39]), Standardized Root Mean Square Residual (SRMR) < 0.08, root mean square error of approximation (RMSEA) < 0.08 [40] and a ratio of five or less for the χ2 to the degrees of freedom [41]. As the original model displayed poor model fit, modification indices were examined and implemented incrementally until model fit was achieved. Modification indices were added if they had a large, expected model change corresponding to a significant improvement (p < 0.001) in chi-square and theoretical support.

A CFA was applied to the parent version (CADLIS-P), although for this measure a three-factor solution was tested (inside the home, outside the home, and parent life) based on prior results from the CALIS [13]. Due to poor model fit for the predicted three-factor model, and no modification indices which significantly improved the model fit, an exploratory factor analysis (EFA) was conducted to examine an alternate possible structure. Principal Axis Factoring (PAF) with oblimin rotation was used due to the high probability of correlations between the factors [42]. Finally, internal consistency and agreement between parent and child reports were evaluated, along with convergent and divergent validity using Pearson’s correlation and Fisher’s Z-transformation to examine differences in the correlation between the CADLIS and measures of internalizing symptoms and externalising symptoms. We expected the CADLIS to be more strongly related to measures of internalising symptoms (RCADS, SDQ-E and CSDS) than externalising symptom measures (SDQ-Ext). Correlations were run separately between parent-reported and child-reported measures. Similarly, given the violation of the assumption of normality, a Mann–Whitney U was conducted to examine differences in CADLIS scores between those who scored high or low on the RCADS-25 to determine if the CADLIS could differentiate between clinical and non-clinical impairment to assess the concurrent validity of the CADLIS. All analyses were performed using Stata/IC 16.1.

Results

Data management

The four samples were merged into one data set. As the data set was utilised for other studies, only participants who completed the CADLIS were included in the sample, parent and child dyads were matched via the secret code. The original data set contained 1543 participants. A total of 244 participants were removed due to failing item attention checks to ensure data quality. Missing data at the item level was dealt with by prorating total scores using the mean when at least 80% of the measure of interest was completed. Participants who completed less than 80% of a measure were dropped at a measure level but not from the data set (n = 94). Thus, each measure has a different total sample. The final data set contained 1299 participants (parent n = 672, child n = 627).

Descriptive statistics

As expected, there were significant differences between the demographics and measure scores across the different samples. These are provided in the supplementary materials (Supplement A). We have provided the means and standard deviations for each measure in Table 4.

CADLIS-C factor structure

The hypothesised two-factor model did not adequately fit the data (RMSEA = 0.239; CFI = 0.780, TLI = 0.707, SRMR = 0.414, χ2 = 9991.999, df = 27, p < 0.001). As model fit was poor, model fit indices were examined, and the addition of the three covariances was suggested. The first covariance (modification index = 424.752) was between the two latent factors (inside the home) and (outside of the home). Given the high modification indices, and resultant high inter-factor correlation (0.95) suggesting little differentiation between the two-factors, a one-factor model was also tested to determine if a single “life interference factor” was a better representation of the model. The one-factor model where all items loaded onto a single factor of life interference displayed slightly better model fit than the two-factor model (RMSEA = 0.128; CFI = 0.937, TLI = 0.916, SRMR = 0.041, χ2 = 303.527, df = 27, χ2/df = 11.2, p < 0.001), however, it was still not within the required range for model fit, thus modification indices were explored. A bifactor model and higher-order model were also attempted, however, these models did not converge. The first covariance (modification index = 120.631) was added to the model between the residuals of item one (“How much does feeling anxious and/or depressed make it difficult for you to get along with your parents?”) and item two (“How much does feeling anxious and/or depressed make it difficult for you to get along with other family members?”) displayed better fit however, the RMSEA was still not within optimal range (RMSEA = 0.097; CFI = 0.965, TLI = 0.952, SRMR = 0.031, χ2 = 179.313, df = 26, χ2/df = 6.90, p < 0.001). The second covariance (modification index = 27.189) was added to the model between the residuals of item three (“to be with friends outside of school?”) and five (“to be with other children at school?”) however the RMSEA was still not within range (RMSEA = 0.090; CFI = 0.971, TLI = 0.959, SRMR = 0.029, χ2 = 153.069, df = 25, χ2/df = 6, p < 0.001). A final covariance (modification index = 37.175) was then added between the residuals of item four (“to get your schoolwork done”) and item nine (“to get to sleep, stay asleep or wake up on time”). The final model was re-run with three covariances. The one-factor model with three covariances fit adequately (RMSEA = 0.078; CFI = 0.979, TLI = 0.969, SRMR = 0.025, χ2 = 115.832, df = 25, χ2/df = 4.83, p < 0.001). All items loaded significantly (p < 0.05) and strongly within the model (λs = 0.68–0.86), factor loadings are displayed in Table 2. The relationship between the residuals of item two and three was significant and moderate (0.44), and the relationship between the residuals of three and five, and four and nine was significant and weak (0.22, 0.26). The one-factor model with three additional covariances was retained as the optimal model for the CADLIS-C, the final model is displayed in the supplementary material (Supplement B).

Table 2 Standardised factor loadings for the CADLIS-C

CADLIS-P factor structure

The hypothesised three-factor model for the parent CADLIS report did not adequately fit the data in the CFA analysis (RMSEA = 0.172; CFI = 0.767, TLI = 0.734, SRMR = 0.448, χ2 = 2482.790, df = 119, p < 0.001). There were no modification indices that could be made to improve model fit significantly; thus it was decided to run an exploratory factor analysis to examine the factor structure of the model. Principal Axis Factoring (PAF) was conducted on the 16 items with oblimin rotation. The PAF proposed a two-factor model from the examination of eigenvalues and the screeplot. Horn’s analysis proposed a one-factor model with only one adjusted eigenvalue above one, the second eigenvalue, however, was 0.98 thus the two-factor model was selected. The two-factor model accounted for 69% of variance. The Kaiser–Meyer–Olkin measure verified sampling adequacy, total KMO = 0.95, and individual items had KMO values above 0.93, which was within the excellent range [43]. Bartlett’s test of sphericity, which tests the overall significance of all the correlations within the correlation matrix, was significant (χ 2 (120) = 9708.832 p < 0.001), indicating that it was appropriate to use the factor analytic model on this set of data. The determinant was above < 0.00001 indicating there is no significant multicollinearity present.

Examination of the two-factor model (CADLIS-P) showed that after oblimin rotation, items regarding child life interference loaded onto factor one, and items regarding parent life interference loaded onto factor two. Item 10 ‘sleep’ loaded onto the parent life interference, for the factor loadings it was retained within the parent factor, however, for scoring purposes it was allocated to child life as there is an equivalent item on the child measure. The factor loadings and eigenvalues are reported in Table 3.

Table 3 Factor loadings of the exploratory factor analysis with oblimin rotation and eigenvalues for the CADLIS-P

Internal consistency and inter-rater reliability

McDonald's omega for the CADLIS-C was 0.94. McDonald’s omega was 0.96 for the total CADLIS-P report, 0.94 for the child life interference subscale and 0.94 for the parent life interference subscale. Agreement between parent and child CADLIS reports was examined using the average intra-class correlations (ICC) for the CADLIS total report between 169 matched parent–child dyads. The ICC for parent–child agreement and descriptive statistics for the measures of interest are reported in Table 4. Across the parent reports, 86.49% of children with elevated depression, and 85.76% with elevated anxiety symptoms, were also identified as having elevated comorbid anxiety and depression symptoms. Similarly, across child reports 81.65% and 79.82% of the high anxiety and high depression symptom groups respectively were in the high total RCADS25 group.

Table 4 Sample means for symptom and interference measures

Convergent and divergent validity

The CADLIS-P correlated positively and strongly with the RCADS25-P, SDQ-P emotional subscale and the CSDS-P. The CADLIS-C correlated positively and moderately with the SDQ-C emotional subscale and CSDS and strongly with the RCADS25-C. The correlation coefficients and their significance levels are reported in Table 5.

Table 5 Correlations between the child anxiety and depression life interference scale and other measures of interference and symptoms

Divergent validity was examined using Fisher’s z-transformation. For the parent report, the CADLIS correlated significantly more strongly with the RCADS-25 than the SDQ-Externalising subscale, z = 8.106, p < 0.01 (one-tailed). Similarly, for the child report there was a significant difference in the correlations between the CADLIS and RCADS-25 and the CADLIS and the SDQ-Externalising subscale in the same direction z = 7.816, p < 0.01 (one-tailed). The correlation between internalising and externalising measures was compared between the CADLIS and CSDS using Fisher’s Z-transformation to test for incremental validity. For the parent report, the SDQ-Externalising report correlated significantly less with the CADLIS than the CSDS, z = −1.82 p = 0.04 (one-tailed). The RCADS-25 correlated significantly more strongly with the CADLIS compared to the CSDS, z = 2.51, p = 0.01 (one-tailed). For the child report, the RCADS-25 correlated significantly more strongly with the CSDS than the CADLIS, z = 0.97, p = 0.17 (one-tailed). There was a significant difference in the correlations between the SDQ-Externalising subscale, CADLIS and CSDS. The SDQ-Externalising subscale correlated significantly less with the CADLIS compared to the CSDS z = −2.90, p < 0.01 (one-tailed).

Differentiation between high and low RCADS25 scores

An independent samples t-test was planned to compare the CADLIS total mean scores between the RCADS-25 high symptom (RCADS-25-C \(\ge\) 65) and low symptom group (RCADS-25-C < 65). Normality of the RCADS25-P/C and the CADLIS-P/C were first examined using the Shapiro–Wilk test and the data were found to be non-normal (p < 0.05), therefore a non-parametric test was used. Mann–Whitney U was deemed the most appropriate analysis. Parents who rated their child in the high RCADS-25 symptom group had higher CADLIS-P scores (Mdn = 33) than the low symptom RCADS-25 group (Mdn = 9). A Mann Whitney test indicated that this difference was statistically significant, U (Nhigh RCADS25 = 162, Nlow RCADS25 = 510) = 4,621,633.81, z = −16.15, p < 0.001. Children who self-reported high RCADS-25 scores reported higher CADLIS-C scores (Mdn = 20) than the low symptom RCADS-25 group (Mdn = 6). A Mann Whitney test indicated that this difference was statistically significant, U (Nhigh RCADS25 = 106, Nlow RCADS25 = 503) = 26,666,128.85, z = −12.72, p < 0.001.

Discussion

The present study indicates support for the validity, and reliability of the CADLIS-C/P an adapted measure of the CALIS, developed to assess the life interference caused by anxiety and depression in children and adolescents. Further research is required to confirm the factor structure of the CADLIS. The confirmatory factor analysis of the CADLIS-C did not support the two proposed sub-scales of life interference within the home and outside of the home, rather a one-factor model of “life interference” was found to be the most appropriate model. Previous studies of the CALIS have found high inter-factor correlations suggesting commonality between the subscales [13, 44, 45]. Thus, a one-factor model is not surprising. The factor structure may be accounted for due to the impact of COVID-19 restrictions which were in place during data collection [2, 3, 46]. Within our sample, 78% of people were self-isolating to some extent. Thus, the distinction between inside the home and outside of the home during data collection was less well defined for both children and parents, compared to when the factor structure of the CALIS was examined in 2013, which could explain the factor structure.

The hypothesised CADLIS-P three-factor model, differentiating life interference inside the home, outside the home and parent life interference factors, did not adequately fit the data. The EFA provided mixed results for the factor structure with recommendations of one (Horn’s analysis) or two factors (eigenvalues and screeplot). Given the theoretical support for the two-factor model with the CALIS factors differentiating between parent and child interference a two-factor model of child and parent life interference was selected and provided a better fit than the three-factor solution. Although contrary to previous CALIS research [13, 47], it is consistent with findings from the CSDS [8] and the singular factor structure for the CADLIS-C, indicating that interference in a child’s life can be measured holistically.

The CADLIS-C/P demonstrated significant moderate to strong convergent validity in its relationships with other symptom and interference measures and significantly lower correlations between the CADLIS and measures of externalising symptoms. Divergent validity was demonstrated with significantly lower correlations between the CADLIS and externalising symptoms compared to the correlation between the CADLIS and internalising measures. The moderate correlation between the CADLIS-P and the SDQ-Externalising subscale is to be expected as there are also high levels of heterotypic comorbidity between internalising and externalising disorders and is in line with other interference measures [8, 48]. Correlations with externalising symptoms were lower than with internalising symptoms, supporting the divergent validity of the CADLIS.

The CADLIS demonstrated incremental validity when compared to the CSDS for divergent and convergent validity for the parent report and divergent validity for the child report. Indicating the CADLIS provides unique information regarding interference from anxiety and depressive disorders when compared to a global impairment measure. Further, children with higher anxiety and depression symptoms reported higher levels of interference, indicating that the CADLIS can differentiate between clinically significant and non-significant interference. There was a high level of comorbidity present within the sample with between 79 and 86% of the sample meeting criteria for threshold or clinical symptoms of both anxiety and depression. This further justifies the need for a measure of impairment for both anxiety and depression in children.

The CADLIS displayed excellent internal reliability within the subscales and total scale [49], and good inter-rater reliability, with strong positive correlations between child and parent reports. The moderate to strong relationship between parent–child responses is consistent with other studies which have found that observable behaviour such as interference leads to stronger relationships between parent–child responses [19].

Limitations

The current study had a small clinical sample and may not be representative of families seeking treatment. The over-representation of high-income families limits the generalisability of the study to broader community settings. A subset of the sample was from a panel provider CINT.com (n = 483), and there was no way to ensure that a child completed the survey. However, 309 children completed the measure under supervision.

The use of modification indices to improve model fit is another limitation. Modification indices can lead to model overfitting and may increase the risk of capitalizing on chance correlations, resulting in less generalisable and replicable factor solutions. The post hoc analyses allowed for a better model fit to be determined and all model covariances had a theoretical underpinning, refer to Supplement C for further information on theoretical justifications. Future research is required to confirm the factor structure.

Finally, the CADLIS provides an assessment of the total impact of anxiety and depressive symptoms, rather than the impact specifically attributed to either depression or anxiety alone.

Conclusion

The CADLIS is a reliable measure that demonstrates evidence of convergent validity for assessing life interference from anxiety and depressive symptoms in children aged 4–18.

The CALDIS is a short measure with only 9 items for children and 16 for parents thus it is a low survey burden and can easily be paired with a symptom measure or used independently without the need for a measure of symptoms. Importantly, the measure provides unique information regarding life interference when compared to a global impairment measure and can differentiate children with high and low anxiety and depressive symptoms. The factor structure indicated a total score for life interference is warranted for child report (CADLIS-C). For the parent report (CADLIS-P), the total score can be calculated in addition to a score for parent life interference and child life interference. With further testing in clinical samples, the CADLIS has the potential to be used during diagnostic assessments and as a screener tool.

Data availability

No datasets were generated or analysed during the current study.

References

  1. Lawrence D, Hafekost J, Johnson SE, Saw S, Buckingham WJ, Sawyer MG, Ainley J, Zubrick SR. Key findings from the second Australian child and adolescent survey of mental health and wellbeing. Aust N Z J Psychiatry. 2016;50(9):876–86. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/0004867415617836.

    Article  PubMed  Google Scholar 

  2. Sicouri G, March S, Pellicano E, De Young AC, Donovan CL, Cobham VE, Hudson JL. Mental health symptoms in children and adolescents during COVID-19 in Australia. Aust N Z J Psychiatry. 2022. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/00048674221090174.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Sicouri G, Perkes I, Hudson JL. Anxiety disorders in children and adolescents. Med Today. 2022;23(1–2):14–21.

    Google Scholar 

  4. Spoelma MJ, Sicouri GL, Francis DA, Songco AD, Daniel EK, Hudson JL. Estimated prevalence of depressive disorders in children from 2004 to 2019: a systematic review and meta-analysis. JAMA Pediatr. 2023;177(10):1017–1027. https://doiorg.publicaciones.saludcastillayleon.es/10.1001/jamapediatrics.2023.3221

  5. Garber J, Weersing VR. Comorbidity of anxiety and depression in youth: implications for treatment and prevention: comorbid anxiety and depression. Clin Psychol: Sci Pract. 2010;17(4):293–306. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/j.1468-2850.2010.01221.x.

    Article  Google Scholar 

  6. Hudson JL, Keers R, Roberts S, Coleman JRI, Breen G, Arendt K, Bögels S, Cooper P, Creswell C, Hartman C, Heiervang ER, Hötzel K, In-Albon T, Lavallee K, Lyneham HJ, Marin CE, McKinnon A, Meiser-Stedman R, Morris T, Eley TC. Clinical predictors of response to cognitive-behavioral therapy in pediatric anxiety disorders: the genes for treatment (GxT) study. J Am Acad Child Adolesc Psychiatry. 2015;54(6):454–63. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jaac.2015.03.018.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Rapee RM, Schniering CA, Hudson JL. Anxiety disorders during childhood and adolescence: origins and treatment. Ann Rev Clin Psychol. 2009;5(1):311–41. https://doiorg.publicaciones.saludcastillayleon.es/10.1146/annurev.clinpsy.032408.153628.

    Article  Google Scholar 

  8. Whiteside SP. Adapting the Sheehan disability scale to assess child and parent impairment related to childhood anxiety disorders. J Clin Child Adolesc Psychol. 2009;38(5):721–30. https://doiorg.publicaciones.saludcastillayleon.es/10.1080/15374410903103551.

    Article  PubMed  Google Scholar 

  9. American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders (DSM-V; 5th ed.). https://doiorg.publicaciones.saludcastillayleon.es/10.1176/appi.books.9780890425596

  10. Beesdo K, Pine DS, Lieb R, Wittchen H-U. Incidence and risk patterns of anxiety and depressive disorders and categorization of generalized anxiety disorder. Arch Gener Psychiatry. 2010;67(1):47. https://doiorg.publicaciones.saludcastillayleon.es/10.1001/archgenpsychiatry.2009.177.

    Article  Google Scholar 

  11. Cummings CM, Caporino NE, Kendall PC. Comorbidity of anxiety and depression in children and adolescents: 20 years after. Psychol Bull. 2014;140(3):816–45. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/a0034733.

    Article  PubMed  Google Scholar 

  12. Angold A, Costello EJ, Farmer EMZ, Burns BJ, Erkanli A. Impaired but undiagnosed. J Am Acad Child Adolesc Psychiatry. 1999;38(2):129–37. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/00004583-199902000-00011.

    Article  CAS  PubMed  Google Scholar 

  13. Lyneham HJ, Sburlati ES, Abbott MJ, Rapee RM, Hudson JL, Tolin DF, Carlson SE. Psychometric properties of the child anxiety life interference scale (CALIS). J Anxiety Disord. 2013;27(7):711–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.janxdis.2013.09.008.

    Article  PubMed  Google Scholar 

  14. Mobach L, Gould K, Hudson JL. Comorbidity in childhood anxiety disorders. In: Pediatric anxiety disorders. Elsevier; 2019. p. 277–98.

    Chapter  Google Scholar 

  15. Franco X, Saavedra LM, Silverman WK. External validation of comorbid patterns of anxiety disorders in children and adolescents. J Anxiety Disord. 2007;21(5):717–29. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.janxdis.2006.10.002.

    Article  PubMed  Google Scholar 

  16. Karlsson L, Pelkonen M, Ruuttu T, Kiviruusu O, Heilä H, Holi M, Kettunen K, Tuisku V, Tuulio-Henriksson A, Törrönen J, Marttunen M. Current comorbidity among consecutive adolescent psychiatric outpatients with DSM-IV mood disorders. Eur Child Adolesc Psychiatry. 2006;15(4):220–31. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s00787-006-0526-7.

    Article  PubMed  Google Scholar 

  17. Schleider JL, Weisz JR. Family process and youth internalizing problems: a triadic model of etiology and intervention. Dev Psychopathol. 2016;29(1):273–301. https://doiorg.publicaciones.saludcastillayleon.es/10.1017/s095457941600016x.

    Article  PubMed  Google Scholar 

  18. Starr LR, Davila J. Differentiating interpersonal correlates of depressive symptoms and social anxiety in adolescence: implications for models of comorbidity. J Clin Child Adolesc Psychol. 2008;37(2):337–49. https://doiorg.publicaciones.saludcastillayleon.es/10.1080/15374410801955854.

    Article  PubMed  Google Scholar 

  19. March JS, Parker JDA, Sullivan K, Stallings P, Conners CK. The multidimensional anxiety scale for children (MASC): factor structure, reliability, and validity. J Am Acad Child Adolesc Psychiatry. 1997;36(4):554–65. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/00004583-199704000-00019.

    Article  CAS  PubMed  Google Scholar 

  20. Creswell C, Nauta MH, Hudson JL, March S, Reardon T, Arendt K, Bodden D, Cobham VE, Donovan C, Halldorsson B, In-Albon T, Ishikawa S, Johnsen DB, Jolstedt M, Jong R, Kreuze L, Mobach L, Rapee RM, Spence SH, Kendall PC. Research review: recommendations for reporting on treatment trials for child and adolescent anxiety disorders—an international consensus statement. J Child Psychol Psychiatry. 2020. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/jcpp.13283.

    Article  PubMed  Google Scholar 

  21. Evans R, Thirlwall K, Cooper P, Creswell C. Using symptom and interference questionnaires to identify recovery among children with anxiety disorders. Psychol Assess. 2017;29(7):835–43. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/pas0000375.

    Article  PubMed  Google Scholar 

  22. Rapee RM, Bőgels SM, van der Sluis CM, Craske MG, Ollendick T. Annual research review: conceptualising functional impairment in children and adolescents: functional impairment in children and adolescents. J Child Psychol Psychiatry. 2012;53(5):454–68. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/j.1469-7610.2011.02479.x.

    Article  PubMed  Google Scholar 

  23. Langley AK, Bergman RL, McCracken J, Piacentini JC. Impairment in childhood anxiety disorders: preliminary examination of the child anxiety impact scale-parent version. J Child Adolesc Psychopharmacol. 2004;14(1):105–14. https://doiorg.publicaciones.saludcastillayleon.es/10.1089/104454604773840544.

    Article  PubMed  Google Scholar 

  24. Schniering CA, Forbes MK, Rapee RM, Wuthrich VM, Queen AH, Ehrenreich-May J. Assessing functional impairment in youth: development of the adolescent life interference scale for internalizing symptoms (ALIS-I). Child psychiatry Human Dev. 2023;54(2):508–19. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10578-021-01241-3.

    Article  Google Scholar 

  25. Keenan K, Feng X, Hipwell A, Klostermann S. Depression begets depression: comparing the predictive utility of depression and anxiety symptoms to later depression. J Child Psychol Psychiatry. 2009;50(9):1167–75. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/j.1469-7610.2009.02080.x.

    Article  PubMed  PubMed Central  Google Scholar 

  26. O’Neil KA, Podell JL, Benjamin CL, Kendall PC. Comorbid depressive disorders in anxiety-disordered youth: demographic, clinical, and family characteristics. Child Psychiatry Human Dev. 2010;41(3):330–41. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10578-009-0170-9.

    Article  Google Scholar 

  27. Guberman C, Manassis K. Symptomatology and family functioning in children and adolescents with comorbid anxiety and depression. J Can Acad Child Adolesc Psychiatry. 2011;20(3):186–95.

    PubMed  PubMed Central  Google Scholar 

  28. Brown TA, Barlow DH. Dimensional versus categorical classification of mental disorders in the fifth edition of the diagnostic and statistical manual of mental disorders and beyond: comment on the special section. J Abnorm Psychol. 2005;114(4):551–6. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/0021-843X.114.4.5.

    Article  PubMed  Google Scholar 

  29. Ehring T, Watkins ER. Repetitive negative thinking as a transdiagnostic process. Int J Cognit Ther. 2008;1(3):192–205. https://doiorg.publicaciones.saludcastillayleon.es/10.1521/ijct.2008.1.3.192.

    Article  Google Scholar 

  30. Australian Bureau of Statistics (2016) Socioeconomic Indexes for Australia (No. 2033.0.55.001). https://www.ausstats.abs.gov.au/ausstats/subscriber.nsf/0/756EE3DBEFA869EFCA258259000BA746/$File/SEIFA%202016%20Technical%20Paper.pdf

  31. Ebesutani C, Reise SP, Chorpita BF, Ale C, Regan J, Young J, Higa-McMillan C, Weisz JR. The revised child anxiety and depression scale-short version: scale reduction via exploratory bifactor modeling of the broad anxiety factor. Psychol Assess. 2012;24(4):833–45. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/a0027283.

    Article  PubMed  Google Scholar 

  32. Chorpita B, Moffitt C, Gray J. Psychometric properties of the revised child anxiety and depression scale in a clinical sample. Behav Res Ther. 2005;43:300–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.brat.2004.02.004.

    Article  Google Scholar 

  33. Ebesutani C, Korathu-Larson P, Nakamura BJ, Higa-McMillan C, Chorpita B. The revised child anxiety and depression scale 25–parent version: scale development and validation in a school-based and clinical sample. Assessment. 2017;24(6):712–28. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/1073191115627012.

    Article  PubMed  Google Scholar 

  34. Sheehan DV, Harnett-Sheehan K, Raj BA. The measurement of disability. Int Clin Psychopharmacol. 1996;11:89–95. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/00004850-199606003-00015.

    Article  PubMed  Google Scholar 

  35. Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40(11):1337–45. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/00004583-200111000-00015.

    Article  CAS  PubMed  Google Scholar 

  36. Goodman A, Lamping DL, Ploubidis GB. When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the strengths and difficulties questionnaire (SDQ): data from British parents, teachers and children. J Abnorm Child Psychol. 2010;38(8):1179–91. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10802-010-9434-x.

    Article  PubMed  Google Scholar 

  37. Kline RB (2011) Principles and practice of structural equation modeling, (3rd ed)

  38. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Eq Model: Multidiscip J. 1999;6(1):1–55. https://doiorg.publicaciones.saludcastillayleon.es/10.1080/10705519909540118.

    Article  Google Scholar 

  39. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/0033-2909.107.2.238.

    Article  CAS  PubMed  Google Scholar 

  40. Awang Z. A handbook on sem structural equation modelling: SEM using AMOS graphic. 5th ed. Kota Baru: Universiti Teknologi Mara Kelantan; 2012.

    Google Scholar 

  41. Wheaton B, Muthen B, Alwin DF, Summers GF. Assessing reliability and stability in panel models. Sociol Methodol. 1977;8:84. https://doiorg.publicaciones.saludcastillayleon.es/10.2307/270754.

    Article  Google Scholar 

  42. Field A. Discovering statistics using IBM SPSS statistics: (and sex and drugs and rock “n” roll). 4th ed. Los Angeles: Sage; 2013.

    Google Scholar 

  43. Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31–6. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/BF02291575.

    Article  Google Scholar 

  44. Marques T, Pereira AI, Pedro M, Russo V, Goes AR, Barros L. Preliminary analysis of the Portuguese version of the child anxiety life interference scale. Psicologia: Reflexão e Crítica. 2015;28(3):454–62. https://doiorg.publicaciones.saludcastillayleon.es/10.1590/1678-7153.201528304.

    Article  Google Scholar 

  45. Orgilés M, Fernández-Martínez I, Morales A, Melero S, Espada JP. Spanish validation of the child anxiety life interference scale (CALIS-C): psychometric properties, factorial structure and factorial invariance across gender. Child Psychiatry Human Dev. 2019;50(5):756–63. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10578-019-00879-4.

    Article  Google Scholar 

  46. Li SH, Beames JR, Newby JM, Maston K, Christensen H, Werner-Seidler A. The impact of COVID-19 on the lives and mental health of Australian adolescents. Eur Child Adolesc Psychiatry. 2021. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s00787-021-01790-x.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Gilbertson TJ, Morgan AJ, Rapee RM, Lyneham HJ, Bayer JK. Psychometric properties of the child anxiety life interference scale—preschool version. J Anxiety Disord. 2017;52:62–71. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.janxdis.2017.10.002.

    Article  PubMed  Google Scholar 

  48. Angold A, Costello EJ, Erkanli A. Comorbidity. J Child Psychol Psychiatry, Allied Discip. 1999;40(1):57–87. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/1469-7610.00424.

    Article  CAS  Google Scholar 

  49. Nunnally JC. An overview of psychological measurement. In: Wolman BB, editor. Clinical diagnosis of mental disorders. Boston: Springer; 1978.

    Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

MO and JL wrote the main manuscript text and prepared figures and tables. MA, AJ, EG and JH conducted data collection, preparation and analysis. All authors reviewed the manuscript.

Corresponding author

Correspondence to Jennifer L. Hudson.

Ethics declarations

Competing interest

The authors declare no competing interests.

Ethical approval

Ethics approval was granted by the Macquarie University Human Research Ethics Committee.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Gradey-Lee, M., Jones, A., Gandhi, E. et al. The psychometric properties of the child anxiety and depression life interference scale (CADLIS). Child Adolesc Psychiatry Ment Health 19, 6 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13034-024-00856-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13034-024-00856-3