Measuring eating behavior and motivations in the United Arab Emirates and the United States: Evaluating measurement and predictive invariance of the Eating Disorder Examination Questionnaire-Short Form and the Eating Motivation Survey
Considerable proportions of college students in White, educated, industrialized, rich, and democratic countries, such as the United States, suffer from eating disorders and other problematic eating behaviors. The prevalence of eating disorders in Western Asia has been historically low but is rapidly increasing. One of the most dramatic increases is occurring in the United Arab Emirates. Advancements in eating disorder research and intervention that would benefit college students in the United Arab Emirates are inhibited by the lack of psychometrically sound measures of eating behaviors and motivations that have been empirically demonstrated to perform well in this population. The present study took initial steps in filling this need by evaluating the measurement and predictive invariance of the Eating Disorder Examination Questionnaire-Short Form and The Eating Motivation Survey using college student samples from the United Arab Emirates ( = 366) and United States ( = 317), followed by a series of cross-country comparisons. Results offer important evidence supporting the measurement invariance of both instruments and the predictive invariance of the The Eating Motivation Survey when used to predict scores on the Eating Disorder Examination Questionnaire-Short Form. Although no significant cross-country differences in eating disorder features and behaviors were found, some cross-country differences in eating motivations were observed. Similar eating motivations emerged in both countries as possible protective and risk factors for eating disorders. The implications of these findings for eating disorder assessment and practice are discussed, along with their implications for theory and research on eating motivations, nutritional health, and people's relationships with food. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Living up to expectations? A simulation study evaluating methods used to detect sudden gains and sudden losses
Sudden gains and sudden losses are abrupt, large changes in symptom severity between two consecutive psychotherapy sessions. Sudden gains (i.e., large improvements in symptom severity) seem to be associated with better treatment outcomes and have thus received considerable attention in clinical psychology over the last 2 decades. However, simulation studies indicate that the most common approach used to detect sudden gains is prone to misclassifications, implying that sudden gain research might be hindered by false positive and false negative findings. Although other sudden gain detection approaches exist, their performance has not yet been investigated and compared to the conventional method. To close this gap, we conducted a simulation study comparing the performance of the conventional approach and four alternative sudden gain detection approaches depending on the type of symptom trajectory, the number of measurements, the reliability of the measurement scores, and the amount of fluctuation around the trajectories. We found that all five detection approaches performed well in the simulation condition with nearly no variability (i.e., low reliability and small fluctuations). However, in conditions with medium or high variability in the data, all detection methods performed poorly. These results suggest that future studies should investigate further potential methods to detect sudden gains and/or examine ways to improve existing methods, such as by considering measurement error. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Does the Bayley-4 measure the same constructs across girls and boys and infants, toddlers, and preschoolers?
This study tested the assumption that the Bayley Scales of Infant and Toddler Development, Fourth Edition (Bayley-4) functions similarly for boys and girls and for four age groups. The Bayley-4 American norming sample of 1,700 children ages 0-42 months (3.5 years) was used, which included 50% boys and girls. Fifty-three percent of the children identified as White, 22.1% as Hispanic, 12.5% as Black, 8.5% as other, and 4.0% as Asian. A confirmatory factor analysis demonstrated the three-factor structure of cognitive, language, and motor abilities fit the data well (comparative fit index = .99, root-mean-square of error of approximation = .08, standardized root-mean-square residual = .02) and fit significantly better than the two- and one-factor models. The correlations between the latent factors were moderate ( = .73) to large sized ( = .81). Measurement and structural invariance were tested for boys and girls and four age groups (0-5, 6-13, 14-25, and 26-42 months). Residual invariance was supported for girls and boys, and intercept invariance was supported for the four age groups. The measurement invariance results suggest the Bayley-4 is not biased toward these gender and age groups, and group comparisons and decision making can be made with the Bayley-4 scores. Structural invariance findings suggested some differences for gender and age groups. The relations between the cognitive, language, and motor factors and factor variances were equal across girls and boys but differed significantly across the four age groups. Girls scored significantly higher on the three latent means, but these differences were small to negligible. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Evaluation of the Multidimensional Personality Questionnaire (MPQ) Unlikely Virtues Scale in the detection of underreporting
The current investigation was designed to examine the impact of underreporting response bias on the Multidimensional Personality Questionnaire (MPQ) and the utility of the Unlikely Virtues scale in detecting such responding. Study participants were randomly assigned to either the underreporting ( = 100) or standard instruction ( = 224) conditions. All participants first completed a series of extratest measures under standard instruction prior to the MPQ administration. The results showed that individuals in the underreporting condition scored significantly higher on MPQ scales that reflect positive emotionality and self-control and lower on scales that indicate negative emotionality compared to those in the standard instruction. Moreover, the psychometric validity of MPQ scale scores against extratest measures was substantially attenuated in the underreporting condition compared to the standard instruction condition. The Unlikely Virtues scale differentiated between the conditions at a large effect size magnitude (Hedges' = 1.21) and showed promising classification accuracy though lower cut scores than those reported in the MPQ manual performed substantially better with respect to sensitivity. Future research needs to replicate these findings in more naturalistic settings with other research designs. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Development and validation of a method for deriving MMPI-3 scores from MMPI-2/MMPI-2-RF item responses
The Minnesota Multiphasic Personality Inventory-3 (MMPI-3; Ben-Porath & Tellegen, 2020a) was developed to expand the content coverage of the MMPI-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011) and to update the test's norms to better represent the U.S. population. Because most MMPI-3 items were carried over from the MMPI-2-RF, most MMPI-3 scales can be either fully scored or prorated from the MMPI-2/MMPI-2-RF item pool. We describe development of a procedure for deriving MMPI-3 scores from MMPI-2/MMPI-2-RF protocols and examine the psychometric properties of prorated MMPI-3 scores across various samples. Following Tarescavage et al. (2016), who developed a method for prorating most MMPI-2-RF scores from the original MMPI, prorated MMPI-3 scales had to meet three criteria: (a) sufficient representation in the MMPI-2-RF item pool, (b) association with the full-length corresponding MMPI-3 scale at ≥ .90 in multiple samples, and (c) comparable T score means and standard deviations in multiple samples. These criteria resulted in the exclusion of the three MMPI-3 non-content-based Validity Scales, as well as nine Specific Problems Scales, yielding 16 MMPI-3 scales that can be fully scored and 24 for which psychometrically comparable prorated score estimates can be derived from responses to the MMPI-2 or MMPI-2-RF item pools. Evidence of the psychometric functioning of the resulting scale scores and their comparability with the full versions of these scales across samples is presented and discussed. This procedure provides a means to study 40 of the 52 MMPI-3 scales using archival data obtained with older versions of the inventory. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Prospectively predicting violent and aggressive incidents in prison practice with the Risk Screener Violence (RS-V): Results from a multisite prison study
Preventing in-prison violence and maintaining a safe environment is an important goal within prison settings. Screening for violence risk may provide a valuable addition to reach this goal. Within the Dutch prison system, the Risk Screener Violence (RS-V) has become an important new element in overall risk management. Prior research shows that RS-V scores are a sound predictor of institutional violence and aggression of incarcerated persons. Whereas previous studies predominantly analyzed retrospective file-based data, the present study includes RS-Vs rated by prison employees in real-life prison practice shortly after implementation. The RS-Vs of 956 detained individuals from 25 Dutch prisons were analyzed. Disciplinary reports were consulted to measure violent and aggressive incidents during 4 months after the screening. In addition, detention duration (length of stay in prison before the screening) was included as an additional variable. Results of the present prison practice study show good predictive values of the RS-V ratings for violent and aggressive incidents during prison stay. The predictive validity was similar for prisoner-to-prisoner assault as well as prisoner-to-staff assault. In addition, the predictive validity of the RS-V scores did not differ between individuals with a longer detention duration versus individuals with a shorter detention duration. This multisite prison practice study is an important step in the further validation of the RS-V and shows that the RS-V is a valuable tool in determining who is more likely to show institutional violence. Nonetheless, it remains important to continually monitor the implementation and correct application of the RS-V in prison practice. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Development of the Food Addiction Symptom Inventory: The first clinical interview to assess ultra-processed food addiction
Prior research on ultra-processed food addiction (FA) has utilized the self-report Yale Food Addiction Scale (YFAS) measures to identify individuals who experience indicators of substance-use disorders with respect to their consumption of ultra-processed foods. Studies using the YFAS have provided insight into the clinical utility of FA as both a distinct construct and an indicator of more severe psychopathology among individuals with eating disorders. However, the absence of clinician-administered assessment tools for FA has been identified as a barrier to the evaluation of FA as a novel clinical syndrome. Thus, the present study reflects the development of the Food Addiction Symptom Inventory (FASI), a clinician-administered assessment of FA, adapted from the Structured Clinical Interview for modules for diagnosing substance-use disorders. The psychometric properties of the FASI and its concordance with the YFAS 2.0 were evaluated in a cross-sectional study of adults ( = 53) with binge-type eating disorders. The FASI performed appropriately on indices of reliability and validity. Concordance between the FASI and YFAS 2.0 was established for the symptom scores ( = .53, < .001), and > 70% agreement was achieved for FA categorization. Using the FASI, 80% of individuals with bulimia nervosa and 91.7% of those with binge eating disorder were identified as exhibiting FA. While the YFAS 2.0 and FASI both lead to similar assessments of FA symptoms, the FASI provides an essential approach for clinician-guided identification of this phenotype, which may be particularly important when participants have high levels of dietary restraint or limited insight into the impact of their eating behavior. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
The Everyday Wellbeing Appraisal Scale: Assessing a type of subjective well-being uniquely associated with health behavior in people with hypertension
Everyday well-being appraisals are judgments about the goodness of recent daily life events. These appraisals are expected to be distinct from other types of well-being involving traits, affect, and psychological distress and expected to be uniquely important for understanding health behavior such as exercise, diet, and treatment adherence for people with medical conditions. To develop and test a new Everyday Wellbeing Appraisal Scale, two studies were conducted in which a total of 718 people with hypertension completed online questionnaires. In Study 1, to achieve maximum validity with the fewest number of items, an empirical analysis was used to select a set of six items with high discrimination that incorporated multiple types of response-option formats. In Study 2, the scale's unidimensional factor structure and high discrimination were confirmed, and the new scale outperformed several existing types of well-being scales in its ability to explain unique variance in health behavior criterion variables. Specifically, it explained unique variance in health behavior after controlling for a widely used measure assessing trait-level reflections of well-being, as well as measures of positive affect and two types of psychological distress. Also, when compared to the trait-level measure of well-being, the new scale demonstrated less overlap with affect and psychological distress. These results suggest that this brief, new scale is valuable for assessing a distinct construct that is especially salient for understanding health behavior. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Introducing the Narcissistic Antagonism Scale: A missing puzzle piece in the assessment of momentary narcissism
Narcissism is a relatively stable personality trait, which is most accurately described by three facets: agentic, antagonistic, and neurotic. Existing studies support the central role of antagonistic narcissism and its role in explaining the process of fluctuation in narcissism. However, there is a lack of a suitable adjective-based measure of antagonistic narcissism, resulting in intensive longitudinal studies assessing only agentic and neurotic narcissism. To address this gap and to advance research on fluctuations in narcissism, this article introduces the Narcissistic Antagonism Scale (NAS). Across six studies (total = 1,862; = 14,927 observations), we establish the NAS's factorial, convergent, and divergent validity; reliability; and temporal stability. The three-factor model of narcissism, including antagonistic aspects, reproduces and proves to be invariant across daily and momentary perspectives. The NAS exhibits good psychometric properties at both between- and within-person levels. It is a valuable addition for intensive longitudinal studies and facilitates a nuanced examination of narcissistic states across diverse contexts. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Initial development of a digitally based comprehensive child mental health questionnaire
The present report describes the item development and initial validation of a comprehensive child mental health questionnaire through a series of four studies. To maximize clinical utility, the questionnaire was developed to directly reflect psychiatric criteria and diagnoses, cover all mental health conditions that present in youth, and capitalize on the benefits of digital administration, particularly tiered branching logic. Study 1 describes the item generation and development of a tiered item structure. Study 2 established internal consistency and discriminant validity in a representative community sample of 1,000 youth aged 7-17 and a parent. Study 3 examined the acceptability of the questionnaire's content and structure to families and made indicated text revisions. Finally, Study 4 cross validated the internal consistency and tiered structure of a revised version of the questionnaire in a second representative normative sample of 1,000 parent and child dyads. The four studies resulted in a questionnaire consisting of one general mental health question (parent-report only), 16 items (for both parent and child) on a diagnostic category checklist, and 40 scales with screener and follow-up items reflecting DSM-5 criteria for specific disorders (371 parent items and 326 child items). The data support the potential of the questionnaire to efficiently assess the breadth of youth psychiatric symptoms efficiently. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Development and validation of the Parental Affection/Warmth Scale (PAWS) in a sample of parents of 2- to 8-year-olds
Parental warmth is a treatment target of emerging interventions for children with callous-unemotional traits. However, research to date has yet to examine the empirical structure of parental warmth toward young children due to the lack of clinically feasible, psychometrically sound, and comprehensive measures of warmth for this population. To address this knowledge gap, the present study developed and tested the psychometric properties of a self-report measure of parental warmth, the Parental Affection/Warmth Scale (PAWS). A sample of 899 parents of 2- to 8-year-old children ( = 4.77 years, = 1.95; 46.1% girls) was recruited online using Amazon's Mechanical Turk and CloudResearch. Exploratory factor analysis identified a novel three-factor structure: Warmth, Toddler-oriented Interaction, and Play-based Interaction, which was validated by a confirmatory factor analysis. However, only the PAWS Warmth subscale functioned consistently with theoretical expectations. PAWS Warmth scores were internally consistent; convergent with existing positive parenting scales; discriminant from negative parenting scales; and concurrent with child empathy, callous-unemotional traits, and conduct problems. Findings have implications for refining treatment targets for interventions focused on enhancing parental warmth. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
The impact of demoralization on the stability of personality traits in a clinical sample
This study examined whether reductions in the severity of personality disorders (PD) mainly reflect changes in personality traits or rather an alleviation of a demoralized state involving nonspecific unpleasant affect. We used 4 years of longitudinal data from the Collaborative Longitudinal Personality Disorders Study, in which patients ( = 419) completed the Neuroticism-Extraversion-Openness Personality Inventory-Revised (NEO-PI-R) three times over 4 years (at baseline and at 6-month and 4-year follow-up assessments). We compared the NEO Demoralization scale with NEO-PI-R domain scales adjusted for demoralization-related items to determine whether changes in demoralization are more pronounced than changes in adjusted personality traits. Results showed that adjusted Neuroticism and Demoralization changed at similar rates and both changed more than other traits. These changes were most pronounced in the first 6 months and tapered thereafter. Rank-order correlations were somewhat lower for Demoralization than adjusted traits. Our findings suggest that decreases in PD symptoms over time have to do with reductions in negative affect and that Demoralization as assessed via a subset of NEO-PI-R items is limited in its ability to distinguish negative affect from trait Neuroticism. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Concurrent and prospective prediction of community-dwelling adults' psychosocial functioning with the Inventory of Depression and Anxiety Symptoms-II (IDAS-II)
Mood and anxiety disorders involve defining symptoms (e.g., dysphoria, anhedonia) that can impair psychosocial functioning (e.g., self-care, work, social relationships). The present study evaluated the validity of the Inventory of Depression and Anxiety Symptoms-II (IDAS-II; Watson et al., 2012) via convergence with a semistructured interview assessing mood and anxiety disorder symptoms and, moreover, prediction of psychosocial functioning. Community-dwelling adults ( = 601) completed the self-report IDAS-II, a semistructured diagnostic interview, and self-report and interview measures of psychosocial functioning. A retest subsample (s = 497-501) completed the functioning measures again, on average 8 months later. Supporting our hypotheses, the IDAS-II converged robustly with interview-assessed symptoms and predicted psychosocial functioning significantly, both concurrently and prospectively. Moreover, the IDAS-II predicted functioning significantly better than did the diagnostic interview. These findings support use of the IDAS-II in research and clinical settings to assess mood and anxiety symptoms and their connections to psychosocial impairment. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Compliance and response consistency in a lengthy intensive longitudinal data protocol
Research on real-world patterns of substance use increasingly involves intensive longitudinal data (ILD) collection, requiring long assessment windows. The present study extends limited prior research examining event- and person-level influences on compliance and response consistency by investigating how these behaviors are sustained over time in an ILD study of alcohol and cannabis co-use in college students. Participants ( = 316) completed two 28-day bursts of ILD comprising five daily surveys, which included a morning survey of prior-day drinking. We used linear mixed effects models in a multilevel interrupted time series framework to evaluate the associations of time and measurement burst with (a) noncompliance (count of missed surveys) and (b) response consistency (difference between same-day report of drinking and morning report of prior-day drinking). We observed that time was positively associated with noncompliance, with no discontinuity associated with measurement burst. The slope of time was more positive in the second burst. Neither time nor measurement burst were significantly associated with consistent reporting. However, survey nonresponse and consistency of responding appeared to be impacted by the same-day use of substances. Overall, compliance decreased while consistency was stable across the duration of a lengthy ILD protocol. Shorter assessment windows or adaptive prompting strategies may improve overall study compliance. Further work examining daily burden and context is needed to inform future ILD design. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Cognitive Disengagement Syndrome-Clinical Interview (CDS-CI): Psychometric support for caregiver and youth versions
Cognitive disengagement syndrome (CDS), formerly termed sluggish cognitive tempo, is a set of symptoms characterized by excessive daydreaming, mental confusion, and slowed behavior/thinking. CDS is distinct from symptoms of attention-deficit/hyperactivity disorder (ADHD) and other psychopathologies and uniquely associated with functional impairment. However, despite significant progress in developing and evaluating rating scale measures of CDS, no clinical interview of CDS exists with established psychometric properties that can facilitate a multimethod approach assessing CDS. Accordingly, the present study evaluated the psychometric properties of the semistructured Cognitive Disengagement Syndrome-Clinical Interview (CDS-CI). The CDS-CI and the ADHD inattention (ADHD-IN) and hyperactive-impulsivity (ADHD-HI) modules from the Kiddie Schedule of Affective Disorders and Schizophrenia for School-Age Children (K-SADS) were administered to a sample of early adolescents ( = 341, ages 10-12 years) and their caregivers. Adolescents and caregivers also completed rating scale measures of CDS and ADHD symptoms. The CDS-CI demonstrated high internal consistency and interrater reliability. CDS-CI scores showed excellent same-source discriminant validity from K-SADS, ADHD-IN, and ADHD-HI scores and encouraging convergent and discriminant validity with rating scale measures, especially for caregivers. Above and beyond K-SADS, ADHD-IN, and ADHD-HI scores, higher parent and adolescent CDS-CI scores were both significantly associated with greater functional impairment. A threshold of ≥ 6 out of 15 symptoms was selected as an initial threshold for determining clinically elevated CDS using the CDS-CI. Findings provide psychometric support for the CDS-CI as a tool in the multimethod assessment of CDS. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Proposing a more conservative Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Effort Index cutoff score for forensic inpatient populations
The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Effort Index (EI) may be unreliable at its standard recommended cutoff score when used with forensic psychiatric inpatient populations given high rates of genuine cognitive impairment. The present study sought to (a) examine the rate of invalid performance on the RBANS EI using the standard cutoff among incompetent to stand trial (IST) inpatients and (b) investigate the psychometric properties of the RBANS EI at various cutoff scores. This study was conducted using archival assessment data collected at a large forensic psychiatric hospital. Across the entire sample ( = 238, 79% male, = 45 years, 24% primary Spanish-speaking), 79% were diagnosed with a schizophrenia spectrum disorder. Experiment 1 of the study ( = 165) contained IST patients who were classified as having a valid presentation. Experiment 2 contained a valid ( = 46) and invalid ( = 27) presentation group comprised of postadjudication and IST inpatients, respectively. In Experiment 1, over one third (36.4%) of the valid presentation sample scored above the standard recommended EI cutoff. In Experiment 2, applying the standard recommended cutoff score of > 3 was associated with a false positive rate of over 20%. Obtaining < 10% false positive errors was achieved at a cutoff score of > 5. At this cutoff score, the estimated local base rate of invalid responding among IST patients was 28%. Clinical and forensic implications and recommendations for adopting this more conservative RBANS EI cutoff score are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Risk to reoffend changes over time: Improving correctional programming through progress monitoring
Progress monitoring is integral to evidence-based practice. Correctional settings, especially the supervision of individuals who commit sexual offenses, elicit public concern; negative outcomes can be catastrophic. Using a prospective longitudinal study of 2,939 men with a history of sexual offenses undergoing community supervision, we examined different models of progress monitoring and how they should inform the assessment of risk for sexual recidivism. We found that the most recent assessment scores of the ACUTE-2007 and STABLE-2007 sexual recidivism risk tools provided the best information about reoffending risk compared to using (a) the worst period of adjustments (i.e., highest risk score), (b) the best period of adjustments (i.e., lowest risk score), or (c) a rolling average of scores. We also found that the latest STABLE-2007 scores incrementally predicted sexual recidivism beyond baseline risk as assessed by demographic and criminal history variables (Static-99R). We conclude that the risk for sexual recidivism changes over time and that community corrections is advanced by repeated assessment of dynamic (changeable) risk factors. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Measurement invariance of the Suicide Cognitions Scale-Revised (SCS-R)
The Suicide Cognitions Scale-Revised (SCS-R) is a unidimensional measure of suicidal cognitions theorized to assess the suicide belief system. Several solutions have been proposed for the Suicide Cognitions Scale and SCS-R (e.g., bifactor model with two specific factors, bifactor model with two specific factors, three correlated factors model). Research indicates the endorsement of thoughts of suicide and suicide-related cognitions varies across demographics. Thus, the current investigation tested the measurement invariance (MI) of the SCS-R across gender, race, and sexual orientation within these proposed solutions and a unidimensional model. A national sample of = 10,625 adults completed an online survey that included the SCS-R and self-report measures of demographics. Results indicated that the bifactor model with three specific factors, the bifactor model with two specific factors, and the three correlated factors models achieved scalar invariance across gender, race, and sexual orientation; a unidimensional model was not scalar invariant by gender. Tests of latent mean differences revealed significant differences in the general factor (i.e., suicidal belief system) and the specific unlovability, unbearability, and unsolvability factors between a few demographic groups. Implications for theory, measurement, and modeling are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
The Inventory of Callous-Unemotional Traits (ICU) self-report version: Factor structure, measurement invariance, and predictive validity in justice-involved male adolescents
The Inventory of Callous-Unemotional Traits (ICU) is a widely used measure of callous-unemotional (CU) traits that may aid in the assessment of the diagnostic specifier "with limited prosocial emotions," which has been added to diagnostic criteria for conduct disorder. Though there is substantial support for use of the ICU total score, the scale's factor structure has been highly debated. Inconsistencies in past factor analyses may be largely attributed to failure to control for method variance due to item wording (i.e., half of the items being worded in the callous direction and half worded in the prosocial direction). Thus, the present study used a multitrait-multimethod confirmatory factor analytic approach that models both trait and method variance to test the factor structure of the ICU self-report in a clinically relevant, high-risk sample of justice-involved male adolescents ( = 1,216). When comparing the fit of empirical and theoretical models, goodness of fit indices (χ² = 1105.877, = 190, root-mean-square error of approximation = .063, comparative fit index = .916, Tucker-Lewis index = .878, standardized root-mean-square residual = .051) provided support for a hierarchical four-factor model (i.e., one overarching callous-unemotional factor, four latent trait factors) when accounting for method variance (i.e., covarying positively worded items). This factor structure is consistent with the way the ICU was constructed and with criteria for the limited prosocial emotions specifier. In addition, measurement invariance of this factor structure across age, race, and ethnicity was supported, and the predictive validity of the ICU was supported across these demographic groups in predicting self-reported antisocial behavior and rearrests over a 5-year period following an adolescent's first arrest. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Measurement invariance of the higher-order model of Preschool Anxiety Scale (PAS) across child age, gender, parental anxiety, and pandemic period in England
The Preschool Anxiety Scale (PAS) is a parent-report scale measuring young children's anxiety symptoms involving five specific anxiety symptoms (separation anxiety, physical injury fears, social phobia, obsessive-compulsive disorder, generalized anxiety) that load on a higher-order factor representing general anxiety shared by all specific anxiety symptom subtypes. Although the PAS has been widely used to assess anxiety symptoms in young children, few studies have tested its measurement invariance for group comparisons. Using data from a sample of 2,221 children and their parents/carers in the United Kingdom, this study investigated the measurement invariance of the higher-order model of the PAS across child age (4-6 years vs. 6-7 years), gender (girls vs. boys), parental anxiety (low vs. high level), and children's living circumstances (before vs. after the removal of COVID-19 restrictions). Our findings demonstrated the good factor structure, internal consistency, and convergent validity of the higher-order model of the PAS in all subgroups and supported its configural, metric, and scalar invariance across these subgroups. Therefore, the findings suggest that the PAS is a reliable and valid instrument for assessing specific anxiety symptoms and general anxiety among young children in the United Kingdom and that comparisons can be made between the subgroups under examination. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Identifying analogue samples of individuals with clinically significant social anxiety: Updating and combining cutoff scores on the Social Phobia Inventory and Sheehan Disability Scale
The use of analogue samples, as opposed to clinical groups, is common in mental health research, including research on social anxiety disorder (SAD). Recent observational and statistical evidence has raised doubts about the validity of current methods for establishing analogue samples of individuals with clinically significant social anxiety. Here, we used data from large community samples of clinical and nonclinical participants to determine new cutoff scores on self-report measures of social anxiety symptoms and symptom-related impairment. We then examined whether using these newly determined cutoff scores alone or in combination improves the identification of individuals who have SAD from those who do not, revealing the most ideal cutoff combination to be 34 or above on the Social Phobia Inventory and 11 or above on the Sheehan Disability Scale. Finally, we compared the effects of our new cutoff scores with old cutoff scores by extracting analogue samples of participants with high social anxiety from historical data on seven large groups of undergraduate Psychology research participants from the authors' institution spanning the past 5 years (2018-2023). We observed that the new combined cutoff scores identified markedly fewer students as having high social anxiety, lending credibility to their utility. We also observed a striking increase in levels of social anxiety symptoms in the undergraduate population from before to after the COVID-19 pandemic. Of note, most participants were under 30 and identified as Caucasian or Asian women, indicating that future research is needed to examine whether our findings generalize to diverse populations. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Reexamining gender differences and the transdiagnostic boundaries of various conceptualizations of perseverative cognition
Research examining gender differences in perseverative cognition (repetitive, negative, and difficult-to-control thoughts) has focused on depressive rumination and internalizing syndromes. This study examines the transdiagnostic role of depressive rumination, anger rumination, and repetitive negative thinking across gender on internalizing and externalizing symptoms. Utilizing an ethnoracially diverse sample (33% Black, 35% Latinx, 32% White non-Hispanic) of = 1,187 young adults (49.5% women), we found equivalent instrument functioning across gender for depressive rumination (specifically brooding), anger rumination, and internalizing problems. Differential item functioning was found for repetitive negative thinking and externalizing problems; partial metric and scalar invariance were established for repetitive negative thinking, and partial metric invariance was established for externalizing problems. After accounting for bias in measurement, women engaged in more perseverative cognition, though effects were small for brooding and anger rumination and large for repetitive negative thinking. Different types of perseverations were positively associated with internalizing and externalizing symptoms across gender. Perseverative cognition may be a transdiagnostic mechanism beyond internalizing problems. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Latent structure and measurement invariance of the Depression Self-Rating Scale for Children across sex and age
Measurement tools from which valid interpretations can be made are critical for assessing early emerging depressive symptoms, as depressive symptoms in childhood are associated with increased risk for early-onset depressive disorder, recurrence, suicidality, and other psychopathology. The Depression Self-Rating Scale for Children (DSRS) is a widely used self-report scale assessing youth depressive symptoms. The relatively few studies investigating the DSRS' latent structure have yielded mixed results, and measurement invariance (MI) based on sex and age has not been examined. We examined the factor structure and MI of the DSRS across sex and age in a community sample of 6-9-year-olds ( = 352; = 7.57 years, = .70). Consistent with the largest prior structural study of the DSRS, a two-factor structure, with factors reflecting elevated negative affect (NA) and low positive affect (PA), showed strong model fit. Although this structure was consistent across sex and age (i.e., configural invariance), loadings of DSRS items varied across sex and age (i.e., metric noninvariance). Allowing the loadings of items contributing to noninvariance to vary across groups improved model fit. Implications for the clinical and research utility of the DSRS and suggestions for future research are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Psychometric properties of the German versions of the Problem Areas in Diabetes Scale for Children (PAID-C) with Type 1 Diabetes and Their Parents (P-PAID-C)
Children with Type 1 diabetes (T1D) and their parent-caregivers often experience diabetes distress due to the daily demands of diabetes management. Regular screening for diabetes distress is needed to prevent the deterioration of metabolic control and the development of mental health disorders. The aim of this analysis was to examine the psychometric properties of the German versions of the Problem Areas in Diabetes Scale for Children (PAID-C) and for caregiver burden in Parents (P-PAID-C). Data were collected from 136 children aged 7-12 years (46.7% females) and 304 parents (Mage = 42.9 (SD 6.1) years; 78% mothers) by using linguistically translated questionnaires in a multicenter study. Confirmatory factor analysis and correlational analyses were conducted. Results confirmed the two-factor model for the PAID-C and the four-factor model for the P-PAID-C with a slight modification. Cronbach's αs for children and parents were 0.88 and 0.92, respectively. The PAID-C and P-PAID-C scores had small positive associations with HbA1c (rs = .220 and .139, respectively, all p < .05) and strong inverse association with the KIDSCREEN-10 index (r = -.643 and -.520, respectively, all p < .001). P-PAID-C scores increased with increasing depressive symptoms measured in nine-item Patient Health Questionnaire among parents (rs = .534, p < .001). The scores produced by the German PAID-C and P-PAID-C were reliable and valid in measuring diabetes burdens. These German versions of PAID can be utilized to assess diabetes-specific distress and to design interventions for children and their parents experiencing high levels of diabetes distress. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Reliability and validity of the Chinese version of the Structured Interview of Personality Organization-Revised (STIPO-R)
With the publication of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders, a set of dimensional criteria was added as an emerging alternative model to the diagnosis of personality disorder (PD; American Psychiatric Association, 2013). Parallel to this, within the object relations conceptualization of personality pathology, a structured interview, the Structured Interview of Personality Organization (STIPO), was developed to assess pathological personality and then revised (STIPO-R). In this study, the reliability and validity of the Chinese version of the STIPO-R were tested on a sample of 236 Chinese participants, including both psychiatric patients and healthy individuals. Overall, the STIPO-R showed good internal consistency, interrater and test-retest reliability, and generally satisfactory results in structure and convergent validity. The STIPO-R also demonstrated discriminant validity (healthy individuals vs. psychiatric patients with PD vs. psychiatric patients without PD). Results are also discussed in light of cultural differences between Chinese and Western cultures. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Locating triarchic model constructs in the hierarchical structure of a comprehensive trait-based psychopathy measure: Implications for research and clinical assessment
The triarchic model posits that distinct trait constructs of boldness, meanness, and disinhibition underlie psychopathy. The triarchic model traits are conceptualized as biobehavioral dimensions that can be assessed using different sets of indicators from alternative measurement modalities; as such, the triarchic model would hypothesize that these traits are not confined to any one item set. The present study tested whether the triarchic model dimensions would emerge from a hierarchical-structural analysis of the facet scales of the Elemental Psychopathy Assessment (EPA), an inventory designed to comprehensively index psychopathy according to the five-factor personality model. Study participants (s = 811, 170) completed the EPA and three different scale sets assessing the triarchic traits along with criterion measures of antisocial/externalizing behaviors. Bass-ackwards modeling of the EPA facet scales revealed a four-level structure, with factors at the third level appearing similar to the triarchic trait dimensions. An analysis in which scores for the Level-3 EPA factors were regressed onto corresponding latent-trait dimensions defined using the different triarchic scale sets revealed extremely high convergence (βs = .84-.91). The Level-3 EPA factors also evidenced validity in relation to relevant criteria, approximating and sometimes exceeding that evident for the Level-4 EPA factors. Together, these results indicate that the triarchic trait constructs are embedded in a psychopathy inventory designed to align with a general personality model and effectively predict pertinent external criteria. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Beyond frequency: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil
Assessment tools for depression and anxiety usually inquire about the frequency of symptoms. However, evidence suggests that different question framings might trigger different responses. Our aim is to test if asking about symptom's context, ability, duration, and botherment adds validity to Patient Health Questionnaire-9, General Anxiety Disorder-7, and Patient-Related Outcome Measurement Information Systems depression and anxiety. Participants came from two cross-sectional convenience-sampled surveys ( = 1,871) of adults (66% females, aged 33.4 ± 13.2), weighted to approximate with the state-level population. We examined measurement invariance across the different question frames, estimated whether framing affected mean scores, and tested their independent validity using covariate-adjusted and sample-weighted structural equation models. Validity was tested using tools assessing general disability, alcohol use, loneliness, well-being, grit, and frequency-based questions from depression and anxiety questionnaires. A bifactor model was applied to test the internal consistency of the question frames under the presence of a general factor (i.e., depression or anxiety). Measurement invariance was supported across the different frames. Framing questions as ability (i.e., "How easily …") produced a higher score, compared with framing by context (i.e., "In which daily situations …"). Construct and criterion validity analysis demonstrate that variance explained using multiple question frames was similar to using only one. We detected a strong overarching factor for each instrument, with little variances left to be explained by the question frame. Therefore, it is unlikely that using different adverbial phrasings can help clinicians and researchers to improve their ability to detect depression or anxiety. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Base rates of failure on various performance validity tests as a function of age in adults referred for neuropsychological assessment
This study aimed to investigate the relationship between age and base rates of failure (BR) on various performance validity tests (PVTs) administered in medical-legal settings. Archival data were analyzed from 3,297 adults (M = 42.3 years; M = 11.2) referred for psychological or neuropsychological assessments in a medical-legal or forensic civil disability context who passed the Word Memory Test. BR on 10 PVTs (three freestanding and seven embedded) were reported at multiple cutoffs across five age groups ranging from 16 years to 69 years. BR increased with age on most embedded PVTs, with a couple of notable exceptions. Reliable Digit Span was unrelated to age at ≤6 but produced elevated BR among older examinees at ≤7. Within freestanding PVTs, a positive relationship emerged between age and BR on most instruments/cutoffs. Older age is associated with an increased risk of false positive errors on many embedded PVTs that rely on raw scores. Although freestanding PVTs tend to be more resistant to the effects of age, several commonly used cutoffs may still produce increased false positive rates in older examinees. Taken together, results suggest that PVT scores should be interpreted in the context of patient characteristics, in an evidence-based manner, rather than by rigidly applying omnibus cutoffs. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Estimating classification consistency of machine learning models for screening measures
This article illustrates novel quantitative methods to estimate classification consistency in machine learning models used for screening measures. Screening measures are used in psychology and medicine to classify individuals into diagnostic classifications. In addition to achieving high accuracy, it is ideal for the screening process to have high classification consistency, which means that respondents would be classified into the same group every time if the assessment was repeated. Although machine learning models are increasingly being used to predict a screening classification based on individual item responses, methods to describe the classification consistency of machine learning models have not yet been developed. This article addresses this gap by describing methods to estimate classification inconsistency in machine learning models arising from two different sources: sampling error during model fitting and measurement error in the item responses. These methods use data resampling techniques such as the bootstrap and Monte Carlo sampling. These methods are illustrated using three empirical examples predicting a health condition/diagnosis from item responses. R code is provided to facilitate the implementation of the methods. This article highlights the importance of considering classification consistency alongside accuracy when studying screening measures and provides the tools and guidance necessary for applied researchers to obtain classification consistency indices in their machine learning research on diagnostic assessments. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Applying the PTSD Checklist-Civilian and PTSD Checklist for DSM-5 crosswalk in a traumatic brain injury sample: A veterans affairs traumatic brain injury model systems study
This study evaluates the use of the crosswalk between the PTSD Checklist-Civilian (PCL-C) and PTSD Checklist for DSM-5 (PCL-5) designed by Moshier et al. (2019) in a sample of service members and veterans (SM/V; N = 298) who had sustained a traumatic brain injury (TBI) and were receiving inpatient rehabilitation. The PCL-C and PCL-5 were completed at the same time. Predicted PCL-5 scores for the sample were obtained according to the crosswalk developed by Moshier et al. We used three measures of agreement: intraclass correlation coefficient (ICC), mean difference between predicted and observed scores, and Cohen's κ to determine the performance of the crosswalk in this sample. Subgroups relevant to those who have sustained a TBI, such as TBI severity, were also examined. There was strong agreement between the predicted and observed PCL-5 scores (ICC = .95). The overall mean difference between predicted and observed PCL-5 scores was 0.07 and not statistically significant (SD = 8.29, p = .89). Significant mean differences between predicted and observed PCL-5 scores calculated between subgroups were seen in Black participants (MD = -4.09, SD = 8.41, p = .01) and those in the Year 5 follow-up group (MD = 1.77, SD = 7.14, p = .03). Cohen's κ across subgroups had a mean of κ = 0.76 (.57-1.0), suggesting that there was moderate to almost perfect diagnostic agreement. Our results suggest the crosswalk created by Moshier et al. can be applied to SM/V who have suffered a TBI. (PsycInfo Database Record (c) 2024 APA, all rights reserved).