Test Validation

Objective: Recognizing the prodrome of a first psychotic episode prospectively creates the opportunity of intervention, which could delay, ameliorate or even prevent onset. Valid criteria and a reliable methodology for identifying possible prodromes are needed. This paper describes an instrument, the Comprehensive Assessment of At-Risk Mental States (CAARMS), which has been designed for such a purpose. It has two functions: (i) to assess psychopathology thought to indicate imminent development of a first-episode psychotic disorder; and (ii) to determine if an individual meets criteria for being at ultra high risk (UHR) for onset of first psychotic disorder. This paper describes the pilot evaluation of the CAARMS.Method: Several methodologies were used to test the CAARMS. First, CAARMS scores in a group of UHR young people and the association between CAARMS scores and the risk of transition to psychotic disorder, were analysed. Second, CAARMS scores in a UHR group were compared to a control group. To assess concurrent validity, CAARMS-defined UHR criteria were compared to the existing criteria for identifying the UHR cohort. To assess predictive validity, the CAARMS-defined UHR criteria were applied to a sample of 150 non-psychotic help-seekers and rates of onset of psychotic disorder at 6-month follow-up determined for the CAARMS-positive (i.e. met UHR criteria) group and the CAARMS-negative (i.e. did not meet UHR criteria) group. The inter-rater reliability of the CAARMS was assessed by using pairs of raters.Results: High CAARMS score in the UHR group was significantly associated with onset of psychotic disorder. The control group had significantly lower CAARMS scores than the UHR group. The UHR criteria assessed by the CAARMS identified a similar group to the criteria measured by existing methodology. In the sample of non-psychotic help-seekers those who were CAARMS-positive were at significantly increased risk of onset of psychotic disorder compared to those who were CAARMS-negative (relative risk of 12.44 (95% CI = 1.5–103.41, p = 0.0025)). The CAARMS had good to excellent reliability.Conclusions: In these preliminary investigations, the CAARMS displayed good to excellent concurrent, discriminant and predictive validity and excellent inter-rater reliability. The CAARMS instrument provides a useful platform for monitoring subthreshold psychotic symptoms for worsening into full-threshold psychotic disorder.

SYNOPSISAs a part of a survey to study the health and living conditions of the elderly population, a random sample of residents aged 65 and over are examined using the Clinical Interview Schedule (CIS) in order to evaluate their psychiatric status. The aim of this study is to evaluate this standard method of assessment as a case-identification instrument in our country. The schedule was completed by 91 subjects. It is easily administered, easily scored, and economical on time. Its completion rate is high. The weighted total scores (WTS) range from 0 to 48. Using the case criteria defined by Cooper & Schwarz (1982), 27 subjects (30%) are considered cases and 64 (70%) are regarded as non-cases. The sensitivity coefficients for the WTS are examined against the overall severity rating at different cut-off points. The optimum cut-off can be anywhere between 16 and 20 points. The WTS has higher validity coefficients to detect the following diagnostic categories (sensitivity, specificity):...

To review the characteristics of psychiatric screening tools currently available in addiction treatment services for rapid assessment of comorbid pathology and to introduce the Centre for Addictions and Mental Health Concurrent Disorders Screener (CAMH-CDS), a computer-administered questionnaire that screens for the occurrence of 11 Axis I disorders plus all substance use disorders, as well as for a history of conduct disorder. We describe the structure, contents, and application of the CAMH-CDS. We undertook a sensitivity and specificity trial involving 171 subjects, a test-retest reliability study with 301 participants, and an open-label concordance study with 656 respondents. All subjects were regular clients of a major addiction treatment facility. The CAMH-CDS was easily and effectively used by addiction counsellors with limited or no mental health training. It has a low rate of false-negative responses, and it yields excellent test-retest reliability figures. It is highly sens...

A new measure of motivation toward education has been developed in French, namely the Echelle de Motivation en Education (EME). The EME is based on the tenets of self-determination theory and is composed of 28 items subdivided into seven sub-scales assessing three types of intrinsic motivation (intrinsic motivation to know, to accomplish things, and to experience stimulation), three types of extrinsic motivation (external, introjected, and identified regulation), and a motivation. The purpose of this investigation was to cross-culturally validate in English the EME. The EME was translated in English through appropriate methodological procedures and completed by university students. Results revealed that the English version of the scale renamed the Academic Motivation Scale (AMS), has satisfactory levels of internal consistency (mean alpha value = .81) and temporal stability over a one-month period (mean test-retest correlation = .79). In addition, results of a confirmatory factor an...

Introduction Obesity is a major health problem with an increasing risk of mortality, associated with comorbidities and high rates of dropout. Research demonstrated that pathological eating behaviors could help to phenotype obese patients thus tailoring clinical interventions. Therefore, our aim was to develop (study 1), validate (study 2), and test in a clinical setting (study 3) the Eating Behaviors Assessment for Obesity (EBA-O). Method Study 1 included the exploratory factor analysis (EFA) and McDonald's ω in a general population sample (N = 471). Study 2 foresaw the confirmatory factor analysis (CFA) and convergent validity in 169 participants with obesity. Study 3 tested the capability of the EBA-O to characterize eating behaviors in a clinical sample of 74 patients with obesity. Results Study 1. EFA identified five factors (i.e., food addiction, night eating, binge eating, sweet eating, and prandial hyperphagia), explaining 68.3% of the variance. The final EBA-O consisted of 18 items. McDonald's ω ranged between 0.80 (hyperphagia) and 0.92 (binge eating), indicating very good reliability. Study 2. A second-order five-factor model, through CFA, showed adequate fit: relative chi-square (χ 2 /df) = 1.95, CFI = 0.93, TLI = 0.92, RMSEA = 0.075, and SRMR = 0.06, thus suggesting the appropriateness of the EBA-O model. Significant correlations with psychopathological questionnaires demonstrated the convergent validity. Study 3. Significant associations between EBA-O factors and emotional-related eating behaviors emerged. Conclusion The EBA-O demonstrated to be a reliable and easy-to-use clinical tool to identify pathological eating behaviors in obesity, particularly useful for non-experts in eating disorders. Level of evidence Level V, descriptive research.

The aim of the present research was to further investigate (a) the structure of the Purpose in Life test (PIL) using confirmatory factor analytic techniques,(b) the reliability of PIL scores, and (c) the validity of the PIL. Participants were 357 social drinkers (not in alcohol treatment) and 137 treatment drinkers (in alcohol treatment). With the exclusion of 3 items, a unidimensional measurement model for the PIL provided an adequate fit for social and treatment drinkers. Model invariance analysis indicated that 6 of 17 PIL items had different pattern coefficients for the two groups of drinkers. The 17 items of the PIL demonstrated good measurement reliability for both groups of drinkers and good criterion-related validity