Measurement Fidelity of Clinical Assessment Methods in a Global Study on Identifying Reproducible Brain Signatures of Obsessive–Compulsive Disorder

Roseli G. Shavitt, Karthik Sheshachala, Dianne M. Hezel, Melanie M. Wall, Srinivas Balachander, Christine Lochner, Janardhanan C. Narayanaswamy, Daniel L.C. Costa, Maria Alice de Mathis, Anton J.L.M. van Balkom, Niels T. de Joode, Madhuri Narayan, Odile A. van den Heuvel, Dan J. Stein, Euripedes C. Miguel, Helen Blair Simpson, Y. C.Janardhan Reddy

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Objective: To describe the steps of ensuring measurement fidelity of core clinical measures in a five-country study on brain signatures of obsessive–compulsive disorder (OCD). Method: We collected data using standardized instruments, which included the Yale–Brown Obsessive–Compulsive Scale (YBOCS), the Dimensional YBOCS (DYBOCS), the Brown Assessment of Beliefs Scale (BABS), the 17-item Hamilton Depression Scale (HAM-D), the Hamilton Anxiety Scale (HAM-A), and the Structured Clinical Interview for DSM-5 (SCID). Steps to ensure measurement fidelity included translating instruments, developing a clinical decision manual, and continuing reliability training with 11–13 transcripts of each instrument by 13 independent evaluators across sites over 4 years. We use multigroup confirmatory factor analysis (MGCFA) to report interrater reliability (IRR) among the evaluators and factor structure for each scale in 206 participantswith OCD. Results: The overall IRR formost scaleswas high (ICC > 0.94) and remained good to excellent throughout the study. Consistent factor structures (configural invariance) were found for all instruments across the sites, while similarity in the factor loadings for the items (metric invariance) could be established only for the DYBOCS and the BABS. Conclusions: It is feasible to achieve measurement fidelity of clinical measures in multisite, multilinguistic global studies, despite the challenges inherent to such endeavors. Future studies should not only report IRR but also consider reporting methods of standardization of data collection and measurement invariance to identify factor structures of core clinical measures.

Original languageEnglish
Pages (from-to)330-343
Number of pages14
JournalNeuropsychology
Volume37
Issue number3
DOIs
StatePublished - 28 Nov 2022
Externally publishedYes

Keywords

  • harmonization
  • interrater reliability
  • measurement invariance
  • multigroup confirmatory factor analysis
  • obsessive–compulsive disorder

Fingerprint

Dive into the research topics of 'Measurement Fidelity of Clinical Assessment Methods in a Global Study on Identifying Reproducible Brain Signatures of Obsessive–Compulsive Disorder'. Together they form a unique fingerprint.

Cite this