TY - JOUR
T1 - Measurement Fidelity of Clinical Assessment Methods in a Global Study on Identifying Reproducible Brain Signatures of Obsessive–Compulsive Disorder
AU - Shavitt, Roseli G.
AU - Sheshachala, Karthik
AU - Hezel, Dianne M.
AU - Wall, Melanie M.
AU - Balachander, Srinivas
AU - Lochner, Christine
AU - Narayanaswamy, Janardhanan C.
AU - Costa, Daniel L.C.
AU - de Mathis, Maria Alice
AU - van Balkom, Anton J.L.M.
AU - de Joode, Niels T.
AU - Narayan, Madhuri
AU - van den Heuvel, Odile A.
AU - Stein, Dan J.
AU - Miguel, Euripedes C.
AU - Simpson, Helen Blair
AU - Reddy, Y. C.Janardhan
N1 - Publisher Copyright:
© 2022 American Psychological Association
PY - 2022/11/28
Y1 - 2022/11/28
N2 - Objective: To describe the steps of ensuring measurement fidelity of core clinical measures in a five-country study on brain signatures of obsessive–compulsive disorder (OCD). Method: We collected data using standardized instruments, which included the Yale–Brown Obsessive–Compulsive Scale (YBOCS), the Dimensional YBOCS (DYBOCS), the Brown Assessment of Beliefs Scale (BABS), the 17-item Hamilton Depression Scale (HAM-D), the Hamilton Anxiety Scale (HAM-A), and the Structured Clinical Interview for DSM-5 (SCID). Steps to ensure measurement fidelity included translating instruments, developing a clinical decision manual, and continuing reliability training with 11–13 transcripts of each instrument by 13 independent evaluators across sites over 4 years. We use multigroup confirmatory factor analysis (MGCFA) to report interrater reliability (IRR) among the evaluators and factor structure for each scale in 206 participantswith OCD. Results: The overall IRR formost scaleswas high (ICC > 0.94) and remained good to excellent throughout the study. Consistent factor structures (configural invariance) were found for all instruments across the sites, while similarity in the factor loadings for the items (metric invariance) could be established only for the DYBOCS and the BABS. Conclusions: It is feasible to achieve measurement fidelity of clinical measures in multisite, multilinguistic global studies, despite the challenges inherent to such endeavors. Future studies should not only report IRR but also consider reporting methods of standardization of data collection and measurement invariance to identify factor structures of core clinical measures.
AB - Objective: To describe the steps of ensuring measurement fidelity of core clinical measures in a five-country study on brain signatures of obsessive–compulsive disorder (OCD). Method: We collected data using standardized instruments, which included the Yale–Brown Obsessive–Compulsive Scale (YBOCS), the Dimensional YBOCS (DYBOCS), the Brown Assessment of Beliefs Scale (BABS), the 17-item Hamilton Depression Scale (HAM-D), the Hamilton Anxiety Scale (HAM-A), and the Structured Clinical Interview for DSM-5 (SCID). Steps to ensure measurement fidelity included translating instruments, developing a clinical decision manual, and continuing reliability training with 11–13 transcripts of each instrument by 13 independent evaluators across sites over 4 years. We use multigroup confirmatory factor analysis (MGCFA) to report interrater reliability (IRR) among the evaluators and factor structure for each scale in 206 participantswith OCD. Results: The overall IRR formost scaleswas high (ICC > 0.94) and remained good to excellent throughout the study. Consistent factor structures (configural invariance) were found for all instruments across the sites, while similarity in the factor loadings for the items (metric invariance) could be established only for the DYBOCS and the BABS. Conclusions: It is feasible to achieve measurement fidelity of clinical measures in multisite, multilinguistic global studies, despite the challenges inherent to such endeavors. Future studies should not only report IRR but also consider reporting methods of standardization of data collection and measurement invariance to identify factor structures of core clinical measures.
KW - harmonization
KW - interrater reliability
KW - measurement invariance
KW - multigroup confirmatory factor analysis
KW - obsessive–compulsive disorder
UR - http://www.scopus.com/inward/record.url?scp=85145844617&partnerID=8YFLogxK
U2 - 10.1037/neu0000849
DO - 10.1037/neu0000849
M3 - Article
C2 - 36442004
AN - SCOPUS:85145844617
SN - 0894-4105
VL - 37
SP - 330
EP - 343
JO - Neuropsychology
JF - Neuropsychology
IS - 3
ER -