Claim validity of print advertisements found in otolaryngology journals

Objective: To evaluate the accuracy and scientific evidence supporting product claims made in print advertisements within otolaryngology journals. Design: Cross-sectional survey with literature review and multiple-reviewer evaluation. Fifty claims made within 23 unique advertisements found in prominent otolaryngology journals were selected. References to support the claims were provided within the advertisements or obtained through direct request to the manufacturer. Five academic otolaryngologists with distinct training and geographic practice locations reviewed the claims and supporting evidence. Each physician had substantial Experience as an editorial reviewer, and several had specific training in research methodology and scientific methods. Results: Of the 50 claims, only 14 were determined to be based on strong evidence (28%). With regard to the supporting references, 32 references were published sources (76%), while 3 references were package inserts and/or prescribing information (7%). Interobserver agreement among the reviewers overall was poor; however, when 3 or more of the reviewers were in agreement, only 10% of the claims were deemed correct (n=5). Reviewers also noted that only 6% of the claims were considered well supported (n=3). Conclusion: Advertisers make claims that appear in respectable journals, but greater than half of the claims reviewed were not supported by the provided reference materials.