TY - JOUR
T1 - How are Patients Describing You Online? A Natural Language Processing Driven Sentiment Analysis of Online Reviews on CSRS Surgeons
AU - Tang, Justin
AU - Arvind, Varun
AU - White, Christopher A.
AU - Dominy, Calista
AU - Cho, Samuel
AU - Kim, Jun S.
N1 - Publisher Copyright:
Copyright © 2022 Wolters Kluwer Health, Inc. All rights reserved.
PY - 2023/3/1
Y1 - 2023/3/1
N2 - Study Design: A quantitative analysis of written, online reviews of Cervical Spine Research Society (CSRS) surgeons. Objective: This study quantitatively analyzes the written reviews of members of the CSRS to report biases associated with demographic factors and frequently used words in reviews to help aid physician practices. Summary of Background Data: Physician review websites have influence on a patient's selection of a provider, but written reviews are subjective. Sentiment analysis of writing through artificial intelligence can quantify surgeon reviews to provide actionable feedback. Methods: Online written and star-rating reviews of CSRS surgeons were obtained from healthgrades.com. A sentiment analysis package was used to obtain compound scores of each physician's reviews. The relationship between demographic variables and average sentiment score of written reviews were evaluated through t-tests. Positive and negative word and bigram frequency analysis was performed to indicate trends in the reviews' language. Results: In all, 2239 CSRS surgeon's reviews were analyzed. Analysis showed a positive correlation between the sentiment scores and overall average star-rated reviews (r 2=0.60, P<0.01). There was no difference in review sentiment by provider sex. However, the age of surgeons showed a significant difference as those <55 had more positive reviews (mean=+0.50) than surgeons >=55 (mean=+0.37) (P<0.01). The most positive reviews focused both on pain and behavioral factors, whereas the most negative focused mainly on pain. Behavioral attributes increased the odds of receiving positive reviews while pain decreased them. Conclusion: The top-rated surgeons were described as considerate providers and effective at managing pain in their most frequently used words and bigrams. However, the worst-rated ones were mainly described as unable to relieve pain. Through quantitative analysis of physician reviews, pain is a clear factor contributing to both positive and negative reviews of surgeons, reinforcing the need for proper pain expectation management. Level of Evidence: Level 4 - retrospective case-control study.
AB - Study Design: A quantitative analysis of written, online reviews of Cervical Spine Research Society (CSRS) surgeons. Objective: This study quantitatively analyzes the written reviews of members of the CSRS to report biases associated with demographic factors and frequently used words in reviews to help aid physician practices. Summary of Background Data: Physician review websites have influence on a patient's selection of a provider, but written reviews are subjective. Sentiment analysis of writing through artificial intelligence can quantify surgeon reviews to provide actionable feedback. Methods: Online written and star-rating reviews of CSRS surgeons were obtained from healthgrades.com. A sentiment analysis package was used to obtain compound scores of each physician's reviews. The relationship between demographic variables and average sentiment score of written reviews were evaluated through t-tests. Positive and negative word and bigram frequency analysis was performed to indicate trends in the reviews' language. Results: In all, 2239 CSRS surgeon's reviews were analyzed. Analysis showed a positive correlation between the sentiment scores and overall average star-rated reviews (r 2=0.60, P<0.01). There was no difference in review sentiment by provider sex. However, the age of surgeons showed a significant difference as those <55 had more positive reviews (mean=+0.50) than surgeons >=55 (mean=+0.37) (P<0.01). The most positive reviews focused both on pain and behavioral factors, whereas the most negative focused mainly on pain. Behavioral attributes increased the odds of receiving positive reviews while pain decreased them. Conclusion: The top-rated surgeons were described as considerate providers and effective at managing pain in their most frequently used words and bigrams. However, the worst-rated ones were mainly described as unable to relieve pain. Through quantitative analysis of physician reviews, pain is a clear factor contributing to both positive and negative reviews of surgeons, reinforcing the need for proper pain expectation management. Level of Evidence: Level 4 - retrospective case-control study.
KW - machine learning
KW - online reviews
KW - patient satisfaction
KW - sentiment analysis
UR - http://www.scopus.com/inward/record.url?scp=85149052880&partnerID=8YFLogxK
U2 - 10.1097/BSD.0000000000001372
DO - 10.1097/BSD.0000000000001372
M3 - Article
C2 - 35945670
AN - SCOPUS:85149052880
SN - 2380-0186
VL - 36
SP - E107-E113
JO - Clinical Spine Surgery
JF - Clinical Spine Surgery
IS - 2
ER -