A Comparison of Automated Named Entity Recognition Tools Applied to Clinical Text

Fatemeh Shah-Mohammadi, Joseph Finkelstein

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Significant part of the data in electronic health records (EHR) is in the form of free text containing valuable information about clinical events. This information needs to be extracted in order to enable further analysis and utilization in daily healthcare setting as well as in research. Clinical named entity recognition is an important natural language processing (NLP) task that is critical for extracting important concepts (named entities) from clinical narratives and encoding them. The aim of this paper was comparison of an automatic entity recognition performance of Amazon Comprehend Medical (ACM), Clinical Language Annotation, Modeling and Processing (CLAMP) toolkit and Spark NLP on a standardized validated dataset and its annotated entities. Recall, precision and F1-score were used to evaluate accuracy and performance of the tools. Spark NLP outperformed ACM and CLAMP in terms of average recall, however CLAMP showed better performance in terms of average precision. Depending on the application, CLAMP and Spark NLP can be used in real world applications.

Original languageEnglish
Title of host publicationICIIBMS 2022 - 7th International Conference on Intelligent Informatics and Biomedical Sciences
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages227-231
Number of pages5
ISBN (Electronic)9781665482295
DOIs
StatePublished - 2022
Event7th International Conference on Intelligent Informatics and Biomedical Sciences, ICIIBMS 2022 - Nara, Japan
Duration: 24 Nov 202226 Nov 2022

Publication series

NameICIIBMS 2022 - 7th International Conference on Intelligent Informatics and Biomedical Sciences

Conference

Conference7th International Conference on Intelligent Informatics and Biomedical Sciences, ICIIBMS 2022
Country/TerritoryJapan
CityNara
Period24/11/2226/11/22

Keywords

  • ACM
  • CLAMP
  • NLP
  • Spark NLP
  • entity recognition
  • machine learning

Fingerprint

Dive into the research topics of 'A Comparison of Automated Named Entity Recognition Tools Applied to Clinical Text'. Together they form a unique fingerprint.

Cite this