Modified BERT-based end-to-end Chinese named entity recognition model

Yanchun Tan; Youmin Zhu; Wenqing Shi

doi:10.1117/12.2641066

13 October 2022 Modified BERT-based end-to-end Chinese named entity recognition model

Yanchun Tan, Youmin Zhu, Wenqing Shi

Proceedings Volume 12287, International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022); 1228725 (2022) https://doi.org/10.1117/12.2641066
Event: International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022), 2022, Wuhan, China

Abstract

In this paper, we present an end-to-end model based on modified Bidirectional Encoder Representations from Transformers (BERT) for Chinese named entity recognition (NER) in natural language processing. The model is composed of the SpanBERT layer and the Conditional Random Field (CRF) layer. By using combination, the model can express the input characters in the better form of "word embeddings", eliminating the steps of feature engineering or data processing in conventional approaches, and can be widely applied to the task of Chinese NER. Our experiments demonstrate that the SpanBERT-CRF model can effectively utilize the contextual data features and give more accurate recognition results. On our data set, the SpanBERT-CRF model had excellent performance with a recognition accuracy of 91.33%, outperforming the benchmark NER model BiLSTM-CRF (Bidirectional Long Short Term Memory, Conditional Random Field) and BERT-CRF model in performance and F1 score.

Citation Download Citation

Yanchun Tan, Youmin Zhu, and Wenqing Shi "Modified BERT-based end-to-end Chinese named entity recognition model", Proc. SPIE 12287, International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022), 1228725 (13 October 2022); https://doi.org/10.1117/12.2641066

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available