A study of BERT-based bi-directional Tibetan-Chinese neural machine translation

Yidong Sun; Dan Yang; Tao Yu; Andi Dong; Cuo Yong

doi:10.1117/12.2641020

2 December 2022 A study of BERT-based bi-directional Tibetan-Chinese neural machine translation

Yidong Sun, Dan Yang, Tao Yu, Andi Dong, Cuo Yong

Proceedings Volume 12288, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2022); 122880X (2022) https://doi.org/10.1117/12.2641020
Event: International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2022), 2022, Zhuhai, China

Abstract

Tibetan-Chinese bidirectional translation can promote the development of Tibetan-Chinese scientific and cultural exchanges as well as educational and cultural undertakings, but it has been facing the dilemma of low resource language parallel corpus scarcity. In this paper, we hope to provide a research idea for Tibetan-Chinese machine translation under low-resource conditions through the study of pre-trained language models, and to alleviate the problems existing in Tibetan-Chinese machine translation such as scarce corpus and unsatisfactory translation performance, so as to promote the development of Tibetan society. In this paper, by introducing pre-trained language models BERT and ALBERT into Tibetan-Chinese bidirectional translation, the translation effect is greatly improved by using large-scale monolingual data. The translations before and after use are also analyzed. Through the tests, the average improvement of the Chinese-Tibetan translation is 2.13 BLEU values, and the average improvement of the Tibetan-Chinese translation is 2.68 BLEU values.

Citation Download Citation

Yidong Sun, Dan Yang, Tao Yu, Andi Dong, and Cuo Yong "A study of BERT-based bi-directional Tibetan-Chinese neural machine translation", Proc. SPIE 12288, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2022), 122880X (2 December 2022); https://doi.org/10.1117/12.2641020

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Transformers

Performance modeling

Computer programming

Data conversion

Information technology

Systems modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years