Research on the Evolution of Journal Topic Mining Based on the BERT-LDA Model

¹ College of Computer and Information Engineering, Xiamen University of Technology, Xiamen, 361024, China
² Fujian Key Laboratory of Internet of things application technology, Xiamen City University, Xiamen, 361008, China
³ Editorial Department, Xiamen University of Technology, Xiamen, 361024, China
⁴ College of Software Engineering, Xiamen University of Technology, Xiamen, 361024, China

^* Corresponding author email: xhchen@xmut.edu.cn

Abstract

Scientific papers are an important form for researchers to summarize and display their research results. Information mining and analysis of scientific papers can help to form a comprehensive understanding of the subject. Aiming at the ignorance of contextual semantic information in current topic mining and the uncertainty of screening rules in association evolution research, this paper proposes a topic mining evolution model based on the BERT-LDA model. First, the model combines the contextual semantic information learned by the BERT model with the word vectors of the LDA model to mine deep semantic topics. Then construct topic filtering rules to eliminate invalid associations between topics. Finally, the relationship between themes is analyzed through the theme evolution, and the complex relationship between the themes such as fusion, diffusion, emergence, and disappearance is displayed. The experimental results show that, compared with the traditional LDA model, the topic mining evolution model based on BERTLDA can accurately mine topics with deep semantics and effectively analyze the development trend of scientific and technological paper topics.