[1]安俊秀,蒋思畅.面向自然语言处理的词向量模型研究综述[J].计算机技术与发展,2023,33(12):17-22.[doi:10. 3969 / j. issn. 1673-629X. 2023. 12. 003]
　AN Jun-xiu,JIANG Si-chang.Survey of Word Vector Model for Natural Language Processing[J].,2023,33(12):17-22.[doi:10. 3969 / j. issn. 1673-629X. 2023. 12. 003]

点击复制

面向自然语言处理的词向量模型研究综述()

分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:

33

期数:

2023年12期

页码:

17-22

栏目:

综述

出版日期:

2023-12-10

文章信息/Info

Title:

Survey of Word Vector Model for Natural Language Processing

文章编号:

1673-629X(2023)12-0017-06

作者:

安俊秀; 蒋思畅

成都信息工程大学 软件工程学院,四川 成都 610225

Author(s):

AN Jun-xiu; JIANG Si-chang

School of Software Engineering,Chengdu University of Information Technology,Chengdu 610225,China

关键词:

自然语言处理; 词向量; 深度学习; 预训练技术; 静态模型; 动态模型

Keywords:

natural language processing; word vector; deep learning; pre-training technique; static model; dynamic model

分类号:

TP391. 1

DOI:

10. 3969 / j. issn. 1673-629X. 2023. 12. 003

摘要:

从 20 世纪 50 年代至今,自然语言处理( Natural Language Processing,NLP) 取得了长足的发展。 早期的词向量模型证明了对该领域的研究需要使用数学方法,而不是人类的语言规则。?

进入 21 世纪后,静态模型以深度学习技术为基础,在很多任务中取得了不错的表现;动态模型再将预训练技术融入进来,实现了根据语境对词向量进行调整的功能,为 NLP 领域带来了里程碑

式的突破,后续研究在此基础上向各领域延伸扩展,并且在现实生活中得到了大规模的应用。文章首先对词向量模型及其发展历史做了介绍,然后分析了现代的词向量模型( NNLM,Word2Vec,　FastText,Glove,ELMo,GPT,BERT) ,其次说明了多种基于预训练技术的扩展模型和当前自然语言处理技术的应用现状,最后总结了目前存在的主要问题,并提出对未来研究的展望。

Abstract:

Since the 1950s,Natural Language Processing ( NLP) has made great progress. The early word vector model demonstrates thatthe study of NLP requires mathematical methods?

rather than human language rules. After entering the 21st century,the static model whichbased on deep learning techniques achieves good performance in many tasks. The dynamic model makes use of pre-training techniquesand realizes the function of adjusting word vectors according to the context,which brings a milestone breakthrough in the field of NLP.On?

this basis,the follow-up research extends to various fields,and has been applied on a large scale in real life. We firstly introduce theword vector model and its development history,then analyze the modern models based on deep learning ( NNLM,Word2Vec,FastText,Glove,ELMo,GPT,BERT) . Secondly,we explain a variety of extended models based on pre - training technology, and describe thecurrent application status of natural language processing technology. Finally,we summarize the main problems at present,and put forwardthe prospect of future research.

常用功能