Creation of Necessary Technical and Expert-Analytical Conditions for Development of the Information System of Evaluating Open Text Information Sources' Influence on Society

被引：0

作者：

Mussabayev, Rustam ^{[1
]}

Kassymzhanov, Bek ^{[1
]}

Mukashev, Aidos ^{[1
]}

Ibrayeva, Viktoriya ^{[1
]}

Merkebayev, Azat ^{[1
]}

机构：

[1] MES RK IIVT, Lab Anal & Modeling Informat Proc, Inst Informat & Comp Technol Comm Sci, Alma Ata, Kazakhstan

来源：

2019 15TH INTERNATIONAL ASIAN SCHOOL-SEMINAR OPTIMIZATION PROBLEMS OF COMPLEX SYSTEMS (OPCS 2019) | 2019年

关键词：

distributional models; text preprocessing; artificial intelligence; machine learning; WORD2VEC and GLOVE;

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

In this paper, we trained distributional models (patterns) for text preprocessing in Word2vec and Glove. Three variants of text preprocessing were used to train distributional patterns. Based on the implemented distribution model Word2Vec, a vector representation was obtained for a cluster-separated test sample of 30 news items. All variants of the weighted average calculation of the vector representation of texts were considered. Two-stage clustering was carried out. After training the Doc2Vec model on normalized documents, a vector representation was obtained for each document. The following news about the same event was selected for the test, but from different sources. A 2-dimensional "factual cube" was analyzed.

引用

页码：104 / 109

页数：6

共 5 条

[1] THE DEVELOPMENT OF AN INFORMATION SPACE INDUSTRY WITH THE AIM OF THE EXPERT-ANALYTICAL SUPPORT OF DEVELOPMENT OF NORMATIVE-METHODICAL DOCUMENTATION
Abramov, Alexey, V
Firsova, Anna, V
Khmara, Dmitriy S.
[J]. MARINE INTELLECTUAL TECHNOLOGIES, 2019, 1 (01): : 78 - 82
[2] TECHNICAL AND ORGANIZATIONAL PREREQUISTE CONDITIONS TO THE DEVELOPMENT OF PRODUCTION INFORMATION-SYSTEM
KARABAIC, I
[J]. STROJARSTVO, 1986, 28 (06): : 411 - 414
[3] DEVELOPMENT AND IMPLEMENTATION OF AN EXPERT INFORMATION-SYSTEM (BRITE) USED IN TECHNICAL-SUPPORT OF MEDICAL DIAGNOSTICS CUSTOMERS
HOPKINS, T
ADVANI, R
GUDMUNSON, G
[J]. CLINICAL CHEMISTRY, 1995, 41 (09) : 1333 - 1337
[4] Development and implementation of an expert information system (BRITE) used in technical support of medical diagnostics customers (vol 41, pg 1333, 1995)
Hopkins, T
Advani, R
Gudmunson, C
[J]. CLINICAL CHEMISTRY, 1996, 42 (03) : 488 - 488
[5] Open source software for disaster management - Evaluating how the Sahana disaster information system coordinates disparate institutional and technical resources in the wake of the Indian Ocean tsunami.
Currion, Paul
De Silva, Chamindra
Van de Walle, Bartel
[J]. COMMUNICATIONS OF THE ACM, 2007, 50 (03) : 61 - 65

← 1 →