Recurrent Neural Network to Deep Learn Conversation in Indonesian

被引:5
|
作者
Chowanda, Andry [1 ]
Chowanda, Alan Darmasaputra [1 ,2 ]
机构
[1] Bina Nusantara Univ, Comp Sci Dept, Sch Comp Sci, Jl KH Syahdan 9, Jakarta 11480, Indonesia
[2] GDP Labs, Jl Aipda KS Tubun 2 C 8, Jakarta 11410, Indonesia
关键词
LTSM; Conversation; Indonesian; Word2Vec; Deep Learning;
D O I
10.1016/j.procs.2017.10.078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural Language Processing (NLP) is still considered a daunting task to solve for us, researcher in this field. Specifically, there is not many research has been done in a local language like Indonesian Language. Nowdays, there are hundreds of systems that require NLP as their main functions. This could be a good opportunity for us to explore this opportunity. This paper contributes models from deep learning training in Indonesian conversation using dual encoder LSTM as well as vector representation models trained with three corpora using Skip-gram method. The results show that the models are able to make a good correlation, synonym from a particular word in the words representation of vector models. In addition, the conversation models resulted in 1.07 of perplexity in the Combined model in the 14000th steps. (c) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:579 / 586
页数:8
相关论文
共 50 条
  • [31] Haze Prediction Model Using Deep Recurrent Neural Network
    Shang, Kailin
    Chen, Ziyi
    Liu, Zhixin
    Song, Lihong
    Zheng, Wenfeng
    Yang, Bo
    Liu, Shan
    Yin, Lirong
    ATMOSPHERE, 2021, 12 (12)
  • [32] ChronoNet: A Deep Recurrent Neural Network for Abnormal EEG Identification
    Roy, Subhrajit
    Kiral-Kornek, Isabell
    Harrer, Stefan
    ARTIFICIAL INTELLIGENCE IN MEDICINE, AIME 2019, 2019, 11526 : 47 - 56
  • [33] Deep evidential learning in diffusion convolutional recurrent neural network
    Feng, Zhiyuan
    Qi, Kai
    Shi, Bin
    Mei, Hao
    Zheng, Qinghua
    Wei, Hua
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (04): : 2252 - 2264
  • [34] Adaptive modulation and coding using deep recurrent neural network
    Sadegh Mohammadvaliei
    Mohammadali Sebghati
    Hassan Zareian
    Telecommunication Systems, 2022, 81 : 615 - 623
  • [35] Very Deep Recurrent Convolutional Neural Network for Object Recognition
    Brahimi, Sourour
    Ben Aoun, Najib
    Ben Amar, Chokri
    NINTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2016), 2017, 10341
  • [36] DnRCNN: Deep Recurrent Convolutional Neural Network for HSI Destriping
    Guan, Juntao
    Lai, Rui
    Li, Huanan
    Yang, Yintang
    Gu, Lin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3255 - 3268
  • [37] Deep recurrent neural network for IoT intrusion detection system
    Almiani, Muder
    AbuGhazleh, Alia
    Al-Rahayfeh, Amer
    Atiewi, Saleh
    Razaque, Abdul
    SIMULATION MODELLING PRACTICE AND THEORY, 2020, 101
  • [38] Applying Deep Recurrent Neural Network to Predict Vehicle Mobility
    Liu, Wei
    Shoji, Yozo
    2018 IEEE VEHICULAR NETWORKING CONFERENCE (VNC), 2018,
  • [39] Brief Announcement: Gradual Learning of Deep Recurrent Neural Network
    Aharoni, Ziv
    Rattner, Gal
    Permuter, Haim
    CYBER SECURITY CRYPTOGRAPHY AND MACHINE LEARNING, CSCML 2018, 2018, 10879 : 274 - 277
  • [40] Adaptive modulation and coding using deep recurrent neural network
    Mohammadvaliei, Sadegh
    Sebghati, Mohammadali
    Zareian, Hassan
    TELECOMMUNICATION SYSTEMS, 2022, 81 (04) : 615 - 623