Recurrent Neural Network to Deep Learn Conversation in Indonesian

被引:5
|
作者
Chowanda, Andry [1 ]
Chowanda, Alan Darmasaputra [1 ,2 ]
机构
[1] Bina Nusantara Univ, Comp Sci Dept, Sch Comp Sci, Jl KH Syahdan 9, Jakarta 11480, Indonesia
[2] GDP Labs, Jl Aipda KS Tubun 2 C 8, Jakarta 11410, Indonesia
关键词
LTSM; Conversation; Indonesian; Word2Vec; Deep Learning;
D O I
10.1016/j.procs.2017.10.078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural Language Processing (NLP) is still considered a daunting task to solve for us, researcher in this field. Specifically, there is not many research has been done in a local language like Indonesian Language. Nowdays, there are hundreds of systems that require NLP as their main functions. This could be a good opportunity for us to explore this opportunity. This paper contributes models from deep learning training in Indonesian conversation using dual encoder LSTM as well as vector representation models trained with three corpora using Skip-gram method. The results show that the models are able to make a good correlation, synonym from a particular word in the words representation of vector models. In addition, the conversation models resulted in 1.07 of perplexity in the Combined model in the 14000th steps. (c) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:579 / 586
页数:8
相关论文
共 50 条
  • [1] Indonesian Music Genre Classification on Indonesian Regional Songs Using Deep Recurrent Neural Network Method
    Furqon, Muhammad Naufal
    Khadijah, Khadijah
    Suhartono, Suhartono
    Kusumaningrum, Retno
    2019 3RD INTERNATIONAL CONFERENCE ON INFORMATICS AND COMPUTATIONAL SCIENCES (ICICOS 2019), 2019,
  • [2] A deep recurrent neural network approach to learn sequence similarities for user-identification
    Vamosi, Stefan
    Reutterer, Thomas
    Platzer, Michael
    DECISION SUPPORT SYSTEMS, 2022, 155
  • [3] Learning to Learn and Compositionality with Deep Recurrent Neural Networks
    de Freitas, Nando
    KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, : 3 - 3
  • [4] Indonesian speech recognition based on Deep Neural Network
    Yang, Ruolin
    Yang, Jian
    Lu, Yu
    2021 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2021, : 36 - 41
  • [5] Deep Recurrent Neural Network for Seizure Detection
    Vidyaratne, L.
    Glandon, A.
    Alam, M.
    Iftekharuddin, K. M.
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1202 - 1207
  • [6] Hate Speech Identification in Text Written in Indonesian with Recurrent Neural Network
    Sazany, Erryan
    Budi, Indra
    2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS 2019), 2019, : 211 - 216
  • [7] Emotional Conversation Generation Based on a Bayesian Deep Neural Network
    Sun, Xiao
    Li, Jia
    Wei, Xing
    Li, Changliang
    Tao, Jianhua
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2020, 38 (01)
  • [8] Learn a Deep Convolutional Neural Network for Image Smoke Detection
    Liu, Maoshen
    Gu, Ke
    Wu, Li
    Xu, Xin
    Qiao, Junfei
    DIGITAL TV AND MULTIMEDIA COMMUNICATION, 2019, 1009 : 217 - 226
  • [9] What Do Recurrent Neural Network Grammars Learn About Syntax?
    Kuncoro, Adhiguna
    Ballesteros, Miguel
    Kong, Lingpeng
    Dyer, Chris
    Neubig, Graham
    Smith, Noah A.
    15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2017), VOL 1: LONG PAPERS, 2017, : 1249 - 1258
  • [10] DEEP RECURRENT REGULARIZATION NEURAL NETWORK FOR SPEECH RECOGNITION
    Chien, Jen-Tzung
    Lu, Tsai-Wei
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4560 - 4564