Recurrent Neural Network to Deep Learn Conversation in Indonesian

被引:5
|
作者
Chowanda, Andry [1 ]
Chowanda, Alan Darmasaputra [1 ,2 ]
机构
[1] Bina Nusantara Univ, Comp Sci Dept, Sch Comp Sci, Jl KH Syahdan 9, Jakarta 11480, Indonesia
[2] GDP Labs, Jl Aipda KS Tubun 2 C 8, Jakarta 11410, Indonesia
关键词
LTSM; Conversation; Indonesian; Word2Vec; Deep Learning;
D O I
10.1016/j.procs.2017.10.078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural Language Processing (NLP) is still considered a daunting task to solve for us, researcher in this field. Specifically, there is not many research has been done in a local language like Indonesian Language. Nowdays, there are hundreds of systems that require NLP as their main functions. This could be a good opportunity for us to explore this opportunity. This paper contributes models from deep learning training in Indonesian conversation using dual encoder LSTM as well as vector representation models trained with three corpora using Skip-gram method. The results show that the models are able to make a good correlation, synonym from a particular word in the words representation of vector models. In addition, the conversation models resulted in 1.07 of perplexity in the Combined model in the 14000th steps. (c) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:579 / 586
页数:8
相关论文
共 50 条
  • [41] Deep Convolutional Recurrent Neural Network For Fiber Nonlinearity Compensation
    Jain, Prasham
    Lampek, Lutz
    Mitra, Jeebak
    2022 EUROPEAN CONFERENCE ON OPTICAL COMMUNICATION (ECOC), 2022,
  • [42] Sentence Level Indonesian Sign Language Recognition Using 3D Convolutional Neural Network and Bidirectional Recurrent Neural Network
    Ariesta, Meita Chandra
    Wiryana, Fanny
    Suharjito
    Zahra, Amalia
    2018 INDONESIAN ASSOCIATION FOR PATTERN RECOGNITION INTERNATIONAL CONFERENCE (INAPR), 2018, : 16 - 22
  • [43] Enhanced Indonesian Ethnic Speaker Recognition using Data Augmentation Deep Neural Network
    Nugroho, Kristiawan
    Noersasongko, Edi
    Purwanto
    Muljono
    Setiadi, De Rosal Ignatius Moses
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (07) : 4375 - 4384
  • [44] Generating Image Description on Indonesian Language using Convolutional Neural Network and Gated Recurrent Unit
    Nugraha, Aditya Alif
    Arifianto, Anditya
    Suyanto
    2019 7TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (ICOICT), 2019, : 98 - 103
  • [45] Indonesian Vehicle License Plate Number Detection using Deep Convolutional Neural Network
    Imaduddin, Hasan
    Anwar, Muhamad Khoirul
    Perdana, Muhammad Ilham
    Sulistijono, Indra Adji
    Risnumawan, Anhar
    2018 INTERNATIONAL ELECTRONICS SYMPOSIUM ON KNOWLEDGE CREATION AND INTELLIGENT COMPUTING (IES-KCIC), 2018, : 158 - 163
  • [46] Relation Detection for Indonesian Language using Deep Neural Network - Support Vector Machine
    Hasudungan, Ramos Janoah
    Purwarianti, Ayu
    2018 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2018, : 290 - 296
  • [47] Recurrent Neural Network Language Model for English-Indonesian Machine Translation: Experimental Study
    Hermanto, Andi
    Adji, Teguh Bharata
    Setiawan, Noor Akhmad
    2015 INTERNATIONAL CONFERENCE ON SCIENCE IN INFORMATION TECHNOLOGY (ICSITECH), 2015, : 132 - 136
  • [48] Discovery of novel chemical reactions by deep generative recurrent neural network
    William Bort
    Igor I. Baskin
    Timur Gimadiev
    Artem Mukanov
    Ramil Nugmanov
    Pavel Sidorov
    Gilles Marcou
    Dragos Horvath
    Olga Klimchuk
    Timur Madzhidov
    Alexandre Varnek
    Scientific Reports, 11
  • [49] Modelling a Quadrotor Vehicle Using a Modular Deep Recurrent Neural Network
    Mohajerin, Nima
    Waslander, Steven L.
    2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 376 - 381
  • [50] Deep Recurrent Neural Network-Based Identification of Precursor microRNAs
    Park, Seunghyun
    Min, Seonwoo
    Choi, Hyun-Soo
    Yoon, Sungroh
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30