A Sentence Summarizer using Recurrent Neural Network and Attention-Based Encoder

For automatically summarizing sentences of nature languages, some cutting-age methods have been proposed since a decade ago. In this paper, an advanced model of abstractive sentence summarization is proposed by composing a recurrent neural network (RNN) and an attention-based encoder. The proposed model is an improvement version of Rush-Chopra-Weston's neural attention model, and main differences between the proposed model and the conventional one is that: 1) the novel model utilizes two RNNs instead of the feed-forward neural networks; 2) the length of summarized sentence (the output of these models) is variable (which is fixed in the conventional case). Experiments showed the effectiveness of the proposed sentence summarizer and these results suggest that it is possible to abstract long articles into shorten words.