Statistical Parsing of Bangla Sentences by CYK Algorithm

Statistical parsing is the task of enabling the parser to find the most probable parse of a sentence according to probabilistic context-free grammar. Crucial use of statistical parser is to solve the disambiguation problem. This paper proposes a statistical parser using probabilistic version of Cocke-Younger-Kasami (CYK) algorithm to parse different kinds of Bangla sentences. For improving parsing efficiency, this model also uses left binarization technique to grammar. Rule probability and word probability is used to generate different probabilities for the same structure of a sentence. Experiment results with different kinds of sentence shows the effectiveness of the propose parser with reasonable accuracy.