Bengali text document categorization based on very deep convolution neural network

Md. Rajib Hossain, Mohammed Moshiul Hoque, Nazmul Siddique, Iqbal H. Sarker

Research output: Contribution to journalArticlepeer-review

35 Citations (Scopus)
191 Downloads (Pure)

Abstract

In recent years, the amount of digital text contents or documents in the Bengali language has increased enormously on online platforms due to the effortless access of the Internet via electronic gadgets. As a result, an enormous amount of unstructured data is created that demands much time and effort to organize, search or manipulate. To manage such a massive number of documents effectively, an intelligent text document classification system is proposed in this paper. Intelligent classification of text document in a resource-constrained language (like Bengali) is challenging due to unavailability of linguistic resources, intelligent NLP tools, and larger text corpora. Moreover, Bengali texts are available in two morphological variants (i.e., Sadhu-bhasha and Cholito-bhasha) making the classification task more complicated. The proposed intelligent text classification model comprises GloVe embedding and Very Deep Convolution Neural Network (VDCNN) classifier. Due to the unavailability of standard corpus, this work develops a large Embedding Corpus (EC) containing 969,000 unlabelled texts and Bengali Text Classification Corpus (BDTC) containing 156,207 labelled documents arranged into 13 categories. Moreover, this work proposes the Embedding Parameters Identification (EPI) Algorithm, which selects the best embedding parameters for low-resource languages (including Bengali). Evaluation of 165 embedding models with intrinsic evaluators (semantic & syntactic similarity measures) shows that the GloVe model is more suitable (regarding Spearman & Pearson correlation) than other embeddings (Word2Vec, FastText, m-BERT) in Bengali text. Experimental results on the test dataset confirm that the proposed GloVe + VDCNN model outperformed (achieving the highest 96.96% accuracy) the other classification models and existing methods to perform the Bengali text classification task.
Original languageEnglish
Article number115394
Pages (from-to)1-23
Number of pages23
JournalExpert Systems with Applications
Volume184
Early online date2 Jul 2021
DOIs
Publication statusPublished (in print/issue) - 1 Dec 2021

Keywords

  • Intelligent systems
  • Natural language processing
  • Low resource language
  • Semantic feature extraction
  • Document categorization
  • Deep convolution network

Fingerprint

Dive into the research topics of 'Bengali text document categorization based on very deep convolution neural network'. Together they form a unique fingerprint.

Cite this