Bangla Wikipedia dataset
Published: 7 December 2019| Version 1 | DOI: 10.17632/3ph3n78fp7.1
Contributors:
Aisha Khatun, Description
A subset of the Bangla Wikipedia text. To create the Wikipedia dataset, we collected the Bangla wiki-dump of 10th June, 2019. The files are then merged and each article is selected as a sample text. All HTML tags were removed and the title of the page was stripped from the beginning of the text. This dataset contains 70377 samples with a total number of words being 18229481. The entire dataset has 1289249 unique words, which is 7% of the total vocabulary.
Files
Institutions
Shahjalal University of Science and Technology
Categories
Natural Language Processing, Bengali Language