Pre-training DataMultimodal

Licensed Pashto Print Corpus

Type
Text-in-ImageDocument Dataset
Domain
Humanities and Social
Language
Pashto

Overview

This dataset consists of digitized Pashto printed books licensed by publishers and authors, including rare lithographed editions. It provides original page scans, OCR-generated text, and transcriptions cross-verified by native speakers.

Potential Use Cases

  • Pashto Language Model Pre-training: Extracted and verified Pashto text can be used as pre-training data for Pashto language models.
  • Pashto Text Corpus Development: OCR-generated text and native-verified transcriptions can be used to organize printed Pashto documents into a digital text corpus for linguistic analysis and natural language processing tasks.
Flitto Curation Data Flitto Curation Data