arrow
Return

Multilingual OCR for cursive scripts using Swin Transformers

delete2026-04-24
delete0
PRE
AI
A
Aejaz Farooq Ganai *
N
Nasir N. Hurrah
DOI:10.1007/s00521-026-12102-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Optical Character Recognition (OCR) has progressed widely for Indian scripts such as Bengali, Devanagari, and Urdu, but Kashmiri script remains underexplored. Handwritten cursive recognition in scripts like Nastaliq, used in Urdu and Kashmiri, is particularly challenging due to cursive connections, context-dependent character shapes, and handwriting variability. Existing methods often fail to capture crucial features like loops, dots (nuqta), and stroke details that distinguish visually similar characters. This study proposes a deep learning approach based on the Swin Transformer architecture, which employs windowed attention mechanisms and multi-scale processing to retain both fine details and holistic structures. The model addresses difficulties such as overlapping characters and diverse handwriting styles, adapting well to the intricacies of handwritten Urdu and Kashmiri text. A multi-scale windowing technique ensures that both fine details and larger character structures are captured, enabling the model to handle overlapping characters and varying handwriting styles. Experimental evaluation on four benchmark datasets (UNHD, NUST-UHWR, UHLD, and the newly introduced HKTD for Kashmiri) demonstrates that the proposed Swin Transformer approach achieves an overall recognition accuracy of 95.4% with a ligature error rate as low as 1.5–2.9% for Urdu datasets and 5.6% for Kashmiri text. The model requires less than 3 GB GPU memory and completes training in under 3 hours, significantly outperforming existing CNN and hybrid Transformer-based baselines in both accuracy and computational efficiency.
Keywords:
Optical Character Recognition (OCR)
Cursive text
Handwritten Urdu
Handwritten Kashmiri text
Swin transformers
Multi-head attention
Shifted window
Multilayer perceptron

Journal

Neural Computing and Applications cover
Neural Computing and Applications
IF:
4.5
Papers:
928
Citations:
3.2W

Organization

C
computer engineering
Scholars:
318
Papers: 195
Citations: 0
E
electronics
Scholars:
50
Papers: 28
Citations: 0
Cited Papers

Cited Papers

Recognition of Urdu Handwritten Characters Using Convolutional Neural Network
err2019-07-08
err0
errOAAI
errMujtaba Husnain; Malik Muhammad Saad Missen; Shahzad Mumtaz; Muhammad Zeeshan Jhanidr; Mickaël Coustaty; Muhammad Muzzamil Luqman; Jean-Marc Ogier; Gyu Sang Choi
errShare
errSave
Challenges in OCR of Devanagari documents
err2005-01-01
err0
PREAI
errSuryaprakash Kompalli; Sankalp Nayak; Srirangaraj Setlur; Venu Govindaraju
errShare
errSave
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
err2021-06-01
err0
errOAAI
errSixiao Zheng; Jiachen Lu; Hengshuang Zhao; Xiatian Zhu; Zekun Luo; Yabiao Wang; Yanwei Fu; Jianfeng Feng; Tao Xiang; Philip H.S. Torr; Li Zhang
errShare
errSave
A convolutional recursive deep architecture for unconstrained Urdu handwriting recognition
err2021-09-14
err0
PREAI
errNoor ul Sehr Zia; Muhammad Ferjad Naeem; Syed Muhammad Kumail Raza; Muhammad Mubasher Khan; Adnan Ul-Hasan; Faisal Shafait
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
ImageNet Classification with Deep Convolutional Neural Networks
err2017-05-24
err8.3W
errOAAI
errKrizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E.
errShare
errSave
Evaluation of Handwritten Urdu Text by Integration of MNIST Dataset Learning Experience
err2019-01-01
err9
errOAAI
errBin Ahmed, Saad; Hameed, Ibrahim A.; Naz, Saeeda; Razzak, Muhammad Imran; Yusof, Rubiyah
errShare
errSave
researcher View more