返回
HierCode: A lightweight hierarchical codebook for zero-shot Chinese text recognition
DOI:10.1016/j.patcog.2024.110963.png)
摘要
En 中文
Text recognition, especially for complex scripts like Chinese, faces unique challenges due to its intricate character structures and vast vocabulary. Traditional one-hot encoding methods struggle with the representation of hierarchical radicals, recognition of Out-Of-Vocabulary (OOV) characters, and on-device deployment due to their computational intensity. To address these challenges, we propose HierCode, a novel and lightweight codebook that exploits the innate hierarchical nature of Chinese characters. HierCode employs a multi-hot encoding strategy, leveraging hierarchical binary tree encoding and prototype learning to create distinctive, informative representations for each character. This approach not only facilitates zero-shot recognition of OOV characters by utilizing shared radicals and structures but also excels in line-level recognition tasks by computing similarity with visual features, a notable advantage over existing methods. Extensive experiments across diverse benchmarks, including handwritten, scene, document, web, and ancient text, have showcased HierCode's superiority for both conventional and zero-shot Chinese character or text recognition, exhibiting state-of-the-art performance with significantly fewer parameters and lower floating-point operations (FLOPs).
Keyword:
Chinese text recognition
Zero-shot learning
Hierarchical information embedding
Optical character recognition
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Self-information of radicals: A new clue for zero-shot Chinese character recognition部首的自信息: 零镜头汉字识别的新线索
PATTERN RECOGNITION
IF7.6
MORAN: A Multi-Object Rectified Attention Network for scene text recognitionMORAN: 用于场景文本识别的多目标校正注意力网络
PATTERN RECOGNITION
IF7.6
Radical aggregation network for few-shot offline handwritten Chinese character recognition用于少镜头离线手写汉字识别的自由基聚合网络

