arrow
Return

A Finger-Worn Device for Exploring Chinese Printed Text With Using CNN Algorithm on a Micro IoT Processor

delete2019-01-01
delete28
delete
OA
AI
Y
Yu-Sheng Su
C
Chien-Hsing Chou *
Y
Yung-Long Chu
Z
Zhao-Yu Yang
DOI:10.1109/ACCESS.2019.2936143delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This study designed a finger-worn device-named the Chinese FingerReader-that can be practically applied by visually impaired users for recognizing traditional Chinese characters on the micro internet of things (IoT) processor. The device is portable, easy to operate, and designed to be worn on the index finger. The Chinese FingerReader on the index finger contains a small camera and buttons. The small camera captures images by identifying the relative position of the index finger to the printed text, and the buttons are applied to capture an image by visually impaired users and provide the audio output of the corresponding Chinese character by a voice prompt. To recognize Chinese characters, English letters, and numbers, a robust Chinese optical character recognition (OCR) system was developed according to the training strategy of an augmented convolution neural network algorithm. The proposed Chinese OCR system can segment a single character from the captured image, and the system can accurately recognize rotated Chinese characters. The experimental results revealed that compared with the OCR application programming interfaces of Google and Microsoft, the proposed OCR system obtains 95% accuracy rate in dealing with rotated character images where the Google and Microsoft OCR APIs only obtain 65% and 34% accuracy rates. These results illustrate that the proposed OCR system was more suitable for the needs of visually impaired people in actual use. Finally, three usage scenarios were simulated, and the accuracy and operational performance of the system were tested. Field tests of this system were conducted for visually impaired users to verify its feasibility.
Keywords:
Assistive technology
Chinese OCR
IoT processor
convolution neural networks
wearable interface
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

National Taiwan Ocean University cover
National Taiwan Ocean University
Scholars:
3.9K
Papers: 3.6K
Citations: 3.0K
T
tamkang university
Scholars:
2.6K
Papers: 3.1K
Citations: 48