Video text recognition using sequential Monte Carlo and error voting methods

Datong Chen

doi:10.1016/j.patrec.2004.11.019

Return

Video text recognition using sequential Monte Carlo and error voting methods

2005-07-01

Datong Chen

Jean‐Marc Odobez

DOI：10.1016/j.patrec.2004.11.019

Original

Save

View PDF

Abstract

En 中文

This paper addresses the issue of segmentation and recognition of text embedded in video sequences from their associated text image sequence extracted by a text detection module. To this end, we propose a probabilistic algorithm based on Bayesian adaptive thresholding and Monte-Carlo sampling. The algorithm approximates the posterior distribution of segmentation thresholds of text pixels in an image by a set of weighted samples. The set of samples is initialized by applying a classical segmentation algorithm on the first video frame and further refined by random sampling under a temporal Bayesian framework. One important contribution of the paper is to show that, thanks to the proposed methodology, the likelihood of a segmentation parameter sample can be estimated not using a classification criterion or a visual quality criterion based on the produced segmentation map, but directly from the induced text recognition result, which is directly relevant to our task. Furthermore, as a second contribution of the paper, we propose to align text recognition results from high confidence samples gathered over time, to composite a final result using error voting technique (ROVER) at the character level. Experiments are conducted on a two hour video database. Character recognition rates higher than 93%, and word error rates higher than 90% are achieved, which are 4% and 3% more than state-of-the-art methods applied to the same database. (c) 2004 Elsevier B.V. All rights reserved.

Keywords:

video text recognition

text segmentation

sequential Monte-Carlo filter

language model

recognition output voting error reduction

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.