%0 Conference Proceedings
%T A Few Shot Multi-representation Approach for N-Gram Spotting in Historical Manuscripts
%A Giuseppe De Gregorio
%A Sanket Biswas
%A Mohamed Ali Souibgui
%A Asma Bensalah
%A Josep Llados
%A Alicia Fornes
%A Angelo Marcelli
%B Frontiers in Handwriting Recognition. International Conference on Frontiers in Handwriting Recognition (ICFHR2022)
%D 2022
%V 13639
%F Giuseppe De Gregorio2022
%O DAG; 600.121; 600.162; 602.230; 600.140
%O exported from refbase (http://refbase.cvc.uab.es/show.php?record=3733), last updated on Tue, 25 Apr 2023 16:07:26 +0200
%X Despite recent advances in automatic text recognition, the performance remains moderate when it comes to historical manuscripts. This is mainly because of the scarcity of available labelled data to train the data-hungry Handwritten Text Recognition (HTR) models. The Keyword Spotting System (KWS) provides a valid alternative to HTR due to the reduction in error rate, but it is usually limited to a closed reference vocabulary. In this paper, we propose a few-shot learning paradigm for spotting sequences of a few characters (N-gram) that requires a small amount of labelled training data. We exhibit that recognition of important n-grams could reduce the system’s dependency on vocabulary. In this case, an out-of-vocabulary (OOV) word in an input handwritten line image could be a sequence of n-grams that belong to the lexicon. An extensive experimental evaluation of our proposed multi-representation approach was carried out on a subset of Bentham’s historical manuscript collections to obtain some really promising results in this direction.
%K N-gram spotting
%K Few-shot learning
%K Multimodal understanding
%K Historical handwritten collections
%U http://refbase.cvc.uab.es/files/GBS2022.pdf
%U http://dx.doi.org/10.1007/978-3-031-21648-0_1
%P 3-12