%0 Conference Proceedings %T A framework for the assessment of text extraction algorithms on complex colour images %A Antonio Clavelli %A Dimosthenis Karatzas %A Josep Llados %B 9th IAPR International Workshop on Document Analysis Systems %D 2010 %@ 978-1-60558-773-8 %F Antonio Clavelli2010 %O DAG %O exported from refbase (http://refbase.cvc.uab.es/show.php?record=1432), last updated on Mon, 15 May 2017 10:20:11 +0200 %X The availability of open, ground-truthed datasets and clear performance metrics is a crucial factor in the development of an application domain. The domain of colour text image analysis (real scenes, Web and spam images, scanned colour documents) has traditionally suffered from a lack of a comprehensive performance evaluation framework. Such a framework is extremely difficult to specify, and corresponding pixel-level accurate information tedious to define. In this paper we discuss the challenges and technical issues associated with developing such a framework. Then, we describe a complete framework for the evaluation of text extraction methods at multiple levels, provide a detailed ground-truth specification and present a case study on how this framework can be used in a real-life situation. %U http://dx.doi.org/10.1145/1815330.1815333 %P 19–26