TY  - CONF
AU  - Sergi Garcia Bordils
AU  - Dimosthenis Karatzas
AU  - Marçal Rusiñol
A2  - ICDAR
PY  - 2023//
TI  - Accelerating Transformer-Based Scene Text Detection and Recognition via Token Pruning
T2  - LNCS
BT  - 17th International Conference on Document Analysis and Recognition
SP  - 106
EP  - 121
VL  - 14192
KW  - Scene Text Detection
KW  - Scene Text Recognition
KW  - Transformer Acceleration
N2  - Scene text detection and recognition is a crucial task in computer vision with numerous real-world applications. Transformer-based approaches are behind all current state-of-the-art models and have achieved excellent performance. However, the computational requirements of the transformer architecture makes training these methods slow and resource heavy. In this paper, we introduce a new token pruning strategy that significantly decreases training and inference times without sacrificing performance, striking a balance between accuracy and speed. We have applied this pruning technique to our own end-to-end transformer-based scene text understanding architecture. Our method uses a separate detection branch to guide the pruning of uninformative image features, which significantly reduces the number of tokens at the input of the transformer. Experimental results show how our network is able to obtain competitive results on multiple public benchmarks while running at significantly higher speeds.
UR  - https://link.springer.com/chapter/10.1007/978-3-031-41731-3_7
N1  - DAG
ID  - Sergi Garcia Bordils2023
ER  -