TY - CONF AU - Felipe Codevilla AU - Eder Santana AU - Antonio Lopez AU - Adrien Gaidon A2 - ICCV PY - 2019// TI - Exploring the Limitations of Behavior Cloning for Autonomous Driving BT - 18th IEEE International Conference on Computer Vision SP - 9328 EP - 9337 N2 - Driving requires reacting to a wide variety of complex environment conditions and agent behaviors. Explicitly modeling each possible scenario is unrealistic. In contrast, imitation learning can, in theory, leverage data from large fleets of human-driven cars. Behavior cloning in particular has been successfully used to learn simple visuomotor policies end-to-end, but scaling to the full spectrum of driving behaviors remains an unsolved problem. In this paper, we propose a new benchmark to experimentally investigate the scalability and limitations of behavior cloning. We show that behavior cloning leads to state-of-the-art results, executing complex lateral and longitudinal maneuvers, even in unseen environments, without being explicitly programmed to do so. However, we confirm some limitations of the behavior cloning approach: some well-known limitations (eg, dataset bias and overfitting), new generalization issues (eg, dynamic objects and the lack of a causal modeling), and training instabilities, all requiring further research before behavior cloning can graduate to real-world driving. The code, dataset, benchmark, and agent studied in this paper can be found at github. UR - https://ieeexplore.ieee.org/document/9009463 L1 - http://refbase.cvc.uab.es/files/CSL2019.pdf UR - http://dx.doi.org/10.1109/ICCV.2019.00942 N1 - ADAS; 600.124; 600.118 ID - Felipe Codevilla2019 ER -