Scene understanding in deep learning-based end-to-end controllers for autonomous vehicles