Deep Learning in Driverless Cars

Introduction
Driverless cars are going viral in this technological era and posing great challenges in its
implementation. The technology giants are investing a huge amount of money to surpass others
in this field. Major competitors in this field are Waymo (Google), Uber, Tesla, and others. Still,
a huge technological advancement is needed to fully commercialize these cars and make them
available for public use [1,2]. The major advancement required in these cars is learning and
evolution. Deep Learning can be used to produce a command for performing the following
operations of driverless cars:
This operation directs the car to follow the right path and take a turn along the path curve [3].
The car must be capable to detect humans to avoid its hitting, so the drive could be safe and
hazard free. The driverless car must be able to follow the road signs and drive accordingly [4].
The traffic light detection must be able to react to the traffic signals as like a human being. The
face detection and recognition of the human beings is a must feature in the driverless car [5].
The car will be able to recognize the people inside it as well as outside. This feature has the
advantage that car will know its owner and couldn’t be used by the unauthorized person. Other
vehicles must be detected by the driverless car in its vicinity [6]. Different obstacles in the path
must be detected by the driverless car. This operation can be performed by analyzing data
received from sensors fitted in the car.

Deep Learning
Different computation models which are composed of numerous layers for processing to
manipulate data for presentation in a specified way at abstraction level are called deep learning.
Speech recognition, object detection and recognition, genomics and other fields like minerals
exploration are considerably improved using these models [7]. Deep learning is used to find
complexity in the structure of a large dataset by the algorithm of backpropagation for enabling
a machine to update its internal weighted parameter, used for the computation of the data
representation in next layer from the values in the previous [8]. Convolutional network in the
deep learning has brought cutting-edge techniques in audio, video and image processing. These
properties of Deep Learning are vastly used in today’s advanced technologies using large
images as input for decision making [9]. Most of the Machine Learning algorithms have the
performance peak while Deep Learning scales itself up to handle big data [10]. In case of
driverless cars, Deep Learning is the only algorithm that copes with a large amount of data
received from different sensors of driverless cars and train itself.

Objective and Operation

The main objective of my PhD studies is to introduce evolvable algorithm in deep learning.
The current algorithm used is convolution neural network where the weight of each neuron is
updated on the phenomena of backpropagation and it has the biggest issue that this algorithm
stuck in the local minima. So, by introducing the Evolutionary Convolution Neural Network
this problem can be diminished.
To operate a driverless car, commands should be produced as per the surrounding environment
keeping in view the perspective of a human driver. For this purpose, a huge amount of data is
required to be processed in Realtime which is obtained by different sensors of the car. Data
will be collected in diverse environmental conditions during day and night times. Different
roads will be used having lane marking and unmarked both will be used.
The network will be trained to reduce the mean square error between the steering operation
performed by the network and a driver.

Output
Input Convolution + ReLU Pooling EANN

Figure 1: Basic Block Diagram

References
1. Lipson, H., & Kurman, M. (2016). Driverless: intelligent cars and the road ahead. MIT
Press.
2. Merat, N., & Lee, J. D. (2012). Preface to the special section on human factors and
automation in vehicles: Designing highly automated vehicles with the driver in mind.
Human factors, 54(5), 681-686.
3. Gupta, A., & Merchant, P. S. (2016). Automated lane detection by k-means clustering:
a machine learning approach. Electronic Imaging, 2016(14), 1-6.
4. Luettel, T., Himmelsbach, M., & Wuensche, H. J. (2012). Autonomous ground
vehicles—Concepts and a path to the future. Proceedings of the IEEE, 100(Special
Centennial Issue), 1831-1839.
5. Ranjan, R., Patel, V. M., & Chellappa, R. (2017). Hyperface: A deep multi-task learning
framework for face detection, landmark localization, pose estimation, and gender
recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence.
6. Tang, Y., Zhang, C., Gu, R., Li, P., & Yang, B. (2017). Vehicle detection and
recognition for intelligent traffic surveillance system. Multimedia tools and
applications, 76(4), 5817-5832.
7. LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436.
8. Goodfellow, I., Bengio, Y., Courville, A., & Bengio, Y. (2016). Deep learning (Vol. 1).
Cambridge: MIT press.
9. Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural
networks, 61, 85-117.
10. Deng, L., & Yu, D. (2014). Deep learning: methods and applications. Foundations and
Trends® in Signal Processing, 7(3–4), 197-387.