Sammy Sidhu, Senior Engineer at DeepScale, presents the "A Shallow Dive into Training Deep Neural Networks" tutorial at the May 2017 Embedded Vision Summit.
In this talk, Sidhu introduces the basics of training deep neural network models for vision tasks. He begins by explaining fundamental training concepts and terms, including loss functions and gradients. He then provides an accessible explanation of how the training process works. Next, he highlights common challenges in training deep neural networks, such as overfitting, and explores proven techniques for addressing these challenges, including regularization and data augmentation. Throughout, he illustrates training techniques and challenges using examples taken from real-world applications.
