In this work we investigate the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting.