Abstract: A novel deep architecture Thresholding Convolution Neural Network (ThCNN) progresses in this paper; Which is a simple and effective method to regularizing features map in the early layers of Convolution Neural Network(CNN). One of the issues identified with deep learning is the features in early layers that robustness and discriminativeness. In this paper, we compute the optimal global threshold to determine the features that are passed to the next layers. We then evaluate ThCNN on an MNIST dataset comparing it CNN by applying multiple trained models. It yield decent accuracy compared to traditional CNN. It gives a 99.5%