Early breast cancer diagnosis and detection are very important. It may greatly enhance treatment results and save a life. The absence of early cancer signs makes early identification challenging. Cancer continues to be one of the health subjects that many researchers work to advance. This study proposed a new hybrid model for classifying breast cancer images. The proposed framework consists of preprocessing stage and the proposed two models stage. For the preprocessing, we downsized every image from its original 50x50 to 32x32 pixel size, rotating and flipping all positive images for the Histology Images. The proposed hybrid model consists of a CNN model created from scratch and transfer learning based on EfficientNetB0 (CNN+ EfficientNetB0) to classify Invasive ductal carcinoma (IDC) into benign and malignant. According to tests, the CNN + EfficientNetB0 model has the highest accuracy compared to the other deep learning models. This model achieves 96% accuracy, 95% precision, 82.5% recall, and 88.3% F1- score.