Diseases of coronary artery are deliberated as one of the most common heart diseases leading to death worldwide. For early detection of such disease, the X-ray angiography is a benchmark imaging modality for diagnosing such illness. The acquired X-ray angiography images usually suffer from low quality and the presence of noise. Therefore, for developing a computer-aided diagnosis (CAD) system, vessel enhancement and segmentation play significant role. In this paper, an optimized adapter filter based on Frangi filter was proposed for superior segmentation of the angiography images using genetic algorithm (GA). The original angiography image is initially preprocessed to enhance its contrast followed by generating the vesselness map using the proposed optimized Frangi filter. Then, a segmentation technique is applied to extract only the artery vessels, where the proposed system for extracting only the main vessel was evaluated. The experimental results on angiography images established the superiority of the vessel regions extraction showing 98.58% accuracy compared to the state-of-the-art.