The predominant method of communication for hearing-impaired and deaf people is still sign language. It is a carefully constructed hand gesture language, and each motion denotes a certain meaning. The purpose of this paper is to create a system for Arabic Sign Language automatic translation. The proposed Arabic sign to Text System consists of five primary stages and serves as a translator for deaf and dumb persons and normal people to improve communication. This system depends on building a two datasets image features for Arabic sign language gestures alphabets from two resources: the Arabic Sign Language dictionary and gestures from different signers' humans. It also uses gesture recognition techniques, which lets the user interact with the outside world. Video and images capture, Video and images processing, Hand Signs construction, classification, and finally text transformation and interpretation. In this paper, we use a set of appropriate features in step hand sign construction and classification of based on different classification algorithms such as (KNN, MLP and C4.5) and compare these results to get better classifier. This system offers a novel technique of hand detection that detects and extracts hand gestures of Arabic Sign from Image or Video..