Herbal remedies have been widely used for management of several ailments in recent years in both developed and developing countries. Owing to their safety and efficacy, scientists paid a great attention to herbal products and/or blends in treating several health problems. Diabetes mellitus is one of the most crippling diseases with huge social, health, and economic consequences. Several phytochemical classes including alkaloids, flavonoids, and essential oils are bioactive ingredients widely distributed in herbal products with promising outcomes in diabetes management. The main aim of the current review is to introduce a holistic overview on medicinal plants used to treat diabetes mellitus from several perspectives: 1) Provide scientific data about the plants effective in diabetes control including the used organs, extracts, and the active phytochemicals. 2) possible mechanism of action of natural products in controlling diabetes. 3) The potential use of bioactive phytochemicals with antidiabetic properties. The vast array of this review can illustrate the value of herbal remedies for treatment of diabetes with possible application.