The propagation of dust-acoustic solitary waves in an magnetized collisionless plasma consisting of positive and negative dust, electrons and ions with Boltzmann distribution are examined. For nonlinear dust acoustic waves (DAWs), a reductive perturbation method was employed to obtain the Kortewege-de Vries (KdV) equation for the first-order potential. As the wave amplitude enlarged, the width and velocity of the wave deviate from the prediction of the KdV equation. Higher order analysis of the perturbed (KdV) equation was used to the fifth-order dispersion term. The effects of higher-order corrections on dust acoustic solitary structures are studied and discussed.