An autofocus device comprising a lens-driving unit, a focal-point-position-detecting unit that detects a position of a focal point of the lens, and a distance measurement sensor. The sensor measures a distance to a subject based on a reference field of view for distance measurement and a field of view for distance measurement being offset outwardly from the reference field of view and/or a field of view for distance measurement having a field of view that is different from the reference field of view. The device has a control unit that controls the lens-driving unit to drive the lens to meet the position of the focal point of the lens to an in-focus position thereof. The focusing operation starts by setting the lens drive based on a representative value selected from measured distance results obtained by the distance measurement sensor and the position of the focal point of the lens.