An apparatus 1 for controlling a movable robot recognizes the person to be followed up from an image taken by a camera C by an image processing portion 20, controls leg portions R1 of a movable robot A so as to keep a prescribed interval between the movable robot A and the person by a portion 50 for detecting an action, and notify the degree of the distance between the movable robot A and the person to the person by a voice from a voice outputting portion 62.