Provided are a method for analyzing a video signal from a camera and determining the position, orientation and direction of motion of a predetermined object and a device for the same. The device for video tracking motions of an object includes: a calibration unit for obtaining intrinsic parameters of a video camera; a camera distortion compensation unit for receiving video data, acquiring by the video camera, of a predetermined object on which at least one principal marker is set and removing lens distortion of the received video data using the intrinsic parameters of the camera; a point coordinate extraction unit for receiving video data from which lens distortions are removed by the camera distortion compensation unit, and extracting two-dimensional coordinates of the video data of the principal marker of the object; and a position, orientation and direction of motion estimation unit for estimating and outputting a position, orientation and direction of motion of the object, based on the two-dimensional coordinates input from the coordinate extraction compensation unit, the intrinsic parameters of the camera input from the calibration unit and three-dimensional coordinates displayed on the object. It is possible to set markers on the predetermined object, processing video data of the filmed object and establishing the position, orientation and direction of motion of the object.