A method of determining segments in a series of images based on previous segmentation results and on motion estimation. A second segment (108) of a second image (106) is determined based on a first segment (102) of a first image (100), with the first segment (102) and the second segment (108) corresponding to one object (104). The method comprises a calculation step to compare values of pixels of the first image (100) and the second image (106) in order to calculate a motion model which defines the transformation of the first segment (102) into the second segment (108). An example of such a motion model allows only translation. Translation can be described with one motion vector (110).