In a method to determine a selection vector that indicates a displacement of an image area from a first position in a first image to a second position in a second image, a set of prediction vectors and a set of test vectors are provided. Using selected test vectors, an image comparison is performed to supply an image comparison result for each selected test vector. The selected test vectors and at least one prediction vector are compared to provide at least one test vector comparison result for each selected test vector. The image comparison result and the at least one test vector comparison result are linked to provide at least one quality characteristic for each selected test vector. A ranking order is determined for these quality characteristics, where at least one test vector is selected as the displacement vector based on the ranking order determined.