Image data containing the face image of a person is retrieved from a plurality of images, the retrieved image data is displayed, face image data, which is for image retrieval, is extracted from the displayed image data, and the extracted face image data is registered as reference face image data. Specified reference face image data in the registered reference face image data is designated and image data that contains the reference face image data is retrieved.