Certain embodiments of the present invention provide a method and system for improved identification of significant images using visual tracking. Certain embodiments of the system include a visual tracking system capable of tracking a user gaze with respect to a display device and a significant image selector for identifying at least one significant image based on user viewing time. The visual tracking system identifies an image at which a user is gazing records a viewing time during which the user is looking at the image. In an embodiment, the visual tracking system records viewing times for one or more users. In an embodiment, meta-data is associated with one or more significant images to identify the images as significant images, for example. The system may further include a database or table storing significant image information.