An endoscopic simulator system includes an endoscope, a detector, a three-dimensional image measuring device, and an image processor. The endoscope is usable for endoscopic simulation. The endoscope has an elongated insertion section and a control section for manipulating the insertion section. The detector detects a movement of the insertion section to obtain activity data on the insertion section. The image measuring device three-dimensionally measures the interior of a patient's body to obtain internal organ shape data. The image processor constructs a virtual three-dimensional image of the interior of the patient's body supposed to be observed through the endoscope, based on the organ shape data obtained from the image measuring device and the activity data on the insertion section obtained from the detector.