A scene segment dividing device which can precisely specify a break segment and an in play segment based on a sports image and can precisely manage a series of offenses in the in play segment as each scene segment. A scene segment division unit extracts ball track information in an in play segment based on specified break segments to divide the information