Metadata corresponding to each segment is added to a content. Each metadata describes a metadata item such as the dominant color or person of the segment. Each metadata item describes metametadata for representing an editing content to the content that influences the effectiveness of the metadata item. When the content is edited, an information processing apparatus adds to the metametadata a description representing executed editing. From the metametadata, the information processing apparatus which processes the content can determine the effectiveness of each metadata item. As a result, the effectiveness of each metadata can be reliably determined.