A system for providing a data broadcast service for digital television receivers. The system includes a data authoring system for creating a program description, a data service encoder for combining the description with other information and encoding it, and a multiplexer for using the encoded data service information into a transport data stream. A receiver at the client end receives the transport data stream and extracts the data and the audiovisual program and builds a summary for the viewer.