A system and method of interpreting communicative behaviors including actions, gestures and sounds produced by individuals, the system includes a database of stored behavior codes, each behavior code having an associated explanation; the system can access the database, records a behavior performed by the individual, assigns an observed behavior code to the recorded behavior, compares the observed behavior code to the stored behavior codes in the database of stored behavior codes, and retrieves the explanation associated with the stored behavior codes which match the observed behavior code. The system can also recognize events and correlate recognized events to the individual's behavior's.