A system and method for determining pain level is disclosed herein. The method comprises: monitoring the gestures of a patient continuously using a video imager. From the monitored gestures a patient-status corresponding to at least one clinical factor is identified and the patient-status is automatically recorded in an electronic medical record (EMR). The method and system describes an exemplary embodiment of determining pain level of a patient in a clinical environment using facial expressions and sound.