Systems and methods for probabilistic determination of real world events in a sensory environment such as a predicting location in a responsive environment are described. A responsive environment system includes a set of sensors for making probabilistic observations of RFID sensor tags. The system also includes a control system employing a set of possible real world events and statistical processing system for predicting a particular real world event state based upon the sensor observations. In one configuration, a Hidden Markov Model is used for the statistical processing system and may be updated based upon the prediction of the model. The responsive environment will then launch a response based upon the predicted real world event state.