Automatic learning of conceptual knowledge in image sequences for human behavior interpretation

Abstract

This work describes an approach for the interpretation and explanation of human behavior in image sequences, within the context of a Cognitive Vision System. The information source is the geometrical data obtained by applying tracking algorithms to an image sequence, which is used to generate conceptual data. The spatial characteristics of the scene are automatically extracted from the resuling tracking trajectories obtained during a training period. Interpretation is achieved by means of a rule-based inference engine called Fuzzy Metric Temporal Horn Logic and a behavior modeling tool called Situation Graph Tree. These tools are used to generate conceptual descriptions which semantically describe observed behaviors.