Semantic Representation of Motion for Tracing Object in Surveillance System

Abstract

Recent proliferation of multimedia data necessitates effective and efficient methods of retrieving of multimedia data. Especially, intelligent surveillance system needs semantic multimedia data processing. However, these studies are significantly insufficient to enable a complete semantic recognition in regard to semantic-based video retrieval. Current technology focuses on analysis of low-level characteristics such as color, texture, shape, and trajectory of an object and on applications of those characteristics. In this paper, we develop a semantic representation in human language to reduce the semantic gap between low-level and high-level characteristics; with consideration of not only the low-level characteristics but also the high-level characteristics with the use of the human language. Particularly, this paper focuses on semantic representation by using topological and directional relations between non-moving and moving objects for intrusion detection system using Closed-Circuit Television (CCTV). To this end, we capitalize on size relation of the object based on the previous studies to suggest 3D spatio-temporal relation. We also intend to reduce semantic gap by mapping with the use of predicates. This paper extends our previous work [17] published on SeCIHD 2011.