Spatial arrangement of color flows for video retrieval

Retrieval of video based on high-level content requires that models are developed to map low level perceptual features into high level semantic concepts. Commercials are a video category where the link between low level perceptual features and high level semantics is stressed, since the way colors are chosen and modified throughout a spot create a large part of the message. In this paper, we propose a model for representation and comparison of video content based on the spatial arrangement of color flows. A model for representation and comparison of spatial relationships between extended sets of pixels in a 3D space is introduced by developing on the concept of weighted walkthroughs. Results of preliminary experiments are reported for a library of video commercials.