Graph-Based Browsing for Large Video Collections

21st International Conference on Multimedia Modeling (MMM 2015)

TL;DR

We introduce a graph-based browsing system that extends ImageMap for visually searching large video collections, using a hierarchical graph to preserve complex inter-image relationships. This system supports various visualization and navigation modes, allowing users to apply filters and search tools to efficiently explore and locate relevant video frames.

Abstract

We present a graph-based browsing system for visually searching video clips in large collections. It is an extension of a previously proposed system ImageMap which allows visual browsing in millions of images using a hierarchical pyramid structure of images sorted by their similarities. Image subsets can be explored through a viewport at different pyramid levels, however, due to the underlying 2D-organization the high dimensional relationships between all images could not be represented. In order to preserve the complex inter-image relationships we propose to use a hierarchical graph where edges connect related images. By traversing this graph the users may navigate to other similar images. Different visualization and navigation modes are available. Various filters and search tools such as search by example, color, or sketch may be applied. These tools help to narrow down the amount of video frames to be inspected or to direct the view to regions of the graph where matching frames are located.

BibTeX

If you use our work in your research, please cite our publication:

@InProceedings{10.1007/978-3-319-14442-9_21,
author="Barthel, Kai Uwe
and Hezel, Nico
and Mackowiak, Radek",
editor="He, Xiangjian
and Luo, Suhuai
and Tao, Dacheng
and Xu, Changsheng
and Yang, Jie
and Hasan, Muhammad Abul",
title="Graph-Based Browsing for Large Video Collections",
booktitle="MultiMedia Modeling",
year="2015",
publisher="Springer International Publishing",
address="Cham",
pages="237--242",
isbn="978-3-319-14442-9"
}