Real-Time Visual Navigation in Huge Image Sets Using Similarity Graphs

27th ACM International Conference on Multimedia (MM '19)

TL;DR

We demonstrate a system for real-time visual exploration of millions of images using a standard web browser, addressing the challenge of inspecting large collections. Our approach leverages graph-based image navigation and a hierarchical similarity graph to present images in a dynamically updated, zoomable 2D map.

Abstract

Nowadays stock photo agencies often have millions of images. Non-stop viewing of 20 million images at a speed of 10 images per second would take more than three weeks. This demonstrates the impossibility to inspect all images and the difficulty to get an overview of the entire collection. Although there has been a lot of effort to improve visual image search, there is little research and support for visual image exploration. Typically, users start "exploring" an image collection with a keyword search or an example image for a similarity search. Both searches lead to long unstructured lists of result images. In earlier publications, we introduced the idea of graph-based image navigation and proposed an efficient algorithm for building hierarchical image similarity graphs for dynamically changing image collections. In this demo we showcase real-time visual exploration of millions of images with a standard web browser. Subsets of images are successively retrieved from the graph and displayed as a visually sorted 2D image map, which can be zoomed and dragged to explore related concepts. Maintaining the positions of previously shown images creates the impression of an "endless map". This approach allows an easy visual image-based navigation, while preserving the complex image relationships of the graph.

BibTeX

If you use our work in your research, please cite our publication:

@inproceedings{10.1145/3343031.3350599,
author = {Barthel, Kai Uwe and Hezel, Nico and Schall, Konstantin and Jung, Klaus},
title = {Real-Time Visual Navigation in Huge Image Sets Using Similarity Graphs},
year = {2019},
isbn = {9781450368896},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3343031.3350599},
doi = {10.1145/3343031.3350599},
booktitle = {Proceedings of the 27th ACM International Conference on Multimedia},
pages = {2202–2204},
numpages = {3},
keywords = {visualization, image sorting, image retrieval, image graph, exploration},
location = {Nice, France},
series = {MM '19}
}