ImageX - Explore and Search Local/Private Images

24th International Conference on Multimedia Modeling (MMM 2018)

Authors: Nico Hezel, Kai Uwe Barthel, Klaus Jung

TL;DR

We present a system for exploring and searching large sets of untagged images using standard hardware and operating systems, leveraging compact 64-byte feature vectors derived from convolutional neural network activations. Our approach enables fast search-by-example queries and keyword search by generating reference features from clustered web images.

Abstract

In this paper we present a system to visually explore and search large sets of untagged images, running on common operating systems and consumer hardware. High quality image descriptors are computed using activations of a convolutional neural network. By applying normalization and a principal component analysis of the activations compact feature vectors of only 64 bytes are generated. The L1-distances for these feature vectors can be calculated very fast using a novel computation approach and allows search-by-example queries to be processed in fractions of a second. We further show how entire image collections can be transferred into hierarchical image graphs and describe a scheme to explore this complex data structure in an intuitive way. To enable keyword search for untagged images, reference features for common keywords are generated. These features are constructed by collecting and clustering examples images from the web.

BibTeX

If you use our work in your research, please cite our publication:

@InProceedings{10.1007/978-3-319-73600-6_35,
author="Hezel, Nico
and Barthel, Kai Uwe
and Jung, Klaus",
editor="Schoeffmann, Klaus
and Chalidabhongse, Thanarat H.
and Ngo, Chong Wah
and Aramvith, Supavadee
and O'Connor, Noel E.
and Ho, Yo-Sung
and Gabbouj, Moncef
and Elgammal, Ahmed",
title="ImageX - Explore and Search Local/Private Images",
booktitle="MultiMedia Modeling",
year="2018",
publisher="Springer International Publishing",
address="Cham",
pages="372--376",
isbn="978-3-319-73600-6"
}