Visually Exploring Millions of Images using Image Maps and Graphs

Big Data Analytics for Large‐Scale Multimedia Search, Chapter 11, John Wiley & Sons, Ltd (2019)

TL;DR

This work introduces various image sorting algorithms and a new measure for evaluating 2D image arrangements. It presents an enhanced self-sorting maps (SSM) algorithm for efficiently sorting millions of images, discusses a graph-based approach for browsing large collections, and explains how high-quality image features are generated using convolutional neural networks.

Abstract

This chapter describes different image sorting algorithms. It introduces a new measure, which is better suited to evaluate two-dimensional (2D) image arrangements. The chapter presents a modified self-sorting maps (SSM) algorithm with improved sorting quality and reduced complexity, which allows millions of images to be sorted very quickly. Graph-based approaches can handle changes in the image collection. The chapter also presents a new graph-based approach to visually browse very large sets of varying images. It shows how high-quality image features representing the image content can be generated using transformed activations of a convolutional neural network. The chapter then presents an overview of various visual browsing models for image exploration. A self-organizing map (SOM) is an artificial neural network that is trained using unsupervised learning to produce a lower dimensional, discrete representation of the input space, called a map. A SOM consists of components called nodes.

BibTeX

If you use our work in your research, please cite our publication:

@inbook{doi:https://doi.org/10.1002/9781119376996.ch11,
author = {Barthel, Kai Uwe and Hezel, Nico},
publisher = {John Wiley & Sons, Ltd},
isbn = {9781119376996},
title = {Visually Exploring Millions of Images using Image Maps and Graphs},
booktitle = {Big Data Analytics for Large‐Scale Multimedia Search},
chapter = {11},
pages = {289-315},
doi = {https://doi.org/10.1002/9781119376996.ch11},
url = {https://onlinelibrary.wiley.com/doi/abs/10.1002/9781119376996.ch11},
eprint = {https://onlinelibrary.wiley.com/doi/pdf/10.1002/9781119376996.ch11},
year = {2019},
keywords = {convolutional neural network, graph-based approaches, image sorting algorithms, self-organizing map, self-sorting maps, visual browsing models}
}