Title :

From Text to Images: Weighting Schemes for Image Retrieval

Author(s) :

Tirilly, Pierre [Auteur]
FOX MIIRE [LIFL]
Claveau, Vincent [Auteur]
Creating and exploiting explicit links between multimedia fragments [LinkMedia]
Gros, Patrick [Auteur]
Creating and exploiting explicit links between multimedia fragments [LinkMedia]

Journal title :

Journal of Multimedia

Pages :

1-21

Publisher :

Academy Publisher

Publication date :

2015-01

ISSN :

1796-2048

English keyword(s) :

weighting schemes
divergence from randomness
vector space model
Minkowski distances
Image retrieval
visual words
fractional distances.

HAL domain(s) :

Informatique [cs]/Vision par ordinateur et reconnaissance de formes [cs.CV]
Informatique [cs]/Recherche d'information [cs.IR]

English abstract : [en]

— Bags of visual words are the most studied image description technique in the last years. This representation of images raised new possibilities as well as new research issues. In particular, it is important to automatically ...
Show more >— Bags of visual words are the most studied image description technique in the last years. This representation of images raised new possibilities as well as new research issues. In particular, it is important to automatically determine which visual words are the most relevant to describe the images, and which ones should be ignored. This issue is a classical problem of textual information retrieval, usually addressed by the use of weighting schemes. In this paper, the most common weighting schemes from text retrieval are applied to the case of visual word-based retrieval.New weighting schemes are also proposed, and several Minkowski-like distances are tested. The experiments are performed on four different datasets that correspond to two different retrieval tasks; it allows us to bring to light some properties of visual words and weighting schemes. This studyresults in several findings. It first shows that the optimal setting for distances and weighting schemes depends on the nature of the visual content of the images considered. Especially, raw frequency can be the most effective weight when dealing with complex datasets; it questions the habit to systematically use the tf . idf weighting scheme. It also shows that weighting schemes and Minkowski distances have similar effect and should be used together in a consistent way. Based on these findings, general guidelines for the choice of distances and weighting schemes are proposed.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

Collections :

• Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189

Source :

Harvested from HAL