Information Technology Reference
In-Depth Information
11
Indexing and Retrieval of
Ubiquitous
Visual Information
Lei Ye, Jianhua Ma, and Runhe Huang
CoNTENTS
11.1 Introduction .............................................................................................. 232
11.2 Visual Information Description............................................................. 233
11.2.1 Color Feature Descriptors ......................................................... 233
11.2.1.1 Dominant Color Descriptor (DCD) ........................ 233
11.2.1.2 Scalable Color Descriptor (SCD) ............................. 236
11.2.1.3 Color Layout Descriptor (CLD) ............................... 237
11.2.1.4 Color Structure Descriptor (CSD) ........................... 237
11.2.2 Texture Feature Descriptors ..................................................... 238
11.2.2.1 Homogeneous Texture Descriptor (HTD) ............. 238
11.2.2.2 Texture Browsing Descriptor (TBD) ....................... 239
11.2.2.3 Edge Histogram Descriptor (EHD) ........................ 240
11.2.3 Shape Feature Descriptors ........................................................ 241
11.2.4 Motion Feature Descriptors ...................................................... 242
11.2.5 Experimental Evaluation........................................................... 243
11.2.5.1 Statistical Analysis .................................................... 243
11.2.5.2 Perceptive Analysis................................................... 244
11.2.5.3 Effectiveness for Indexing ....................................... 244
11.3 Visual Similarity and Feature Aggregation......................................... 246
11.3.1 Relevance and Visual Similarity .............................................. 247
11.3.2 Linear Combination of Visual Features .................................. 250
11.3.3 Classifier Combination .............................................................. 251
11.4 A Case of Application: Web Image Search........................................... 255
11.5 Conclusions............................................................................................... 257
References ............................................................................................................ 257
It is a challenge to index and retrieve visual information generated from
ubiquitous multimodal sensors based on its perceptual relevance. This
chapter describes the key techniques and some fundamental problems
in indexing and retrieving visual information including visual informa-
tion description, visual similarity, and feature aggregation. First, standard
231
