Video Search Engines

Content Processing (Video Search Engine Systems)

Newly acquired media is available in a state that facilitates subsequent operations on the media such as transcoding and metadata extraction. Transcoding engines may operate independently on the content with the goal of preparing the content for delivery (perhaps via streaming) and normalizing to a single format suitable for archiving. We can consider a path […]

Retrieval (Video Search Engine Systems)

The Extensible Markup Language (XML) is well suited for representing the extracted metadata, along with any metadata that accompanies the source asset and any additional metadata that is added over the life of the asset while in the repository. While many metadata systems can be used for high-level metadata, there is really only a single […]

User Perspectives (Video Search Engine Systems)

Interaction States Let’s consider how a user interacts with a video search engine. We can model this as a set of behavioral states as shown in Fig. 4.6 where the retrieval activities are shown in white and the contribution activities are shown in grey. The states are as follows: •    Q: Query – the user […]

Factors Concerning Scalability (Video Search Engine Systems)

Introduction In the process of designing a content indexing and retrieval system, several factors influence the scalability of the system and basic choices can have a great effect on the cost required to support a given user base. Of course, the fundamental design decision of referring video playback requests back to the originator as opposed […]

Retrieval Interfaces (Video Search Engine Systems)

As with text search engine systems, video search systems may support several interfaces to allow developers to create new applications, or for users to access the service using multiple client applications other than browsers such as RSS readers, gadget containers such as desktop sidebars, or mashups which combine multiple services. Systems may support interfaces including: […]

Typical System Features (Video Search Engine Systems)

We indicated notification as an interface, but this may be thought of as more of a “service” or feature than an API. Other features typically found in video search services include: •    Favorites – saved searches where results may appear on the search engine landing page freshly executed with each visit. •    History – access […]

Introduction to Media Processing (Video Search Engines)

The only media descriptions available for the vast majority of media published on the Web today is global high level metadata. To differentiate themselves from systems that treat the described media payload as an opaque data file, individual systems must employ automated content processing. While specific processing methods have been optimized to handle particular media […]

Feature Extraction (Media Processing) (Video Search Engines)

Feature extraction implies processing series of media samples (signals) and creating more efficient representations that will be eventually useful in deriving meaning about the content represented by the signals. Generally for media processing, this achieves a large data reduction, sometimes on the scale of several orders of magnitude. It is typically not practical or useful […]

Media Segmentation (Media Processing) (Video Search Engines)

Segmentation is important for a number of reasons. The concept of segmentation is to divide a stream of media into semantically consistent units and one benefit is increased efficiency in representation or compression. For example, in video compression shot boundary detection can be used so that difference frames are calculated within a shot instead of […]

Clustering, Structure Generation (Media Processing) (Video Search Engines)

Assuming we have good segmentation, the notion of clustering or forming relations between segments using distance metrics arises. Consider a video program where two participants are discussing a series of issues, and we have three cameras in the studio, one for close-ups of each speaker and one for a wide shot. We now successfully detect […]