Information Technology Reference
In-Depth Information
Figure 3. An example of visually expanding the space of free association found by the Imagination En-
vironment. Here the term 'agreement,' from G. W. Bush's 2003 State of the Union Address, is juxtaposed
with a picture of the Oslo II Interim Agreement of 1995, one of the Google Image results for that term.
Agreement
``He (Saddam Hussein)
systematically violated
that agreement"
online sources to find images and media clips
related to the content of the media. It presents a
selection of the results, images as found objects,
during its performance. The Imagination Environ-
ment understands the structure of a scene of video;
it builds a representation of the scene's context,
uses that context to find new media and run a
performance. The Imagination Environment has
been reviewed in the New York Times (Mirapaul,
2004) and shown as a public display at Second
City Chicago from April 2004 to July 2005, ACM
SIGGRAPH ETECH 2004, and Wired Magazine 's
NextFest 2005 (Anderson, 2005) and NextFest
2006. MusicStory builds on the foundation of
the Imagination Environment by incorporating
tagged image search with automated examination
of audio cues and lyrics search to create a uni-
fied artistic experience. Instead of externalizing
the online zeitgeist, MusicStory seeks to invoke
personal memories by using private media content
(mp3s and photos). This is described in greater
detail in a later section.
related Work
There has been much work in automatic music
video creation. Our work bears the most like-
ness to P-Karaoke from Microsoft Research Asia
(Hua, Lu, & Zhang, 2004). P-Karaoke selects
personal home videos and images from a user's
local documents to uses as the backdrop video
projection during a karaoke performance. Since
a user's local documents are often unstructured,
it filters out the undesirable images. Undesirable
images are typically those which are damaged by
being burred or through bad exposure. Images
which are duplicated on the user's local disk are
also avoided.
P-Karaoke relies on the Microsoft DirectX
framework for the video creation and both systems
examine the beat of the audio track. P-Karaoke
(blurred, bad exposure, duplicates, etc.) selects ca-
priciously from the final candidate list. P-Karaoke
uses the beat of the audio track, relying on exact
beat transitions to structure the video creation.
Search WWH ::




Custom Search