Hardware Reference
In-Depth Information
image of the original input image from the USB camera. The size of the input image
is 320 × 240 pixels. A smoothed image is shown at the upper right. The lower left
image shows the edge detection effect, and the lower right image shows the corner
detection effect. The images are written on the frame buffer in Linux using the
Xgraphics functions of the Xlib library.
6.4
Video Image Search
One example of the systems utilizing the multicore chip is a video image search
system. A detailed implementation of the system with the multicore chip or RP-X
[
17
] is described in this chapter. It offers a video-stream playback with a graphical
operation interface, as well as a similar-image search [
18
] that recognizes faces
while playing back video. It makes the most use of the heterogeneous cores such
as the video processing unit (VPU) in playing video streams and SH-4A in per-
forming image recognition. Figure
6.35
shows a block diagram of the implemented
video image search system on the chip. The system operates on two different oper-
ating systems, uITRON and Linux, over a hypervisor, to manage the physical
resources of the chip. The hypervisor is a programming layer lower than operating
systems [
19
]. The two operating systems use a common shared memory for their
intercommunications.
Face
detection
Face
recognition
Application
Video image search
GUI
uITRON
SH-Linux (SMP)
OS
Hypervisor
VPU
VEU
SH-4A
SH-4A
SH-4A
SH-4A
SH-4A
Chip
BEU
LCDC
MMU
Device
interface
DVI
I/F
SATA
I/F
USB
I/F
Ethernet
I/F
Device
Display
Memory
HDD
HID
IPTV
: Internet Protocol television
MMU
: Memory Management Unit
GUI
: Graphical User Interface
DVI
: Digital Visual Interface
VPU
: Video Processing Unit
SATA
: Serial Advanced Technology Attachment
VEU
: Video Engine Unit
USB
: Universal Serial Bus
BEU
: Blend Engine Unit
HDD
: Hard Disk Drive
LCDC
: Display Controller
HID
: Human Interface Device
Fig. 6.35
Block diagram of developed video image search system
Search WWH ::
Custom Search