Background - Heterogeneous Multicore Processor Technologies for Embedded Systems - page 2

Still Image

JPEG
MotionJPEG
JPEG2000

Video

MPEG2
MPEG4
H.264
VC-1

Information,
Communication

Graphics

2D, 3D
Image base
Multi path
Rendering

SoC

WEB Browser
XML
Java
Data base
DLNA

Recognition,
Synthesis
Voice, Audio
Image
Biometrics

Audio

MP3
AAC
AAC Plus
Dolby 5.1
WMA
RealAudio

Security

AES
DES
RSA
Elgamal
DRM

Media

Flash
HDD
DVD
Blu-ray Disc

Fig. 1.1 Digital convergence

Giga Operations per Second Giga Operations per Second

0.01 0.01 0.1 0.1 1 1 10 10 100 100

Video Video

MPEG2 MPEG2

MPEG1 MPEG1

MP/ML MP/ML MP/HL MP/HL

JPEG JPEG MPEG4, H.264, DivX MPEG4, H.264, DivX

Graphics Graphics

3D rendering 3D rendering

10Mpps 10Mpps

100Mpps 100Mpps

2D rendering 2D rendering 3D image extraction 3D image extraction

Audio
Voice

Audio
Voice

AAC AAC

Sentence Translation Sentence Translation

Dolby-AC3
MPEG

Dolby-AC3
MPEG

Voice Translation Voice Translation

WMA WMA Word Recog. Word Recog. Voice Recognition Voice Recognition

Recognition
Comm.

Recognition
Comm.

VoIP modem VoIP modem

Face Recognition Face Recognition

Data modem Data modem

Video Recognition Video Recognition

Voice-print Rec. Voice-print Rec.Eye Recog.

FAX FAX

Fig. 1.2 Required performance of digital-convergence applications

hardware-accelerator approach is not always flexible. Better solutions that can exe-
cute a wide variety of high-GOPS applications should therefore be studied.
A photo of a ball-catching robot is shown in Fig. 1.3 . This is an example of
media-recognition and motion-control convergence [ 6, 7 ]. In this system, a ball
image is extracted and recognized from video images of two cameras. The trajec-
tory of the ball is predicted by calculating its three-dimensional position. Based
on the trajectory projection, the joint angles of the robot manipulators are calcu-
lated, and the robot catches the ball. The four stages of the media recognition and
the motion control need to be executed every 30 ms, and this requires over
10-GOPS performance. Like this example, a variety of functions, which may