Information Technology Reference
In-Depth Information
FIGURE 5.9:
Adaptive Mode Control (adapted from [
250
]). The decay interval changes by changing
the global control register (GCR) which holds the threshold for the local counters (LICs). The global
counter (LIC Update Interval) does not change. Adaptation is controlled performance feedback loop
(adaptive mechanism). Reproduced from [
250
]. Copyright 2001 IEEE.
Control Logic (MCL)—shown next to the cache lines in Figure 5.9. The threshold, which is
the same for all cache lines, is kept in a global control register, the GCR.
12
Adaptation of the decay interval is simply a matter of setting the GCR to the appropriate
threshold for the LICs. For this, a feedback loop monitoring decay induced misses is employed.
The feedback loop works by adjusting the decay interval to keep the decay-induced miss rate
around a desired
target
which is given as a percentage of the application's
true
miss rate.
Decay-induced misses are distinguished from normal misses by keeping the tags powered
on at all times and detecting accesses to decayed lines (i.e., accesses that would be hits if the line
was still powered on). The decay-induced miss rate is measured within a time window, and at
the end of the window the decay interval is adjusted. If the decay-induced miss rate is less than
the target, the decay interval is decreased; otherwise, it is increased. Hitting the exact target
is difficult to do. Most often, the feedback loop simply oscillates around the target, constantly
adjusting the decay interval. To avoid this needless exercise, the decay interval is not allowed
to change if the miss rate falls within a band enveloping the
target
miss rate.
Figure 5.10 shows the behavior of the feedback loop. Two bold lines in the graph
represent, respectively, the “
ideal
”or
true
miss rate, which is the miss rate without decay, and
the “
target error
” which is the
additional
miss rate of the decay-induced misses. The target error
is defined as the fraction of the ideal miss rate via the
performance factor (PF)
which is externally
12
Note that although the hardware can accommodate individual decay intervals per cache line, adaptation is based
on a single global decay interval.
Search WWH ::
Custom Search