Information Technology Reference
In-Depth Information
amazon returns a result to user, even if it isn't ready yet (apologies later)
ncaa broadcaster turns people away, rather than giving everyone poor service
(analogy: restaurant and instead of a having a line, you let everyone sit
down at a table)
7.6
Case Study: data center servers
Customers get assigned to a node when they arrive at the web site, to the
node with the least load
Additional requests from that user get assigned to the same node (anity
scheduling)
Prevent users from hogging resources; favor short tasks over long ones or
bin requests based on source IP
want to ensure response time stays small, so add resources if load increases
it can take time to bring online new resources, so need to model with
control theory
