Database Reference
In-Depth Information
used on a more regular basis to schedule a subset of the optical network
connections used to broadcast lectures from Louisiana State University as
part of an education experiment carried out in 2007.
46*
HARC Compute Resource Managers are now deployed on several machines
in the TeraGrid,
†
LONI,
‡
and UK NGS
$
infrastructures. This growing, sup-
ported infrastructure was used in demos by the GENIUS project.
33
at SC'07
Although the early results are encouraging, if the advance scheduling of
light paths is to become a production activity, then the network scheduling
service(s) need to be properly integrated with the other control/management
plane software to ensure that these activities do not interfere with the pre-
scheduled light paths (and vice versa).
4.7 Conclusions
The increase in the demand for large-scale data processing has necessitated
collaboration and sharing of data collections among the world's leading edu-
cation, research, and industrial institutions and use of distributed resources
owned by collaborating parties. Ecient and reliable access to large-scale data
sources and archiving destinations in a widely distributed computing environ-
ment brings new challenges such as scheduling data movement and placement,
ecient use of wide area network links, remote access to partial data, and
co-scheduling of data storage, network, and computational resources. In this
chapter, we tried to address the challenges and possible solutions in each of
these areas with specific examples and case studies. We believe that these
examples are only some of the initial steps taken toward the solution of these
problems, and there is still a lot to be done to break the barriers in front of the
domain scientists to easily and e
ciently access and use distributed datasets.
Acknowledgments
The work presented in this chapter is in part sponsored by the National
Science Foundation under award numbers CNS-0846052 (Career-Kosar),
CNS-0643229
(Career-Thain),
CNS-0619843
(PetaShare),
EPS-0701491
*
This was the first distance-learning course ever offered in uncompressed high-definition video.
Participating locations included other sites in Louisiana, Masaryk University in the Czech Re-
public, University of Arkansas, and North Carolina State University.
†
http://www.teragrid.org/. Accessed July 16, 2009.
‡
http://www.loni.org/. Accessed July 16, 2009.
$
http://www.ngs.ac.uk/. Accessed July 16, 2009.
