159.735 Parallel Computing
Globus Toolkit – Grid
Ayaka Ohira
Overview

Grid computing

Globus toolkit

GT4 architecture

GT4 projects

How to run a simple program
Grid computing



“A Grid is a system that coordinates resources that
are not subject to centralized control using standard,
open, general-purpose protocols and interfaces to
deliver nontrivial qualities of service.”
- Ian Foster
A kind of distributed computing
Enables large scale calculations
and simulations.
http://www.fraunhofer.de/fhg/Images/grid
%20computing_kl_tcm6-71852.jpg
Globus Toolkit

Developed by Globus Allience

De facto standard for grid computing

Open source

Heterogeneous

A set of software and services to solve general grid
problems.
Globus toolkit

1998: Globus toolkit version 1

2002: Globus toolkit 2

2003: Globus toolkit 3

2006: Globus toolkit 4
Globus Toolkit 4 (GT4)




Extensive use of Web Services
Web Services are flexible, loosely coupled and
platform and language independent
Based on OGSA standard
Implemented on Web Service Resource Framework
(WSRF)
GT4 architecture
http://www-unix.globus.org/toolkit/about.html
Common runtime components
(C WS Core)


Provide a set of libraries and tools that allows
services to be platform independent
Tested platforms for C WS Core:

IA32/Linux/gcc32

IA64/Linux/gcc64

x86_64/Linux/gcc64

SPARC/Solaris 9/vendorcc32

PowerPC/AIX 5.2/vendorcc32

Mac/OS X/gcc32
Security




Grid Security Infrastructure (GSI)
Provides fundamental security services needed to
support grids
Message-level security
 X.509 (Public Key Cryptography)
Transport-level security

HTTPS (Hyper Text Transport Protocol Secure)
Data Management

Manages data movement and replication

Data transfer:


GridFTP

Reliable File Transfer (RFT)
Data replication

Replica Location Service (RLS)
Information Services




Monitoring and Discovery Service (MDS4)
Enable projects to discover needed data from
services to make job submission
Index service
Trigger service
Execution Management




Grid Resource Allocation Management (GRAM)
Provides secure, reliable and sound job execution
services
Enables users to locate, submit, monitor and cancel
remote jobs on Grid-based compute resources
Not a job scheduler!
Grid projects using GT4

NASA Information Power Grid

Earth System Grid

TeraGrid





Laser Interferometer Gravitational Wave
Observatory (LIGO) project
Open Science Grid
Cancer Bioinformatics Grid
UK National Grid Service
China Grid
http://www-unix.globus.org/alliance/impact/
Common steps to submit a job

Install and configure a grid

http://www.globusconsortium.org/tutorial/
1.Start Globus Toolkit
2.Write RSL (Resource Specification Language) for
your program
3.Submit a job
Common steps to submit a job...cont

Start Globus toolkit
/etc/init.d/globus-4.0.1 start

RSL file example
<job>
<executable>/your/directory/name</executable>
<argument>hello</argument>
<stdout>hello.out</stdout>
<stderr>hello.err</stderr>
</job>
Common steps to submit a job...cont

Submit the job
globusrun-ws –submit –F
[protocol://]{hostname|hostaddr}[:port][/service] -f
yourrslfile.rsl

Copy a file from a remote server
globus-url-copy gsiftp://remote.host.edu/path/to/file
file://path/on/local/host
Further readings

Tutorial on how to set up GT4 using PBS and SGE job
scheduler


MPICH-G2 website


http://www.globusconsortium.org/tutorial/
http://www3.niu.edu/mpi/
Globus allience official website

http://www-unix.globus.org/
Thank you
Questions?
Descargar

www.massey.ac.nz