more_on_gLite3 - Indico

Enabling Grids for E-sciencE
More on gLite:
2 services you have not seen!
Mike Mineter
www.eu-egee.org
EGEE-II INFSO-RI-031688
Enabling Grids for E-sciencE
AMGA
Metadata Service
www.eu-egee.org
EGEE-II INFSO-RI-031688
Metadata on the GRID
Enabling Grids for E-sciencE
• Metadata is data about data
• On the Grid: information about files
– Describes files
– Locate files based on their metadata
EGEE-II INFSO-RI-031688
3
gLibrary Example of entries
Enabling Grids for E-sciencE
Collection
/gLibrary
Attributes
Entry Names
FileName
PathName
Type
Submitter
4ffaffc8-26e7-4826-b460-3d5bf08081a4
DedicatoAte.mp3
/grid/gilda/calanducci
Audio
Tony
Calanducci
00454dca-a269-4b93-8a45-c4012af05600
ardizzonelarocca_is_231005.ppt.gpg
/grid/gilda/calanducci/
EGEE
EGEEDOC
Tony
Calanducci
/gLibrary (continuum)
Attributes
SubmissionDate
Encryption
Description
Keywords
CreationDate
2006-01-05 00:00:00
false
Canzone delle vibrazioni
che ha ricevuto un
enorme successo tra i
teenagers nel 2003
Vibrazioni
2004-02-05 00:00:00
2005-01-05 16:44:22
true
gLite Information System
R-GMA, RGMA, BDII, IS
2005-10-05 23:40
EGEE-II INFSO-RI-031688
4
Further information
Enabling Grids for E-sciencE
• on AMGA and gLibrary:
– http://indico.eu-eela.org/conferenceTimeTable.py?confId=37
– (go to day 3 for the AMGA tutorial )
• AMGA Web Site
http://project-arda-dev.web.cern.ch/project-arda-dev/metadata/
EGEE-II INFSO-RI-031688
5
Enabling Grids for E-sciencE
Introduction to R-GMA:
Relational Grid Monitoring
Architecture
www.eu-egee.org
EGEE-II INFSO-RI-031688
R-GMA
Enabling Grids for E-sciencE
P1
VIRTUAL DATABASE
TABLE 1,Producer P1 details
P3
P2
TABLE 1, Colum defs
TABLE 2, Colum defs
TABLE 3, Colum defs
TABLE 4, Colum defs
SQL “CREATE TABLE”
SCHEMA
SQL “INSERT”
TABLE 2,Producer P1 details
SQL “SELECT”
TABLE 2,Producer P2 details
TABLE 2,Producer P3 details
TABLE 3,Producer P2 details
TABLE 3,Producer P1 details
TABLE 3,Producer P3 details
MEDIATOR
C1
C2
REGISTRY
There is no central repository!!! There is only a “Virtual Database”.
Schema is a list of table definitions: additional tables/schema can be defined by applications
Registry is a list of data producers with all its details.
Producers publish data.
Consumers read data published.
EGEE-II INFSO-RI-031688
7
NPM Frameworks: e2emonit
Enabling Grids for E-sciencE
• Network performance
data important:
– to detect and resolve
network problems.
– to intelligently schedule
jobs based on network
load and reliability.
• active measurements
between end-sites,
using tools such as
– iperf,
– udpmon
– ping.
EGEE-II INFSO-RI-031688
PP
PP
SP
PP
PP
C
NM-WG
WS
•https://egee.epcc.ed.ac.uk:
28443/npm-dt/query.jsp
8
More information
Enabling Grids for E-sciencE
• R-GMA overview page.
– http://www.r-gma.org/
• R-GMA in EGEE
– http://hepunx.rl.ac.uk/egee/jra1-uk/
• R-GMA command line tool
– http://hepunx.rl.ac.uk/egee/jra1-uk/glite-r1/command-line.pdf
• R-GMA Browser Home Page
– https://rgmasrv.ct.infn.it:8443/R-GMA/
EGEE-II INFSO-RI-031688
9