OMII-Europe-infn-set07 - Istituto Nazionale di Fisica Nucleare

OMII-Europe
(Open Middleware Infrastructure Institute for Europe)
A.Ghiselli
INFN-CNAF
Referee meeting, settembre 2007
What is OMII-Europe?
(www.omii-europe.org)
• EU funded FP6 project (RI)
– Starting May 2006, initial 2 year duration (up to 4/08)
– 16 partners (8 European, 4 USA, 4 Chinese)
• Goal is to provide key software components, standard
compliant, for building e-infrastructures
• What will OMII-Europe do?
– Common interoperable services:
• Database Access, Virtual Organisation Management, Portal,
Accounting, Job Submission and Job Monitoring
• Capability to add additional services
– Infrastructure integration
• Initial EGEE/UNICORE/Globus interoperability
• Interoperable security framework
EU project: RIO31844-OMII-EUROPE
OMII-Europe guiding principles
• Committed to standards process
– Implementing agreed open standards and working with
standards process (GGF/Oasis)
• Quality Assurance
– Published methodology and compliance test
– All software components have QA process and audit trail
– Working with similar projects and organisations to agree policies
• Impartiality
– OMII-Europe is “honest broker” providing impartial
advice/information on e-infrastructures
EU project: RIO31844-OMII-EUROPE
OMII-Europe Project Partners
114 person years over 2 years, 5 million Euro, 4 major Grid infrastructures
University of Southampton UK (coordinator)
University of Chicago USA
Fujitsu Laboratories Europe UK
NCSA, University of Illinois USA
Forschungszentrum Juelich Germany
University of Southern California Los Angeles
USA
Kungl Tekniska Högskolan Sweden
University of Wisconsin-Madison USA
Istituto Nazionale di Fisica Nucleare Italy
Beihang University China
Poznan Supercomputing & Networking Center
Poland
China Institute of Computing Technology
Beijing China
University of Edinburgh UK
Computer Network Information Centre Beijing
China
CERN, European Organisation for Nuclear
Research Switzerland
Tsinghua University
China
EU project: RIO31844-OMII-EUROPE
The Virtuous Cycle - Technology transfer with grid
infrastructure projects and standards organisations
JRA2
SA2
Standards
Compliance
Testing and QA
New Components
Standards
Implementation
Components
IN
Globus
OMII-UK
CROWN
OUT
Components
JRA4
JRA1
Benchmarking
Repository
SA1
Supported
Components on
Eval. Infrastructure
SA3
JRA3
Integrated
Components
EU project: RIO31844-OMII-EUROPE
INFN participation
•
•
•
JRA1 activities (sviluppo middleware)
– VO oriented authentication and authorization (sviluppo di VOMS con interfaccia conforme al protocollo
SAML (Security Assertion Markup Language))
– Accounting (ri-ingegnerizzazione di DGAS con interfaccia e formato dei dati conforme al protocollo
RUS/UR, Resource Usage Service/Usage Record))
– Job submission and monitoring (sviluppo di CREAM conforme agli standard JSDL/BES Job Sub
Description Language/Basic Execution Service)
– Database access (integrazione di OGSA-DAI con VOMS e Glueschema)
– Portal Interface (accesso a cream/bes, DGAS/RUS)
JRA2
– Identification of new services: definizione del GLUESCHEMA V2 per CREAM/BES e sviluppo degli
infoprovider
JRA3
– Infrastructure Integration
•
•
•
•
JRA4
– Benchmarking (sviluppo dei tools ed esecuzione dei test di bechmarking sulle componenti di JRA1)
SA1
–
•
Common Security Infrastructure
Infrastructure Integration (integrazione delle componenti sviluppate in JRA1)
Repository (contenente le componenti sviluppate da jra1 e relativa documentazione inclusi build e test
report)
SA3
– Evaluation Infrastructure and Support (partecipazione al tesbed)
EU project: RIO31844-OMII-EUROPE
SA1
coord.
coord.
INFN
A.Caltroni
SA3
UEDIN
JRA1
Database
UEDIN
JRA1
VO management
INFN
JRA1
accounting
KTH
JRA1
job submit
INFN
JRA1
Portal
PSNC
JRA2
new services, TC
GlueSchema
INFN
JRA3
security infrastr.
KTH
JRA3
infrastr. integration
FZJ
JRA4
benchmarking
KTH
TOTALI
F. FTE
req.
0,25
F
F people
0,8
E-mail
A.Caltroni [email protected]
0,2
V.Venturi
M.Marzolla
S.Andreozzi
V.Venturi [email protected]
A.Caltroni [email protected]
UNF. FTEUF
req.
1
0,25
0,25
UF people
E-mail
A.Ghiselli
M.Mazzucato
[email protected]
[email protected]
[email protected]
0,5
0,5
Marco Verlato
0,2
0,2
G.Donvito
V.Venturi
[email protected]
0,7
0,5
0,2
F.Stagni
A.Gianoli
[email protected]
[email protected]
0,7
0,5 Luca Tomassetti [email protected]
Rosario Piro
[email protected]
1,2
1
0,2
0,95
1
0,95
0,8
0,2
0,3
M.Marzolla [email protected]
S.Andreozzi [email protected]
G.Fiorentino [email protected]
0,2
0,2
0,2
M.Marzolla [email protected]
0,2
0,25
0,8
S.Andreozzi [email protected]
1
1
1
1
M.Canaparo [email protected]
M.Carpene' [email protected]
1
0,5
0,5
A.Ferraro [email protected]
P.Andreetto [email protected]
0,5
0,3
0,2
A.Gianoli
A.Ghiselli
[email protected]
[email protected]
1,25
0,5
0,5
0,2
A.Ferraro [email protected]
P.Andreetto [email protected]
G.Fiorentino [email protected]
0,5
0,5
E.Luppi
A.Ghiselli
[email protected]
[email protected]
0,5
0,5
G.Fiorentino [email protected]
0,5
8,75
10
Michele Pace [email protected]
A.Ghiselli
M.Mazzucato
5
??
3,4
EU project: RIO31844-OMII-EUROPE
Spotlight on some achievements thus far
(review in june 07, INFN specific)
•
•
•
•
•
•
•
•
•
VOMS service extended to SAML support and integrated into UNICORE
– SAML support available for integration into EGEE
BES service available for UNICORE, OMII-UK, CREAM-BES
Implementation of a common resource usage service (RUS) for gLite
(DGAS), Globus (SGAS) and UNICORE in progress
Initiated development of a common security profile acceptable to all grid
middleware systems
– gLite, Globus and UNICORE to accept x509 Proxy cert.
Produced first grid benchmarking reports
Plan for GLUE-2 schema implementation for JSDL/BES CEs just started
Repository in place and open to activities for upload of re-engineered
components
OGSA-DAI 3.0 alpha version for UNICORE and gLite available
Portal demonstrator access to gLite and UNICORE providing single sign
on and access to resources
– Interest from EGEE sites
EU project: RIO31844-OMII-EUROPE
Plans for the forthcoming months
• “To move from providing common services and interoperable
infrastructures to a complete, reliable set of services and
demonstrable solutions”
EU project: RIO31844-OMII-EUROPE
Plans for the forthcoming months: Integration between activities
(INFN specific)
•
•
•
•
•
JRA1/VOMS with JRA1/Job submission and JRA1/accounting
– Use of SAML assertions in BES servers (CREAM/BES)
– Use of SAML assertions in RUS servers (DGAS/RUS)
JRA3/Security
– Common authentication/authorization solutions will be adopted for
secure job submission and accounting operations
JRA2 with JRA1/JobSub
– GlueSchema is one of the topics which was selected by JRA2 for
evolution and implementation during the second year; it will be
integrated in CREAM/BES and UNICORE/BES
– GlueSchema will be used to express requirements on resources in JSDL
JRA4/Benchmarking
– Benchmarking test for CREAM/BES, VOMS/SAML and DGAS/RUS
SA3/evaluation infrastructure and SA1/repository
– All the implemented services will be downloaded from the Repository
and deployed on the integrated gLite-Unicore infrastructure
EU project: RIO31844-OMII-EUROPE
Participation in middleware standardisation
•
Most project participants involved as member/observer in many OGF WG
–
–
–
–
–
–
OGSA RUS/UR WG (Resource Usage Server)
OGSA BES WG (Basic Execution Service)
OGSA JSDL WG (Job Submission Description Language)
GIN CG (Grid Interoperability Now)
OGSA-AuthZ-WG (Authorization)
GLUE WG (Grid service information modeling)
EU project: RIO31844-OMII-EUROPE
ATTIVITA' OMII-Europe 2008
Sito
Missioni Int (k Missioni Estere
Euro)
(k Euro)
FTE persone
Consumo
(k Euro) Inventariabile Totale sito
Commenti
0.2/1 unfunded
BA
CNAF
0,2
1
Donvito
6,5
7
10
55
FE
2
4
3
15
MI
1
1
2
6
1
PD
TO
3,75
5
10
25
1
5
Totale
13,5
18
25
101
7
20
5
15
6/6 funded, 0.5/1 unfunded
missioni estero: all-hands 28 + OGF 8 + varie
Andreozzi, Ghiselli,
(es. F2F meeting) 10 = 50
Canaparo,
missioni italia: 15
Carpenè, Ferraro,
inventariabile: 6 server bi-processore
Pace, Venturi
2/4 unfunfed
missioni estero: all-hands 6 + OGF 2 + varie
(es. conferenze) 4 = 12
Gianoli, Luppi,
missioni italia: 10 (es. riunioni al CNAF) Stagni, Tomasetti
1 funded
missioni estero: all-hands 4 + varie (es. F2F
meeting) 2 = 6
missioni italia: 4 (es. riunioni al CNAF) Fiorentino
3/3 funded + 0.75/2 unfunded
missioni estero: all-hands 16 + varie varie (es.
F2F meeting) 4 = 20
Marzolla, Andreetto,
missioni italia: 24 (es. riunioni al CNAF) Caltroni, Verlato,
inventariabile: 2 server bi-processore
Mazzucato
consulenza
Guarise, Piro
85
18
9
41
153
EU project: RIO31844-OMII-EUROPE
StoRM: attivita’ per il 2008
•
•
•
WLCG SRMv2.2 ROLL-OUT PLAN
– https://twiki.cern.ch/twiki/pub/LCG/GSSD/SRM-Rollout-Plan2007.pdf
– Definito fino alla fine Febbraio 2008 ( SRM v2.2 deployed in T1 e
T2 in produzione). Possibile estensione con nuovi task.
StoRM fixing and improvement
– Realizzazioni di configurazioni ulteriormente scalabili,
Adeguamento sviluppi GPFS, Fixing, Performance, Sviluppo nuovi
driver (Lustre), New features..
StoRM e Castor in T1
– Driver per Castor e utilizzo di Castor come T1D0 per StoRM..
EU project: RIO31844-OMII-EUROPE
StoRM : Richieste Finanziarie
• Trasferte
– WLCG SRMv2.2 Collaboration
• 4 Trasferte per 2 persone in EU (CERN / UK / ??)
• 1 Trasferta per 2 persone in US (FNAL)
– Conferenze (GRID2008, eScience2008)
•
8k
4k
4k
totale
16k
EU project: RIO31844-OMII-EUROPE