Post on 01-May-2015
Servizio Centrale Informatica e Reti (Maggio-2003)
Ing. Silvio Migliori (migliori@enea.it)
Coordinatore Calcolo ScientificoENEA
INFRASTRUTTURA “GRID” PER IL CALCOLO
SCIENTIFICO in ENEA
Agenda
•Cenni sui concetti generali delle griglie computazionali
•Architettura dell'infrastruttura GRID ENEA
•Prossimi sviluppi per il SUD
•Esempi di funzionamento
Ing. Silvio MiglioriCoordinatore progetti calcolo scientifico in ENEA
Milano 7/5/2003
The Grid: The Web on Steroids
On-demand creation of powerful virtual computing systems
http://
http://
Web: Uniform access to HTML documents
Grid: Flexible, high-perf access to all significant resources
Sensor nets
Data archives
Computers
Softwarecatalogs
Colleagues
Ian Foster
Network Exponentials Network vs. computer performance
– Computer speed doubles every 18 months– Network speed doubles every 9 months– Difference = order of magnitude per 5 years
1986 to 2000– Computers: x 500– Networks: x 340,000
2001 to 2010– Computers: x 60– Networks: x 4000
Moore’s Law vs. storage improvements vs. optical improvements. Graph from Scientific American (Jan-2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins.
Ian Foster
Performance Extrapolation
N=1
N=500
Sum
1 GFlop/s
1 TFlop/s
1 PFlop/s
100 MFlop/s
100 GFlop/s
100 TFlop/s
10 GFlop/s
10 TFlop/s
10 PFlop/s
PFlop/scomputer
TFlop/sTo enter the list
Jac. Dongarra SC2002
Selected Major Grid ProjectsName URL & Sponsors Focus
Access Grid www.mcs.anl.gov/FL/accessgrid; DOE, NSF
Create & deploy group collaboration systems using commodity technologies
BlueGrid IBM Grid testbed linking IBM laboratories
DISCOM www.cs.sandia.gov/discomDOE Defense Programs
Create operational Grid providing access to resources at three U.S. DOE weapons laboratories
DOE Science Grid
sciencegrid.org
DOE Office of Science
Create operational Grid providing access to resources & applications at U.S. DOE science laboratories & partner universities
Earth System Grid (ESG)
earthsystemgrid.orgDOE Office of Science
Delivery and analysis of large climate model datasets for the climate research community
European Union (EU) DataGrid
eu-datagrid.org
European Union
Create & apply an operational grid for applications in high energy physics, environmental science, bioinformatics
g
g
g
g
g
g
New
New
Ian Foster
Selected Major Grid ProjectsName URL/Sponsor Focus
TeraGrid teragrid.org
NSF
U.S. science infrastructure linking four major resource sites at 40 Gb/s
UK Grid Support Center
grid-support.ac.uk
U.K. eScience
Support center for Grid projects within the U.K.
Unicore BMBFT Technologies for remote access to supercomputers
g
g
New
New
Also many technology R&D projects: e.g., Condor, NetSolve, Ninf, NWS
See also www.gridforum.org
Ian Foster
CitrixMetafra
me
CitrixNfuse
ICA
WEB(ICA)
power3.frascati.enea.it
boquad.frascati.enea.it
dafne.casaccia.enea.it
infocal.trisia.enea.it
8
622 Mbps
ENEAINFO
12017
0
NEW
Cray 39 Gflops
25 Gflops
Cluster Linux 50 Gflops
Software Conceptual StructureINFORMATICSINFORMATICS CENTRAL FUNCTIONS CENTRAL FUNCTIONS
ITALIAN NATIONAL AGENCY FOR NEW TECHNOLOGY ,ENERGY AND THE ENVIRONMENT
AFS Geographical cross platform& File System
AIX SGI SUN Compaq
NT Linux
Quadrics
…
Load Leveler LSF
Graphic User Interface
LSF multi-cluster as integrator
Telnet
User programs & commercial code
Portale Applicativo (Metaframe/Nfuse)
ICAWEB
Qu
alità
di serv
izio
Mon
itori
ng
di sis
tem
a e
d’u
tilizzo,
Recu
pero
e S
eg
nala
zio
ne A
uto
mati
co a
nom
alie,
pia
nifi
cazio
ne s
vilu
pp
o
New
Gestione generale di una specifica richiesta al sistema
InterfacciaGrafica
(RICHIESTA)LSF
Cluster Configuratio
n(STATICO)
Stato delle Risorse
(TEMPO REALE)
Politica delle code
(STATICO)•Accoda la richiesta
•Assegna la risorsa
•Lancia il comando sul calcolatore selezionato
DATI(SW/Prog.)
File Server
Client AFS
Cache locale
•Risolve la piattaforma•Verifica i diritti di accesso•Mantiene la coerenza dei dati
AFS
Data Base Server
Graphic environment under
AFS
ITALIAN NATIONAL AGENCY FOR NEW TECHNOLOGY ,ENERGY AND THE ENVIRONMENT
IBM SP
CATIA User(AIX)
FUS Project Users
UserInterferom
etriaOligrafia
Octane 2ProcBologna
Octane 2ProcCasaccia
Onyx3 4ProcFrascati
Cray
INFO Graphic Developers
UsersRobotica
Clu
ste
r Lin
ux A
lph
a
Onyx2 4ProcCasaccia
new
new
new
new
Simulazione RoboticaFig 2a
Visualizzazione Immersiva CR FrascatiVisualizzazione Immersiva CR Frascati
Visualizzazione Immersiva CR CasacciaVisualizzazione Immersiva CR Casaccia
Accesso WEB“Verticalizzazione” dell’accesso alle Applicazioni
ACCESSO AI SERVIZI DELLA CELLA afs fusione.enea.it
8
622 Mbps
ENEAINFO
Linux\Alpha100 Gflops
70
NEW
Cluster Linux 20 Gflops
Cray 32 Gflops
DataGrid at
ESA\ESRIN
GEANT
grid0007
ENEA GRID
GigaBit-Link
DB_2
DB_1
CPUS ENEA GRID
WEBICASSH
Integrazione Impianti e Calcolo
In fase di integrazioine
FTUMOVIE
Test Program “GOME”
ENEA-Geographic SUBMITION PROCEDURE
Input FilesLIV1
List of pathInput File
LIV1
IDL “GOME” Program
Output FileLIV2
.jpg Image
Input FileLIV1
List of pathInput File
LIV1
IDL Program“GOME”
Output FileLIV2
.jpg Image Input File
LIV1
List of pathInput FileLIV1
Case-1
Case_2
Case n
WEB
User afs/home
Por ti c
i
Brin
dis
i
Clus
ter
Clus
ter
Pote
nzia
men
to
New
8
622 Mbps
ENEAINFO
12017
0
NEW
Cray 39 Gflops
25 Gflops
Cluster Linux 50 Gflops
Brindisi
Portici Potenziamento
Web di GraficaWeb di Grafica
http://onyx2ced.frascati.enea.it/grafica/
ITALIAN NATIONAL AGENCYFOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
RESEARCH AND TECHNOLOGY
AT THE NATION’S SERVICE