HPC per IA e BIG DATACLOUD HPC 112 nodi Intel BDW 2x18 cores, 2.3 GHz 128 GB RAM/CN Ethernet 25 Gbit...
15
HPC 4 IA e BD - Eric Pascolo June 2020 1 [email protected] HPC PoC Group HPC per IA e BIG DATA Infrastruttura e tecnologie
Transcript of HPC per IA e BIG DATACLOUD HPC 112 nodi Intel BDW 2x18 cores, 2.3 GHz 128 GB RAM/CN Ethernet 25 Gbit...
HPC 4 IA e BD - Eric PascoloJune 2020 1
[email protected] PoC Group
HPC per IA e BIG DATAInfrastruttura e tecnologie
June 2020 HPC 4 IA e BD - Eric Pascolo
Consorzio privato a controllo pubblico:
• 3 policlinici universitari • 9 Enti pubblici di Ricerca• 67 Atenei• MIUR
2
Attività principali:•Supercalcolo • Supporto al Miur• Supporto agli Atenei•Trasferimento Tecnologico
I nostri numeri:100M€ volume di affari
19° nella top 500700 dipendenti
HPC a Bologna,Milano,Roma
June 2020 HPC 4 IA e BD - Eric Pascolo
-Supercalcolo per la ricerca-Supporto alla competitività industriale nazionale-Visualizzazione per le Digital Humanities
HPC@
3
June 2020 HPC 4 IA e BD - Eric Pascolo
Necessità di un calcolatore.. ma quale?
4
Dimensione del problema -> # incognite
10 100 000 > 1 000 000
June 2020 HPC 4 IA e BD - Eric Pascolo
HPC@
5
Italia:Marconi
Francia:Courie
Spagna: MareNostrum
Svizzera:Piz Daint
Germania: HazelHen,Juqueen,SuperMUC
June 2020 HPC 4 IA e BD - Eric Pascolo
GALILEO 2000 nodi Intel BDW 2x18 cores, 2.3 GHz 128 GB RAM/CN 36 nodi Intel HSW 2x8 cores, 2.4 GHz 2 NVIDIA K80 GPUS 128 GB RAM/CN Intel Omnipath
Marconi100 980 nodi IBM POWER 9 2x16 cores (HT 8) 4 NVIDIA Volta V100 256 GB RAM/CN Mellanox EDR
CLOUD HPC 112 nodi Intel BDW 2x18 cores, 2.3 GHz 128 GB RAM/CN Ethernet 25 Gbit
Marconi 3188 nodi Intel SKL 2x24 cores, 2.1 GHz 192 GB RAM/CN Intel Omnipath
MEUCCI 104 nodi Intel BDW 2x18 cores, 2.3 GHz 128 GB RAM/CN Ethernet 25 Gbit
June 2020 HPC 4 IA e BD - Eric Pascolo
Exascale race
8
1 000 000 000 000 000 000 FLOPS
2021
2021
2022
2023
June 2020 HPC 4 IA e BD - Eric Pascolo 9
2023 Exascale system installed (EPI tech)2021 EPI Gen1 for HPC e automotive2020 Pre-exascale systems (Leonardo in italy)2019 European Processor Initiative calls (EPI)2018 Joint Undertaking EuroHPC (budget 1B€)
3 pre-exascale machines5 peta-scale machines
HPC Competence center for Industry
Training and Outreach
Centre of Excellence for HPC application
European exascale technologies (EPI)
June 2020 HPC 4 IA e BD - Eric Pascolo 10
Booster3500 nodes4GPU x node
General Purpose1000 nodes
High core count
Data Centric500 nodesLarge mem
- 8MW hot-water DLC - 2MW Air cooled ~1000 m^2
Storage150 PB1 TB/s
Network200 Gb/s
HPL 180 PFlopsHPCG 3.3 PFlops
June 2020 HPC 4 IA e BD - Eric Pascolo
HPC@
1111
June 2020 HPC 4 IA e BD - Eric Pascolo 12
SupercomputerCPU_1
MEM
CPU_0
0GPU_0 GPU_1
NETW
ORK 4
5
6
3
2
1switchMASTER NODE
// F
ILES
YSTE
MINTERNET
SCHEDULERLOGIN NODE 2
I/O NODE
LOGIN NODE 1
June 2020 HPC 4 IA e BD - Eric Pascolo
CPU vs GPU
13
CU
CACHE
ALU
DRAM
June 2020 HPC 4 IA e BD - Eric Pascolo
Cloud
14
NETWORKING
STORAGE
SERVERS
VIRTUALIZATION
OS
MIDDLEWARE
RUNTIME
DATA
APPLICATION
IT
NETWORKING
STORAGE
SERVERS
VIRTUALIZATION
OS
MIDDLEWARE
RUNTIME
DATA
APPLICATION
Infrastructure
NETWORKING
STORAGE
SERVERS
VIRTUALIZATION
OS
MIDDLEWARE
RUNTIME
DATA
APPLICATION
Platform
NETWORKING
STORAGE
SERVERS
VIRTUALIZATION
OS
MIDDLEWARE
RUNTIME
DATA
APPLICATION
Service
Da gestire Fornito come Servizio
June 2020 HPC 4 IA e BD - Eric Pascolo
Container
15
PHYSICAL HARDWARE LAYER
LINUX KERNEL
ROOT FILE SYSTEM
APP VIRTUAL HD LAYERLINUX KERNEL
ROOT FILE SYSTEM
HYPERVISORAPP
APP APP
APP APP APP
VIRTUAL
PHYSICAL HARDWARE LAYER
LINUX KERNEL
ROOT FILE
APPSI
NGUL
ARIT
YAPP
APP APP
IMG ROOT FS
APP APP
APP APP
SINGULARITY
