Tecnologia dei Servizi Grid e cloud computing - Lezione 001a 0 Lezione 1a - 13 ottobre 2009 Il...

Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 1

Lezione 1a - 13 ottobre 2009

Il materiale didattico usato in questo corso è stato mutuato da quello utilizzato da Paolo Veronesi per il corso di Griglie Computazionali per la Laurea Specialistica in Informatica tenuto nell’anno accademico 2008/09 presso l’Università degli Studi di Ferrara.

Paolo [email protected], [email protected]://www.cnaf.infn.it/~pveronesi/unife/

Università degli Studi di Bari – Corso di Laurea Specialistica in Informatica

“Tecnologia dei Servizi “Grid e cloud computing” A.A. 2009/2010

Giorgio Pietro Maggi [email protected], http://www.ba.infn.it/~maggi


The technological “offer”


Computing and Communication Technologies Evolution: 1960-2010!

* Sputnik

1960 1970 1975 1980 1985 1990 1995 2000

* ARPANET

* Email* Ethernet

* TCP/IP* IETF

* Internet Era * WWW Era

* Mosaic

* XML

* PC Clusters* Crays * MPPs

* Mainframes

* HTML

* W3C

* P2P

* Grids

* XEROX PARC worm

COMPUTING

Communication

* Web Services

* Minicomputers * PCs

* WS Clusters

* PDAs* Workstations

* HTC

2010

* e-Science

Computing as Utility

* e-Business

* SocialNets

ControlCentralised Decentralised


Performance, Capability, Value of ICT asdefined by the three Laws of Computing

Moore’s Law. Transistors on a

single chip doubles ~ every 18 months.

Gilder’s Law. Aggregate bandwidth

triples ~ every year. Metcalfe’s Law.

The value of a network may grow exponentially with the number of participants.

Source: Cambridge Energy Resource Associates


“Increase” of network technologies Network vs. Computer perfomances

Computer speed doubles every 18 months Data storage density doubles every 12 months Network speed doubles every 9 months

1986 → 2000 Computers: x500 Networks: x 340,000

2001 → 2010 Computers: x60 Networks: x4,000

Scientific American (Jan-2001) by Cleo Vilett, source VinedKhoslan, Kleiner, Caufieldand Perkins


Entry Price-Points For HPC Has Dropped

Sample System

Performance

Price

Customers

Cray Y-MP C916 Sun HPC10000 [email protected]

~10 GFlops ~10 GFlops ~10 GFlops

$40,000,000 $1,000,000(40x drop)

$4,000 (250x drop)

Government Labs Large Enterprises Every Engineer and Scientist

1991 1998 2005


Distributed Memory Becoming The Norm

Clusters over 70%


COTS Components Gaining Ground

GigaE is gaining (50% of systems)

x86 is leading (Pentium 41%, EM64T

16%, Opteron 11%


The GÉANT2 network and the rest of the world

USA

Latin America

Asia

South-East Europe

Mediterranean Area

Pan-European coverage (40+ countries/3900 Universities/30+ millions of students) Hybryd architecture:

Connectivity at 10 Gbps Dark fiber wavelengths


The “global” network

Corso Introduttivo di Grid Computing, Catania, 25.03.2008

10


The Grid: networked data processing centres and ”middleware” software as the “glue” of resources.

Researchers perform their activities regardless geographical location, interact with colleagues, share and access data

Scientific instruments and experiments provide huge amount of data

The Grid Vision for e-Science

Grids are both a “dream” and a tool for realizing even larger “dreams”.

(http://access.ncsa.uiuc.edu/witg/)


eScience Science is becoming increasingly digital, needs to deal with increasing amounts

of data and computational needs

Simulations get ever more detailed Nanotechnology – design of new materials from

the molecular scale Modelling and predicting complex systems

(weather forecasting, river floods, earthquake) Decoding the human genome

Experimental Science uses ever moresophisticated sensors to make precisemeasurements Need high statistics Huge amounts of data Serves user communities around the world


Definitions e-Sciencee-Science is used to describe computationally intensive science that is carried

out in highly distributed network environments, or science that uses immense data sets that require grid computing; the term sometimes includes technologies that enable distributed collaboration

(The term was created by John Taylor, the Director General of the United Kingdom's Office of Science and Technology in 1999 and was used to describe a large funding initiative starting in November 2000)

e-Researche-Research extends e-Science and e-Infrastructure to all sciences and denotes the use of Information Technology to support existing and new forms of research.

The main features are : Collaborative; uses GRID technologies; data intensive;

and the adoption in research activities of a spectrum of advanced Information and Communication Technology (ICT) capabilities. It embraces new research methodologies emerging from increasing access to: Networks; Services; Tools.


e-Knowledge


La strategia di Lisbona

È stata definita dall’Agenda Sociale Europea nei Consigli Europei di Lisbona (2000), Nizza (2000), Göteborg (2001), Barcellona (2002) e Bruxelles (2005);

Obiettivo qualitativo: Trasformare l'Unione Europea, entro il 2010, “nell’economia basata

sulla conoscenza più competitiva e dinamica del mondo, in grado di realizzare una crescita economica sostenibile con nuovi e migliori posti di lavoro e una maggiore coesione sociale“;

Obiettivi quantitativi (da raggiungere entro il 2010): Un tasso di crescita economica pari al 3%; Un tasso di occupazione del 70%; Un tasso di partecipazione della forza femminile al lavoro pari al

60%.


The European Research Area

Network infrastructure(GÉANT2)

Op

erat

ion

s,

Su

pp

ort

an

d

trai

nin

g

Collaboration

Pan-European Grid


REL-PROJ'sEGEE Related projects co-vering several regions of the world

GÉANT .

INFRASTRUCTURE

GRID .

INFRASTRUCTURE

EGEE

Production quality Grid, HEP, Biomed..., int. links (67M€ – CERN)

GÉANTPan-European Research Network,3900 inst., 30+ million users, 40+ countries(~100 M€ - DANTE)

DEISA

Grid of EU supercomputers networked at Gbps, focus on global filing systems,>40 Tflop/s, several user communities(15M€ - CNRS) .

L’e-Infrastruttura Europea oggi

300 M€ in FP64 G€ in FP7 !


Summary of How e-Infrastructures help e-Science

e-Infrastructures provide easier access for Geographically distributed researchers Small research groups Scientists from many different fields Remote and still developing countries

To new technologies Produce and store massive amounts

of data Transparent access to millions of files

across different administrative domains Low cost access to resources

Mobilise large amounts of CPU & storage on short notice (PC clusters)

High-end facilities (supercomputers)

And help to find new ways to collaborate Develops applications using distributed

complex workflows Eases distributed collaborations Provides new ways of community building Gives easier access to higher education

NETWORK .

INFRASTRUCTURE

GRID .

INFRASTRUCTURE

KNOWLEDGE .

INFRASTRUCTURE


Evolution

European e-Infrastructure

Testbeds Utility ServiceRoutine Usage

National

Global


21

Slide courtesy of Kyriakos Baxevanidis, EC

Broad scale test-beds

Production quality facilities

Sustainable grid/data-based e-Infrastructures (utility model)

Towards sustainable e-Infrastructures


Le opportunità future in Europa: l’FP7

http://cordis.europa.eu/fp7/ict/e-infrastructure/projects_en.html

>100 M€ già spesi

> 100 M€ disponibili in call aperte

Per informazioni sulle call aperte:

http://cordis.europa.eu/fp7/dc/index.cfm


Le opportunità future in Italia: il PON 2007-2013

Il PON 2007-2013 “Ricerca e Competitività” ha l’obiettivo di cofinanziare progetti nei campi della ricerca scientifica, dello sviluppo tecnologico, della competitività e dell’innovazione industriale nel periodo di programmazione 2007-2013.

Il PON 2007-2013 si articolerà su 3 Assi prioritari: Asse I: Sostegno ai mutamenti strutturali Asse II: Sostegno all’innovazione Asse III: Assistenza tecnica e attività di accompagnamento

Le azioni dell’Asse I e dell’Asse II saranno tra loro fortemente correlate ed interdipendenti


Alessandro Volta in Paris in 1801 at the French National Institute shows the battery while in the presence of Napoleon I

Fresco by N. Cianfanelli (1841) (Zoological Section "La Specula" of National History Museum of Florence University)


….and in the future, I imagine a WorldwidePower (Electrical) Grid …...

What ?!?!This is a mad man…

Oh, monDieu !


2008 - 1801 = 207 years(Recent R&D: Delivering Internet services via Electric cables).


4 Essential Utilities and Delivery Networks

(2) WaterWater

Distribution Network

(4) TelephoneTelecom Networks

(3) Gas

(1) ElectricityPower Grid


A citation …

(The father of “ubiquitous computing”)

Telephone, Light bulb, Telegraph, Radio, TV, Computer, Network, PC, Web, …(in the same order as they were invented)

Tecnologia dei Servizi Grid e cloud computing - Lezione 001a 0 Lezione 1a - 13 ottobre 2009 Il...

Documents

Transcript of Tecnologia dei Servizi Grid e cloud computing - Lezione 001a 0 Lezione 1a - 13 ottobre 2009 Il...