Dino Pedreschi

KDD LABUniversità di Pisa e ISTI-CNR

http://kdd.isti.cnr.it

Forum PA – Roma 27 maggio 2014

BIG DATA ANALYTICS & SOCIAL MINING

SIAMO TUTTI POLLICINI DIGITALI

La Vita Nova, e-magazine de Il Sole 24 OreFosca Giannotti, Dino Pedreschi

Shopping patterns & lifestyle

Desires, opinions, sentiments

Relationships & social ties

Movements

Big data “proxies” of social life

27 ottobre 2014Analisi di Reti Sociali. Aprile-Maggio 20118

UNDERSTANDINGHUMAN MOBILITYPartner: Octo Telematics, PA

A12 SudCascina

Marina di Pisa/TirreniaLucca

Individual Routines

Work‐Home

Home‐Work

Collective systematic patterns

http://kdd.isti.cnr.it/uma Urban Mobility Atlas

PROACTIVE CARPOOLINGPartner: Octo Telematics, PA

Car Pooling

Carpooling Network

Carpooling Communities

Trajectory matching

Carpooling potentialPISA

16467 users, 357137 trips

20% systematic trips

40% matching trips

142.740.060 saved Kms

FLORENCE

34864 users, 1040872 trips

9% systematic trips

58% matching trips

220.802.240 saved Kms

ELECTRIFIABILITY

Partner: Octo, PA

Electrifiability

90.5% of daily trips are electrifiable

In Tuscany 66% of users have a dailymobility 100% covered by an electrical vehicle(home to home)

Electrifiability index

90%

10%

Pisa

Yes No

85%

15%

Livorno

Yes No

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

dim. 1

mar. 3

jeu. 5

sam. 7

lun. 9

mer. 11

ven. 13

dim. 15

mar. 17

jeu. 19

sam. 21

lun. 23

mer. 25

ven. 27

dim. 29

mar. 31

Firenze

Yes No

CITY USERS’ SOCIOMETER

Partner: Telecomunicazioni, PA, ISTAT

Dimmi come chiami…ti dirò chi sei!

A

Residente

B

Pendolare

A

A

B

Visitore

Anonimizzazione

City User Sociometer

Chiamate

Mappa dei profili

Analisi di data mining

Pendolari

Visitatori/Turisti

ResidentiProfilo aggregato

userIDCellSta

rtIDCellEn

dIDTimestampStart TimestampEnd

109259401503

PI010U2

PI010U2

2012-01-19 18:37:15+01

2012-01-19 18:38:07+01

109259401503

PI002U2

PI002U2

2012-01-19 18:46:33+01

2012-01-19 18:46:44+01

109259401503

PI002U2

PI002U2

2012-01-19 18:53:10+01

2012-01-19 18:53:33+01

109263991410

PI034U1

PI034U1

2012-01-18 13:59:20+01

2012-01-18 14:02:33+01

109269325201

PI023U1

PI023U1

2012-01-24 11:03:21+01

2012-01-24 11:04:56+01

Urban Sociometer: the city user meter

Pisa january 2012

ISTAT – Commissione Big Data

Measuring urban population and inter-city mobility using big data in an integratedapproach

Barbara Furletti, Lorenzo Gabrielli, Giuseppe Garofalo, Fosca Giannotti, Letizia Milli, Mirco Nanni, Dino Pedreschi, Roberta Vivio

KDD LAB – Univ. Pisa & ISTI CNR, ISTAT SIS 2014 – 47° Simposio Italiano di Statistica

MP4-A Project: Mobility Planning For Africa

A joint work of &

kdd.isti.cnr.it www.goudappel.nl

Mirco Nanni, Roberto Trasarti, et al.: MP4-A Project: Mobility Planning for Africa. “Data for Development” Orange challenge, 2013

Mirco Nanni, Roberto Trasarti, et al.: MP4-A Project: Mobility Planning for Africa. “Data for Development” Orange challenge, 2013

Measuring exceptional events

0

0,01

0,02

0,03

0,04

0,05

0,06

0,07

0,08

Giovedi Venerdi Sabato Domenica

Presenze

Presence of Visitors GSM - Pisa - Historical Center

Presenze Internet Festival Presenza media settimanale

00,050,1

0,150,2

0,250,3

0,350,4

0,45

Giovedi Venerdi Sabato Domenica

Presenze

Presence of Visitors GSM - Lucca Comics 2012

Presenze Comics 2012 Presenza media settimanale

Extraordinary events

DIVERSITY & WELL‐BEING

Partner: Octo, WIND, Orange Telecom

MOBILITY BORDERS

big data | public good

“Personal data is the new oil of the Internet and the new currency of the digital world”Maglena Kuneva, former European

Commissioner of Consumer Protection

Who’s got the big benefits so far?

A few latifundists of data GAFA

Profiling for behavioral advertising and target marketing

NSA

Profiling for discovering potential terroristsMass surveillance … STASI_2.0

EUROPEAN WAY TO BIG DATA

PRIVACY-BY-DESIGN

NEW DEAL ON DATA

Privacy-by-Design in Data Analytics

Anonymization

Service ProviderMining and 

Analytical Engine

Anonymization is not trivial

De‐identification is not enough

Anonimizzazione

City User Sociometer with Privacy-by-design

Chiamate

Mappa dei profili

Analisi di data mining

Pendolari

Visitatori/Turisti

ResidentiProfilo aggregato

userIDCellSta

rtIDCellEn

dIDTimestampStart TimestampEnd

109259401503

PI010U2

PI010U2

2012-01-19 18:37:15+01

2012-01-19 18:38:07+01

109259401503

PI002U2

PI002U2

2012-01-19 18:46:33+01

2012-01-19 18:46:44+01

109259401503

PI002U2

PI002U2

2012-01-19 18:53:10+01

2012-01-19 18:53:33+01

109263991410

PI034U1

PI034U1

2012-01-18 13:59:20+01

2012-01-18 14:02:33+01

109269325201

PI023U1

PI023U1

2012-01-24 11:03:21+01

2012-01-24 11:04:56+01

A NEW DEAL ON PERSONAL DATA

DEMOCRATIZING BIG DATA

A user-centric ecosystem for Big Data

Engage people in the creation and use of big data and knowledge, by empowering individuals with self-knowledge

Incentivize individual to participate, to align ownself-interest with broader societal goals

Based on transparency, trust & privacy

Collective KnowledgeCollective

Knowledge

Personal data store

for self knowledge

Personal data store

for self knowledge

Individual profiles

Collective patterns

Conoscenzadi seSelf‐awarenessNovel 

Indicators

Conoscenza individuale e conoscenza collettiva

Social mining of individual histories

Mobility DataMobility Data

Mobility DataMobility Data

Mobility DataMobility Data

Mobility DataTraditional DB

sources

Social mining of many individuals

Key publications F Giannotti, M Nanni, F Pinelli, D Pedreschi. Trajectory pattern mining. ACM SIGKDD

2007 F Giannotti, D Pedreschi. Mobility, data mining and privacy: Geographic knowledge

discovery. Springer, 2008 A Monreale, F Pinelli, R Trasarti, F Giannotti. WhereNext: a location predictor on

trajectory pattern mining. ACM SIGKDD 2009 S Rinzivillo, D Pedreschi, M Nanni, F Giannotti, N Andrienko, G Andrienko. Visually

driven analysis of movement data by progressive clustering. Information Visualization7 (3-4), 225-239. 2008

D Wang, D Pedreschi, C Song, F Giannotti, AL Barabasi. Human mobility, social ties, and link prediction. ACM SIGKDD 2011

F Giannotti, M Nanni, D Pedreschi, F Pinelli, C Renso, S Rinzivillo, R Trasarti. Unveilingthe complexity of human mobility by querying and mining massive trajectory data. The VLDB 20(5) 2011

R Trasarti, F Pinelli, M Nanni, F Giannotti. Mining mobility user profiles for car pooling. ACM SIGKDD 2011

Key publications M Coscia, G Rossetti, F Giannotti, D Pedreschi. Demon: a local-first

discovery method for overlapping communities. ACM SIGKDD 2012 S Rinzivillo, S Mainardi, F Pezzoni, M Coscia, D Pedreschi, F

Giannotti. Discovering the geographical borders of human mobility. KI-Künstliche Intelligenz 26 (3) 2012

D Pennacchioli, M Coscia, S Rinzivillo, D Pedreschi, F Giannotti. Explaining the Product Range Effect in Purchase Data. IEEE BIGDATA 2013

B Furletti, L Gabrielli, C Renso, S Rinzivillo. Analysis of GSM Calls Data for Understanding User Mobility Behavior. IEEE BIG DATA 2013

L Milli, A Monreale, G Rossetti, D Pedreschi, F Giannotti, F Sebastiani. Quantification trees. IEEE ICDM 2013

Vision papers

F Giannotti, D Pedreschi, A Pentland, P Lukowicz, D Kossmann, J Crowley, D Helbing. A planetary nervous system for social mining and collective awareness. The European Physical Journal Special Topics 214 (1), 49‐75, 2012

J van den Hoven, D Helbing, D Pedreschi, J Domingo‐Ferrer, F Giannotti . FuturICT—The road towards ethical ICT. The European Physical Journal Special Topics 214 (1), 153‐181, 2012

M Batty, KW Axhausen, F Giannotti, A Pozdnoukhov, A Bazzani, M Wachowicz. Smart cities of the future. The European Physical Journal Special Topics 214 (1), 481‐518, 2012

Special thanks to …

Fosca Giannotti, co‐lead of KDD LAB Fosca.giannotti@isti.cnr.it

Salvo Rinzivillo, Mirco Nanni, Roberto Trasarti, Salvatore Ruggieri, Chiara Renso, Anna Monreale, Franco Turini

all the fantastic folks at KDD LAB Pisa many international collaborators

Knowledge Discovery & Data Mining Laboratory | kdd.isti.cnr.it