BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia...

70
2/28/2012 1 BioIngegneria e BioRobotica: l’ingegneria al servizio della vita Paolo Dario Direttore Istituto di BioRobotica Studiare ingegneria alla Scuola Superiore Sant’Anna Giornata di orientamento, 4 febbraio 2012, San Miniato (PISA) Etimologia del termine “robot” Il termine robot fu usato per la prima volta dallo scrittore ceco Karel Čapek , nel 1920 nel suo romanzo R.U.R. (Rossum's Universal Robots) . Deriva dal termine ceco robota, che significa "lavoro pesante" o "lavoro forzato". In realtà il vero inventore della parola robot fu il fratello di Karl Čapek, Josef, anche lui scrittore e pittore cubista, il quale utilizzò la parola “automat”, (automa), in un suo racconto del 1917, Opilec (“L'ubriacone”). Il termine greco autòmaton significa “che si muove da sé”. La Robotica

Transcript of BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia...

Page 1: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

1

BioIngegneria e BioRobotica lrsquoingegneria al servizio della vita Paolo Dario

Direttore

Istituto di BioRobotica

Studiare ingegneria alla Scuola Superiore SantrsquoAnna Giornata di orientamento 4 febbraio 2012 San Miniato (PISA)

Etimologia del termine ldquorobotrdquo

Il termine robot fu usato per la prima volta dallo scrittore ceco Karel Čapek nel 1920 nel suo romanzo RUR (Rossums Universal Robots) Deriva dal termine ceco robota che significa lavoro pesante o lavoro forzato In realtagrave il vero inventore della parola robot fu il fratello di Karl Čapek Josef anche lui scrittore e pittore cubista il quale utilizzograve la parola ldquoautomatrdquo (automa) in un suo racconto del 1917 Opilec (ldquoLubriaconerdquo) Il termine greco autogravematon significa ldquoche si muove da seacuterdquo

La Robotica

2282012

2

Etimologia del termine ldquoroboticardquo Il termine robotica venne usato per la prima volta (su carta stampata) nel racconto di Isaac Asimov intitolato Circolo vizioso (Runaround 1942) presente nella sua famosa raccolta Io Robot

In esso egli citava le tre

regole della robotica che in seguito divennero le Tre leggi della robotica

La Robotica

First edition cover

December 2 1950

Le tre leggi della robotica di Asimov

Un robot non puograve recare danno a un essere umano neacute puograve permettere che a causa del suo mancato intervento un essere umano riceva danno

Un robot deve obbedire agli ordini impartiti dagli esseri umani purcheacute tali ordini non contravvengano alla Prima Legge

Un robot deve proteggere la propria esistenza purcheacute questa autodifesa non contrasti con la Prima e la Seconda Legge

2282012

3

Definizioni di Robotica

A robot is a re-programmable multi-functional manipulator designed to move material parts or specialized devices through variable programmed motions for the performance of a task

Un robot egrave un manipolatore multifunzionale

riprogrammabile progettato per muovere materiali componenti o dispositivi specializzati attraverso movimenti variabili programmati per lo svolgimento del compito

Robotics Industry Association (~ 1980)

Jablonsky J Posey J 1985 ldquoRobotics Terminologyrdquo in Handbook of Industrial Robotics ed S Nof J Wiley New

York pp1271-1303

Joseph Engelberger Ingegnere Isaac Asimov

Scrittore

Le origini della

robotica moderna

UNIMATE Il primo robot

industriale Nel 1960 il primo robot industriale fu installato presso un

impianto produttivo General Motors in New Jersey (USA)

2282012

4

Isaac Asimov e Joseph Engelberger

Dalla robotica industriale alla robotica di servizio

Robotica di servizio

Esplorazioni spaziali Esplorazioni sottomarine

Applicazioni domestiche

Igiene urbana e monitoraggio ambientale

Applicazioni militari

2282012

5

January 2007

I robot fuori dalle fabbrichehellip

Condivisione dello spazio di lavoro tra persone e robot

Maggiori capacitagrave percettive

Comportamento reattivo

Servizi

Ambienti ostili

Photo Center for Robot-Assisted Search and Rescue

2282012

6

La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM

Il computer che ha battuto il campione di scacchi Kasparov

Paradigma ldquoMeccatronicordquo per la progettazione di

macchine

Meccanismo

Spazio di lavoro

Interfaccia

uomo-macchina

Attuatori

Energia

Operatore

Controllo

Sensori

Progettazione meccatronica integrata

Avvento della microelettronica cambio

di paradigma

Telecamera digitale

Boeing 777

Ferrari - 550 Maranello

Lavatrice

Meccatronica il paradigma per la progettazione di robot

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 2: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

2

Etimologia del termine ldquoroboticardquo Il termine robotica venne usato per la prima volta (su carta stampata) nel racconto di Isaac Asimov intitolato Circolo vizioso (Runaround 1942) presente nella sua famosa raccolta Io Robot

In esso egli citava le tre

regole della robotica che in seguito divennero le Tre leggi della robotica

La Robotica

First edition cover

December 2 1950

Le tre leggi della robotica di Asimov

Un robot non puograve recare danno a un essere umano neacute puograve permettere che a causa del suo mancato intervento un essere umano riceva danno

Un robot deve obbedire agli ordini impartiti dagli esseri umani purcheacute tali ordini non contravvengano alla Prima Legge

Un robot deve proteggere la propria esistenza purcheacute questa autodifesa non contrasti con la Prima e la Seconda Legge

2282012

3

Definizioni di Robotica

A robot is a re-programmable multi-functional manipulator designed to move material parts or specialized devices through variable programmed motions for the performance of a task

Un robot egrave un manipolatore multifunzionale

riprogrammabile progettato per muovere materiali componenti o dispositivi specializzati attraverso movimenti variabili programmati per lo svolgimento del compito

Robotics Industry Association (~ 1980)

Jablonsky J Posey J 1985 ldquoRobotics Terminologyrdquo in Handbook of Industrial Robotics ed S Nof J Wiley New

York pp1271-1303

Joseph Engelberger Ingegnere Isaac Asimov

Scrittore

Le origini della

robotica moderna

UNIMATE Il primo robot

industriale Nel 1960 il primo robot industriale fu installato presso un

impianto produttivo General Motors in New Jersey (USA)

2282012

4

Isaac Asimov e Joseph Engelberger

Dalla robotica industriale alla robotica di servizio

Robotica di servizio

Esplorazioni spaziali Esplorazioni sottomarine

Applicazioni domestiche

Igiene urbana e monitoraggio ambientale

Applicazioni militari

2282012

5

January 2007

I robot fuori dalle fabbrichehellip

Condivisione dello spazio di lavoro tra persone e robot

Maggiori capacitagrave percettive

Comportamento reattivo

Servizi

Ambienti ostili

Photo Center for Robot-Assisted Search and Rescue

2282012

6

La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM

Il computer che ha battuto il campione di scacchi Kasparov

Paradigma ldquoMeccatronicordquo per la progettazione di

macchine

Meccanismo

Spazio di lavoro

Interfaccia

uomo-macchina

Attuatori

Energia

Operatore

Controllo

Sensori

Progettazione meccatronica integrata

Avvento della microelettronica cambio

di paradigma

Telecamera digitale

Boeing 777

Ferrari - 550 Maranello

Lavatrice

Meccatronica il paradigma per la progettazione di robot

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 3: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

3

Definizioni di Robotica

A robot is a re-programmable multi-functional manipulator designed to move material parts or specialized devices through variable programmed motions for the performance of a task

Un robot egrave un manipolatore multifunzionale

riprogrammabile progettato per muovere materiali componenti o dispositivi specializzati attraverso movimenti variabili programmati per lo svolgimento del compito

Robotics Industry Association (~ 1980)

Jablonsky J Posey J 1985 ldquoRobotics Terminologyrdquo in Handbook of Industrial Robotics ed S Nof J Wiley New

York pp1271-1303

Joseph Engelberger Ingegnere Isaac Asimov

Scrittore

Le origini della

robotica moderna

UNIMATE Il primo robot

industriale Nel 1960 il primo robot industriale fu installato presso un

impianto produttivo General Motors in New Jersey (USA)

2282012

4

Isaac Asimov e Joseph Engelberger

Dalla robotica industriale alla robotica di servizio

Robotica di servizio

Esplorazioni spaziali Esplorazioni sottomarine

Applicazioni domestiche

Igiene urbana e monitoraggio ambientale

Applicazioni militari

2282012

5

January 2007

I robot fuori dalle fabbrichehellip

Condivisione dello spazio di lavoro tra persone e robot

Maggiori capacitagrave percettive

Comportamento reattivo

Servizi

Ambienti ostili

Photo Center for Robot-Assisted Search and Rescue

2282012

6

La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM

Il computer che ha battuto il campione di scacchi Kasparov

Paradigma ldquoMeccatronicordquo per la progettazione di

macchine

Meccanismo

Spazio di lavoro

Interfaccia

uomo-macchina

Attuatori

Energia

Operatore

Controllo

Sensori

Progettazione meccatronica integrata

Avvento della microelettronica cambio

di paradigma

Telecamera digitale

Boeing 777

Ferrari - 550 Maranello

Lavatrice

Meccatronica il paradigma per la progettazione di robot

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 4: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

4

Isaac Asimov e Joseph Engelberger

Dalla robotica industriale alla robotica di servizio

Robotica di servizio

Esplorazioni spaziali Esplorazioni sottomarine

Applicazioni domestiche

Igiene urbana e monitoraggio ambientale

Applicazioni militari

2282012

5

January 2007

I robot fuori dalle fabbrichehellip

Condivisione dello spazio di lavoro tra persone e robot

Maggiori capacitagrave percettive

Comportamento reattivo

Servizi

Ambienti ostili

Photo Center for Robot-Assisted Search and Rescue

2282012

6

La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM

Il computer che ha battuto il campione di scacchi Kasparov

Paradigma ldquoMeccatronicordquo per la progettazione di

macchine

Meccanismo

Spazio di lavoro

Interfaccia

uomo-macchina

Attuatori

Energia

Operatore

Controllo

Sensori

Progettazione meccatronica integrata

Avvento della microelettronica cambio

di paradigma

Telecamera digitale

Boeing 777

Ferrari - 550 Maranello

Lavatrice

Meccatronica il paradigma per la progettazione di robot

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 5: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

5

January 2007

I robot fuori dalle fabbrichehellip

Condivisione dello spazio di lavoro tra persone e robot

Maggiori capacitagrave percettive

Comportamento reattivo

Servizi

Ambienti ostili

Photo Center for Robot-Assisted Search and Rescue

2282012

6

La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM

Il computer che ha battuto il campione di scacchi Kasparov

Paradigma ldquoMeccatronicordquo per la progettazione di

macchine

Meccanismo

Spazio di lavoro

Interfaccia

uomo-macchina

Attuatori

Energia

Operatore

Controllo

Sensori

Progettazione meccatronica integrata

Avvento della microelettronica cambio

di paradigma

Telecamera digitale

Boeing 777

Ferrari - 550 Maranello

Lavatrice

Meccatronica il paradigma per la progettazione di robot

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 6: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

6

La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM

Il computer che ha battuto il campione di scacchi Kasparov

Paradigma ldquoMeccatronicordquo per la progettazione di

macchine

Meccanismo

Spazio di lavoro

Interfaccia

uomo-macchina

Attuatori

Energia

Operatore

Controllo

Sensori

Progettazione meccatronica integrata

Avvento della microelettronica cambio

di paradigma

Telecamera digitale

Boeing 777

Ferrari - 550 Maranello

Lavatrice

Meccatronica il paradigma per la progettazione di robot

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 7: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

7

Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema

Progettazione biomeccatronica

Mechanism

Workspace

Human-machine interface

Actuators

Energy Supply

Operator

Control

Sensors

Integrated mechatronic design

Biorobotics Science and Engineering

Biorobotics Science using robotics to discover new pricipleshellip

Biorobotics Engineering using robotics to invent new solutionshellip

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 8: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

8

Biorobotica intersezione tra biologia e robotica

BIOLOGIA ROBOTICA BIO

ROBOTICA

Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla

progettazione ed alla realizzazione di sistemi robotici di

ispirazione biologica

A methodology for Biorobotics biomechatronic design

Engineering analysis and modeling

Development of a physical model

Bio-mimetic robot

Biological system

Bio-inspired robot

Validation

Applications

Development of a biomedical robot

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 9: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

9

I

O

I

O

HYPOTHESIS AND MODEL

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

Gripforce

Loadforce

Movement

Biorobotics vs simulations and animal models

Interaction

Human model

Model of

interaction

World model

World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 10: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

10

I

O

I

O

HYPOTHESIS AND MODEL

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED

IMPLEMENTATION IN A ROBOT

Gripforce

Loadforce

Movement

G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic

Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58

HYPOTHESIS AND MODEL (comparison between

numerical results and interpolated experimental data

of living oligochaeta)

Validation of the model

EXPERIMENT Comparison between robot and biological system performance

Biorobotics Science

PHENOMENON TO BE

EXPLAINED (combination of

friction and segment number for effective

locomotion)

IMPLEMENTATION IN A ROBOT

A Menciassi and P Dario Philos

Transact Roy Soc A Math Phys

Eng 2003

D Accoto P Castrataro P Dario

J Theor Biology 2004

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 11: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

11

Biorobotics epistemology

Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)

Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory

Cybernetics (Rosenblueth Wiener Bigelow 1943)

Unified approach to the study of living organisms and machines

Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)

Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses

Machines are used for SCIENCE

Robotics for Biology - This approach can be used for

Corroborationfalsification

hellip if the artificial and the robotic system behave in the

samedifferent way under the same external and internal

circumstances

Deciding between two competing hypotheses

hellip if the behaviour of the robot built according to the

theoretical model M1 is more similar to the target biological

behaviour than the behaviour generated by the robot built

according to the theoretical model M2

Generating new hypotheses on the functional structure of the

biological system

Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 12: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

12

Biorobotics Engineering

Using biological principles of functioning to develop new application solutions

Neuro-robotics

Application of ldquohuman-likerdquo robotic platforms in neuroscience research

Robots used as physical models for validating neuroscience models

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 13: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

13

A robotic platform for validating a model of development of sensory-motor grasp control

Objectives

To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children

To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants

PALOMA EU IST-FET Project

P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43

ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan

The goal of the Department of Humanoid Robotics and

Computational Neuroscience is to develop and explore

computational theories of human behavior by implementing

them on humanoid robots and virtual humans

Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)

ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo

Mitsuo Kawato

DB by Sarcos

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 14: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

14

The WABIAN humanoid robot as a Robotic Human Simulator

WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI

(WABOT-HOUSE Project Gifu Prefecture)

WABIAN simulating the pathological walking of post-stroke patients

Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model

2-DOF model for the waist mechanism allowing knee stretch walking

Height mm 1500

Weight kg 64 (with batteries)

Degrees of Freedom

(DOF)

Leg 6times2

Foot 1times2 (passive)

Waist 2

Trunk 2

Arm 7times2

Hand 3times2

Neck 3

Total 41

The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution

The first explanation of a mechanism of gait transition from swimming to walking

The first amphibious robot capable of swimming crawling and walking

Example of a fruitful interaction between robotics and neuroscience

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 15: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

15

Biological modeling Models of central pattern generators (CPGs)

Lamprey Salamander Cat Human

Madeleine is similar

in size and weight to

a Kemps Ridley or

Olive Ridley sea

turtle measuring 80

cm by 30 cm and

weighing 24 kg The

robot also has a

comparable power

output between 5

and 10 watts per kg

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 16: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

16

A robotic turtle helps engineers build better autonomous underwater vehicles and

answers fundamental questions about how prehistoric and current beasts swim

The robot called Madeleine is already helping researchers understand when it is best

to swim with four flippers and when to use two

The robots polyurethane flippers have the same stiffness as a real turtles but are

operated by electric motors connected to an onboard computer These motors rotate

each flipper so that its back lifts up before rapidly sweeping it down again to generate

propulsion The robot is controlled remotely but has several sensors including video

cameras sonar and altimeter and accelerometer

As real turtles strangely do Madeleine is generally faster when using two active

flippers rather than four This is related to turbolence phenomena between active and

not active flippers together with some power consumptions reasons

Toy car gets stability from lsquolizard tailrsquo

Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards

Taking inspiration from lizardshellip

Nature January 12 2012

Tail-assisted pitch control in lizards

robots and dinosaurs

T Libby T Moore E Chang Siu D Li Daniel J

Cohen Ardian Jusufi

amp Robert J Full

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 17: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

17

Lamprey and salamander-like robots

(b) finding new solutions for high-performance

artificial locomotion in terms of fast-response

adaptability reliability energy efficiency control

Development and use of lampreysalamander

bioinspired artefacts for

The final aim is to go beyond steady state locomotion and investigate locomotion that is

continuously modulated for implementing a rich variety of behaviours

(a) conducting neuroscientific studies on

vertebrate mechanisms involved in the

neural control of goal-directed locomotion

new classes of

biomimetics and

high performance

sensors and

actuators

efficient control

techniques

ICT BioNeurosci

ence

Lamprey Salamander Cat Human

Lamprey and salamander-like robots

Evolution of spinal locomotor CPG for locomotion

The lamprey and the salamander hold a phylogenetic important position in evolution

they possess all basic features of the vertebrate nervous system

Why lamprey and salamander

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 18: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

18

Neuroscience provides

information to be transferred to

mathematical models creating a

bridge between biology and

technology

Numerical simulations are used

to analyse the neuroscientific

models and to study system

properties in well defined

situations

Physical artefacts

provide a powerful

addition to the

methodological

repertoire

Methodology

Lamprey and salamander-like robots

Learning from nature a Bioinspired Jumping Robot

The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of

Energy efficiency

Negotiation on uneven terrains

Robustness to disturbances

Jumping in small animals

By investigating scale effects on locomotion in different sized animals it is evident that

the choice of optimal gait strongly depends upon animal dimensions

For small animals that have to travel rapidly on ground jumping rather

than walking is the only physical solution

Less interaction with ground less dissipated power

[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 19: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

19

Methodology

Study of biological systems experiments on animal locomotion

Analysis of locomotion mechanisms from an engineering point of view

Elaboration of a theory on how scale effects influence locomotion

Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform

Realization of a series of prototypes as models of biological systems to verify the theory

Insects collection and breeding

Insects high-speed video recording

Modeling Prototyping

Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks

Results amp Potential Outcomes

We found that during take-off the legs

of both insect and robot exert a fairly

constant force on the ground

Robots for the exploration of remotehostile environments (eg planetary surface exploration)

New modelsrefinement of existing theories on the physiology of jumping in small animals

bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338

bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58

bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009

bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 20: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

20

Swiss National Center of Competence in Robotics Dario Floreano

1988 - MA in visual psychophysics at the University of Trieste

1992 - MSc in Neural Computation from the University of Stirling

1995 - PhD in Cognitive Systems and Robotics from the University of Trieste

2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL

2005 - associate EPFL professor and established the Laboratory of Intelligent Systems

2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in

Robotics

Bibliography

SMA actuated Microglider looking for the Light

bullCapable of autonomous phototaxis

bullWingspan 24cm

bullLength 22cm

bullFlying at around 15msec

To reduce the weight it has a

02g SMA actuator

for rudder control that is

harmoniously integrated in the

airframe structure

Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D

A 15g SMA-actuated Microglider looking for the Light

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 21: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

21

The AirBurr Robust Flight in Cluttered Indoor Environments

The goal

to study the physical interaction between indoor flying robots and the

environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision

Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano

An Indoor Flying Platform with Collision Robustness and Self-Recovery

2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010

The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings

Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario

IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011

Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)

A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 22: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

22

The octopus as a model

Soft Robotics

o The octopus has no rigid structures and it

can squeeze into small apertures

o The octopus peculiar muscular structure

(muscular hydrostat) provides it with high

strength (up to 40N) in grasping

o The octopus shows rich behaviour learning

capability memory

The octopus muscular hydrostat

Longitudinal muscles

Transverse muscles

Oblique muscles

Constant volume

during contractions

Muscular system as a

modifiable skeleton

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 23: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

23

New technologies and design principles

Achievements

Patent

OCTO-Prop Sucker STIFF-FLOP

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 24: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

24

Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus

OCTOPUS (2009-2013)

The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)

wwwoctopus-

projecteu

Project Duration

48 months

Project Cost

9745000 euro

EC contribution

7600000 euro

7 partners from 5

countries

Coordinator SSSA

Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence

Artificial Muscles the scientifictechnical problem

Current actuation technologies represent a real bottleneck in many robotic

applications especially in biomimetic ones

Biological muscle has some unique properties

bull High efficiency

bull High power density

bull High force density

bull Inherent compliance

bull Flexibility

bull Integrated self-sensing

bull Self-healing properties

Inspiration from biology is driving

the development of new generations

of actuators with the aim of matching

or outperforming natural muscle

M Zupan Adv Mat 2002

Main limitations inertia and back-drivability stiffness control power consumption

Mimicking of both ldquoactiverdquo and ldquopassiverdquo

muscle components

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 25: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

25

Strategies for artificial muscle development

Different technologies have been developed in the last decade to resemble

muscle performance

Shape memory alloys (SMA)

Pneumatic actuators

Electro-active polymers (EAP)

Dielectric elastomers

Ferroelectric polymers

Liquid crystal elastomers

Conducting polymers

Ionic polymermetal composites

ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches

Whole explanted muscles

Recellularized muscle

extracellular matrix (ECM)

Self-organized muscle tissue

engineered in vitro

Elastomeric proteins-based

biomaterials (resembling passive

muscle components)

Protoypes and Publications (1)

Shape memory alloys

P Dario Sens Actuat 1989

D Grant Contr Syst Mag 1997

Y Tadesse J Mech Rob 2011

Pneumatic actuators

CP Chou Rob Autom 1994

B Hannaford Trans Rob Autom 1996

Dielectric elastomers

R Pelrine Proc SPIE 2002

M Cianchetti Sens Actuat B 2009

Ferroelectric polymers

ZY Cheng Sens Actuat A 2001

Conducting polymers

RH Baughman Synth Met 1996

McKeon-Fischer Polymer 2011

Liquid crystal elastomers

L Walter J Appl Phys 1999

CL Van Oosten Nat Mat 2009

M Winkler Macromol Symp 2010

Ionic polymermetal

composites

KJ Kim Polymer 2002

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 26: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

26

Protoypes and Publications (2)

Whole explanted muscles

RG Dennis Tissue Eng 2007

Recellularized muscle

extracellular matrix (ECM)

B Perniconi Biomaterials 2011

Self-organized muscle tissue

engineered in vitro

K Morishima Sens Actuat B 2006 AW Feinberg Science 2007

L Ricotti Biomed Microdev 2010

Elastomeric proteins-based

biomaterials (resembling

passive muscle components)

S Lv Nature 2010

The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular

disorderS)

The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 27: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

27

State of the art of prosthetic hands

Passive Cosmetic Prosthetic Hands

Active Body Powered Prostheses

Myoelectric Prostheses

Hybrid (myoelectric

elbow and body-

powered hand)

Task Oriented

(designed for specific

tasks)

Trend of neurocontrolled artificial limbs

EMG control

(Graupe 1978 hellip)

Targeted Muscle Reinnervation

(Kuiken 2007)

Implantable intraneural interfaces

(Hoch Micera 2006-)

Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take

advantage of the existingremaining neural

connection

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 28: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

28

Extraction of

brain commands

from the motor

nerves

Stimulation of

the sensory

nerves to

provide a

sensory

feedback

The dexterous

prosthesis is re-

connected directly to

the nervous system

LIFE electrodes with a transcutaneous connection

Scheme of the short-term implant

of the CYBERHAND system

CYBERHAND prosthesis

Electronics for recording and stimulation (outside the body of the subject)

Efferent processing control afferent stimulation (on a PC platform)

Collaboration between Scuola Superiore SantrsquoAnna

Campus Biomedico University Fraunhofer Inst Biomed Eng

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 29: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

29

Decoding of motor information

results

Micera et al Proc IEEE 2010

bull More channels make a

difference

bull Decoding grasping is

possible

bull Learning is also possible

To evaluate whether it is possible to alter the perceived magnitude

of these sensations a psychometric scaling task has been used

Subject has been asked to assign an open-ended number to the

magnitude of the elicited sensation for each stimulus presentation

We have been able to elicit sensory information in the subject

(mainly tactile information) but only for the first ten days

Protocol for the experiments on sensory

feedback

Rossini Micera et al Clin Neuroph 2010

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 30: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

30

What we learnt from these

experiments

Decoding grasping information and

delivering sensory feedback is possible

However a more selective and

effective neural interface must be

developed

Next year the first bidirectional

implant for the online control of

a dexterous hand prosthesis

will be tested

Real-time

decoding of motor

commands and

control of the

prosthesis

Afferent nerve

stimulation to

deliver sensory

feedback

TIME real-time

bidirectional implant

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 31: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

31

NEUROBike design and development

Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa

NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke

NEUROBike basic idea

3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot

NEUROBike design and development

1st part foot manipulator

2nd part walls

3rd part knee wrappers

4th part hip support

XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide

Foot device

Walls Knee wrappers Hip support

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 32: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

32

NEUROBike evaluation of performance on healthy subjects

Test with a physiatrist

Monaco Micera et al 2009

Falling definition

ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]

ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]

ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]

ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]

ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]

Classification

bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS

bull DIFFICULT TO DEFINE UNIVOCALLY

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 33: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

33

Falling in elderly people

Common 30 of adults over 65 experience at least a fall each year

Significant consequences

Traumatic

Slight damage (50 ) serious (6 ) fracture (5)

First cause of accidental death

Reduction of mobility and quality of life

Acceleration of functional decline

Psychological

lost of safety fear of falling depression

They occur during activity of daily life at home 60 due to slipping and tripping

Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk

Increasing of the mean age population social and health care problem

Need to prevent falling and correlate damage

2 independently controlled parallel treadmills (4 engines)

Each one can move in longitudinal and transverse directions

Perturbation can be applied in all direction with sudden movement of one or both treadmills

Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)

SENLY

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 34: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

34

SENLY-Fall risk detection

Current work

Identify incipient falling

Mitigation of fall effects

Wearable device

Based on inertial sensors located around waist

Adopts threshold based algorithm

Complex design

Reliability and tolerance

Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable

devices

Martelli Micera et al submitted

SENLY

The long term view

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 35: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

35

Biorobotics Engineering

Diagnosis and rehabilitation in infancy do it earlier make it better

bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment

bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment

bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]

Early diagnosis Early intervention (re-habilitation)

High-quality personalized care

Reduced hospitalization

rate and improved disease

management

Reduced costs for the entire

Healthcare system

ICT

ICT tools for early diagnosis

Rehabilitation robotics Robots for cognitive diseases (eg ASD)

Mechatronic devices for motor rehabilitation

Potential impact

Developmental bioengineering

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 36: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

36

Developmental bioengineering our history

2006 TACT project (FP6)

2008 Collaboration with Fondazione Stella Maris

2010 MechTOY project (Tuscan Region)

2011 CareToy project (FP7)

Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia

Sensorized toys for early diagnosis of Autism Spectrum Disorders

CareToy A Modular Smart System for Infantsrsquo Rehabilitation

At Home based on Mechatronic Toys

FP7-ICT-2011-7 ICT-201151

Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo

a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the

therapy while reducing the cost for the Healthcare Systems

Maximum financial EC contribution 229300000 euro

Duration of the project 36 Months

Starting date November 1st 2011

Expected results

1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy

2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke

3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge

Developmental bioengineering results and future programs

Research

Exploitation

Toys for infancy

Educational Robotics

Some data

N of projects 4

N of papers 5

Clinical partners 5

Industrial partners 3

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 37: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

37

Traditional Stiff and Single-DoF Prostheses

hellipSince 70s

Ottobock LTI Motion Control

RSL Kesheng hellipetc

1-2 DoFs

Reliable

100N power grasp

600g

Precision grasps

[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]

[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results

IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002

[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993

bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps

bull low cosmetics Both static and dynamic properties

bull low controllability No feedback delivered to amputee Not felt as part of their body

30 to 50 do not use their prosthesis regularly

The loss of the upper limb is a traumatic event

that changes the quality of life radically

Actual prostheses are very

different from the natural model

Contact christianciprianisssupit

Dexterous and sensorised FOR ldquoneural intarfacingrdquo

1 Low-Level Control

2 Feedback Delivery Allow natural control

Bidirectional

Large bandwidth

Efference

Afference

Neural Interface Position Touch Pressure [1]

Non-Invasive Interface Touch Temperature Pressure [2]

[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005

[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human

amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007

Dexterous and

Sensory equipped

Biomechatronic

hand

Neural

electrodes

Implantable system

for neural

stimulation and

recording

Telemetric link

for efferent and

afferent signals Patients intentions

decoding cognitive

feedback delivery and

control unit

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 38: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

38

Next

(ongoing) Achievementshellip

Non-invasive interface Clinical ev (8 patients) -Lund University Sweden

Recent publications (last 5 years)

bull ~30 papers on ISI journals or IEEE Conf

Current active projects

bull 2 EU FP7

bull 2 National (Ministry of Research)

Current total funding ~15 Meuro

2011 IH2 Azzurra hand

2009 Spin-off company

16 DoF 4 Motors

40 Sensors

SmartHand Prototype (2009)

16 DoF 5 Motors

24 Sensors 500gr

Bioinspired finger design

Contact christianciprianisssupit

Aer-O-Scope Invendotrade endoscope Endotics

Wireless Endoscopic Capsule

Biorobotics Engineering scientific problem

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 39: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

39

Capsule shell

26mm in length and

11mm in diameter less

than the commercial

PillCam Colon (11mm

31mm)

Operating channel

air and water injection and endoscopic tools

introduction for therapeutic and surgical procedures

Video module

color VGA

camera and 4

light emitted

diodes (LED)

Hall-effect sensor

on-board magnetic

field sensor that

provides real-time

clues about the

magnetic link

strength

Washing system

injection of water

for the glass

cleaning from a

dedicated channel

and nozzle

Biorobotics Engineering methodological approach

Biorobotics Engineering in-vitro ex-vivo and in-vivo

experimental study

Grasping forceps Biopsy forceps Retrieval basket

Ex-vivo test In-vivo test

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 40: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

40

EAES conference

19th International congress of European

association for endoscopy surgery

June 15-18TH 2011

Turin - Italy

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino

P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic

air capsule robotic system Proof of concept of a novel approach for painless colonoscopy

Surgical Endoscopy submitted

Biorobotics Engineering Robotics Surgery

Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system

CHALLENGES

From external robots to endoluminal robots

The quest for miniaturization integrating robotics and nanomedicine

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 41: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

41

Case study - Developing a novel reconfigurable robotic system for endoluminal surgery

Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery

Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases

Developing a novel reconfigurable robotic

system for endoluminal surgery

Case study

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 42: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

42

From one to many capsules - RECONFIGURABLE robots for the exploration of the human body

Φ154 X 363 56 g 2 DOF

plusmn90 deg

Motors

Battery

Control Board

360 deg

1 Swallowing

the capsules 2 Passing through the esophagus

3 Assembly in the stomach

4 Diagnosis Intervention in the stomach

Target area

Operation

5 Reconfiguration for passing the pyloric sphincter

Prototyping of a robotic module

Camera

Biopsy forceps

Tissue Storage

ARES project European Commision FP7

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 43: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

43

Developing a novel bimanual dexterous robotic system for

NOTES and single port surgery

Case study

Common mechanical problems for intra-abdominal robots

bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization

Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity

Shoulder Elbow

Wrist

on-board actuation

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 44: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

44

bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total

bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time

SPRINT-v01 robot first prototype

International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery

Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010

Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011

SPRINT System simulated pick and place tasks

SPRINT System simulated suturing tasks

SPRINT-v01 robot first prototype

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 45: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

20

40

60

80

100

120

Pegs Mean Transfer Time

peg

me

an

tim

e (

s)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

10

20

30

40

50

60

Percentage of pegs lost

peg

o

f p

eg

s lo

st

Robot Characterization Peg transfer task

Learning Curves Task repeated two times

SURGEON Background 1 2 3 4 5 6

AGE 46 49 37 51 70 47

SPECIALIZATION General Surgery

Urology

General Surgery

General Surgery

Laparoscopic Surgery

Gynecology

OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20

EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY

YES YES YES YES YES YES

EXPERIENCE IN SINGLE PORT LAPAROSCOPY

YES NO YES YES YES YES

Robot Characterization Suturing task

Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg

Treating Brain Diseases by means of Endoscopic Microrobotic Solutions

Extremely high-impact pathologies

Brain tumors

148 new cases per 100000 inhabitantsyear (USA)

Alzheimer 266 million sufferers worldwide

Parkinson 8-18 new cases per 100000 personsyear

Neurosurgery

Radiotherapy

Chemotherapy Drug therapy

Invasiveness (craniotomy)

Systemic side effects

Systemic side effects high dose

Drawbacks Current treatments

Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue

Quest for a flexible yet controllable (dexterous) probe

(to be framed within a CAS platform)

CNS = Central

Nervous System

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 46: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

46

Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)

bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)

bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via

Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system

bull Real-scale spine model (after reconstruction from medical images)

bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode

Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain

Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)

CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)

Preliminary control tasks for the LWR arm which will support the probe module (end-effector)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 47: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

47

Processing module Pre-operative data

(MRI data) VHD PHD

MRI Scanner NA 3 T

Images type 2D 3D

Images view Axial AxialCoronal Sagittal

Resolution Image 256 x 256 256 x 256

Slice thickness 4 mm 1 mm

Spacing between scans 1 mm 06 mm

Pre-operative imaging 3D reconstruction (Amira sw)

Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)

Reconstruction also used for fluid-structure interaction modeling

CAS framework for the neurosurgical dexterous probe processing module (ongoing development)

Neurosurgical dexterous probe (ongoing development)

bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)

bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)

bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents

bull development of control strategies (at both arm and probe level) for motion compensation

bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 48: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

48

Developing a novel miniaturized robotic

system for diagnosis and treatment of vascular

diseases

Case study

A possible approach to intraluminal navigation

hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 49: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

49

years

en

do

lum

ina

l ro

bo

ts s

ize

10 cm

1 cm

1 mm

Millimetric robot

for vascular

diagnosis and

therapy

Micromechanical and microelectronic

systems integrated into the milli-shuttle

can provide for

bulldrug delivery

bullplaque destruction

bullMicro-stenting

bulletc

Additional therapyimaging can be

provided by the help of external energy hellip

1995 2000 2010 2005

Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)

Scientific Problems

Main Goal

Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part

More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved

hellip to develop novel diagnostic and therapeutic procedures in the vascular

system by exploiting micronano-system technologies integrated in robotic

platforms for usable clinical applications

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 50: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

50

Surgeon

US Visual Interface

Control Unit

External Robotic Platform

Intravascular Robotic Device

Magnetic Link

Patient

Processing Unit

Pre-operative Data

Intra-operative Data

Pre-operative Imaging

Virtual Path

Localization System

US Imaging Data

The Platform

Trad

itio

nal C

AS

arch

itectu

re

Magnetic dragging and US tracking (intra-operative)

Imaging and locomotion

Intra-operative data coming from the US localization system for ultrasound-based servoing

control

Ultrasounds can be adequate for effective and safe localization and

tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates

Robotic-aided magnetic navigation

Ultrasound (US) imaging

Externally applied magnetic fields that control movement and position of magnetically tipped instruments

External permanent magnet (EPM) attached to the end-effector of a 6 DoFs

robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped

internal permanent magnets (IPM)

US PROBE

EPM

IPM

Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 51: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

51

Magnetic guidance of miniaturized devices within pulsatile flows

First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype

within a pulsatile flow

Vascular MicroRobot Test Bench EVE Endovascular Simulation System

MicroVAST project ndash wwwmicrovastit

DustBot e post-DustBot

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 52: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

52

DustBot from a project to a product

DustBot system

develop

DustBot demon-strations

DustBot Deep Demo

Extensive testing

(gt 3 months)

of the real service

in real environments

with real end users

under the supervision

of real customers

Industrial develop

market

DustBot Project

Venture Capital

DustBot Exploitation Plan

bottleneck Laws

Regulations Insurance

DustBot End-user analysis

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 53: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

53

Ethical Legal and Social issues (ELS)

bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by

robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation

ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards

ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities

Main achievements in roboethics activities

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 54: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

54

The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and

development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive

problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent

Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the

social and ethical problems they are identifying in their fields

First International Symposium on

ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics

30th - 31th January 2004 Villa Nobel Sanremo Italy

Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO

Organiser

Scuola di Robotica

Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy

International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy

Main publications in ELS topics

bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011

bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010

bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)

bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 55: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

55

Other achievements

The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo

Topic SiS2011111-3 Regulating emerging scientific and technological developments

ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2

Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany

ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use

Educational Robotics

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 56: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

56

Il nostro obiettivo educare lrsquoingegnere del

XXI secolo

Il nostro modello dellrsquoingegnere inventore

Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria

Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave

Il nostro modello dellrsquoingegnere inventore

Micro-robot per esplorare il corpo umano Robot Umanoidi

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 57: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

57

Il nostro ldquolabrdquohellip

hellipcome una bottega rinascimentale

dove decine di studenti di dottorato

imparano come si fa la ricercahellip

Il nostro modello dellrsquoingegnere

inventore

Lrsquoinnovazione ldquodisruptiverdquo

(ldquoradicalerdquo) la fanno gli

innovatori (non le macchine)

Ersquo quindi fondamentale

formare innovatori

Lrsquoassunto di partenza

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 58: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

58

Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza

In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia

Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici

Ingegneria e scienza sono strettamente interconnesse

Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori

Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 59: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

59

Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving

Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico

Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati

Il nostro modello dellrsquoingegnere inventore

Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI

Engineering Education at MIT (IEEE Spectrum 1995)

ldquoOrganizzatori di Creativitagraverdquo

Il nostro modello dellrsquoingegnere inventore

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 60: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

60

bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane

bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave

bull Capacitagrave di formulare un ldquopensiero sistemisticordquo

bull Spirito imprenditoriale bull Forte competenza e attenzione ai

problemi sociali

Il nostro modello dellrsquoingegnere inventore

Un modello europeo per lrsquoeducazione del nuovo ingegnere

bull Elevata competenza tecnica

bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)

bull Capacitagrave di risolvere problemi

bull Capacitagrave di lavorare in gruppo

bull Apertura mentale e capacitagrave di dialogo con differenti discipline

Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)

Il nostro modello dellrsquoingegnere inventore

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 61: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

61

Lrsquoobiettivo

bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso

un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati

per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc

ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati

Il nostro modello dellrsquoingegnere inventore

LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)

LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli

innovatori

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 62: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

62

Il nostro modello dellrsquoingegnere inventore

Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che

sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)

Gli Innovatori are a sono ldquoribelli organizzatirdquo

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)

I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 63: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

63

helliplrsquoIngegnere del 21-mo secolo

Il nostro modello dellrsquoingegnere inventore

bull Per fare questo occorrono

ndash solide competenze di base (scientifiche ed ingegneristiche)

ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca

ndash ed un autonomo spirito imprenditoriale

Innovazione e Innovatori

Il nostro modello dellrsquoingegnere inventore

Innovazione e Innovatori

Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati

Il primo problema egrave come educare e formare i potenziali Innovatori

Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 64: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

64

Educare i giovani ricercatori attraverso

GRANDI SFIDE

Il nostro modello dellrsquoingegnere inventore

Sognatori e Leader

Coltiva i tuoi sogni

Sii un sognatore ma sii concreto

Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni

Raggiungi i risultati e possibilmente

Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 65: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

65

Primary Education (3-14 years)

Product

specifications

Design

Factory

organization

management

Product

Mark

et

Problem

(curiosity and

creativity

driven)

Modelling

discovery

Invention

Prototypes

experiments

Specifications

Pre-school (3-6 years old)

bull Introduction to robotics

bull Robot as interactive games

Elementary (6-11 years old)

bull What is a robot

bull The robots already among us

bull Manual activities

bull Contest robot design or project

Secondary schools (11-14 years old)

bull Introduction to robotics

bull Experimental activities using robotic kits

bull Robot contests

Secondary Education

(14-19 years)

(14-19 years old)

Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)

bull History

bull Philosophy

bull Language and Linguistics

bull Art

bull Biology

bull Sciences

Involvement of childrenteenagers form 3 to 19 years old

Completing the education of the new

engineer of the XXI Century a

scientist an inventor an entrepreneur

Educational Robotics Educational activities since the 1990s

The BioRobotics Institute approach to educational activities

Robotic contestICAR rsquo91 Pisa Italy 1991

LDT in Pontedera (PI) Italy 2011

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 66: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

66

Educational Robotics La Scuola SantrsquoAnna sul territorio

Piscina comunale_Pontedera

Piscina comunale_Pontedera

Ecce Robot_Pisa

Settembre Pedagogico_Pisa

Main results and publications

bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in

Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area

bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E

Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011

ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011

ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 67: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

67

Permanent Robot Exhibition

bull Directors Paolo Dario and Mario Zen

bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer

bull Catalogue and staging Roberto Festi

bull Quantity of material presented 220250 pieces (estimation)

bull Exposition space 800900m2

In collaboration with

The

BioRobotics

Institute

Spin-off Companies at SSSA

Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178

Areas ICT 7

Electronics (ElectronicsSensors) 5

Biomedical Instruments 4

Mechatronics

3

EnvironmentEnergy 2

Robotics

3

Optoelectronics

1

Domotics

1

Consultancy- Due Diligence

1

2

Pisa19

2

1

2

1

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 68: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

68

The

BioRobotics

Institute

Scientia

Machina

le srl

1991

HUMANWARE

srl

IDEA

srl

1994

PRAGMA

srl

1995

SYNAPSIS

srl

1996

ICUBE

srl

1997

TechnoDeal

srl

2000

DOMOTICA 2000

srl

MicroTech srl

AEDIT

srl

2001

VR Media

srl

2002

EVIDENCE

srl

AMIC

srl

2003

ENCREA

srl

2004

ERA

ENDOSCOPY

srl

DEDALO

srl

PhoTrix

srl

2005 2006

ROBOTECH

srl

MEDEA

srl

ERGO

srl

MINT Publishing

srl

Henesis

srl

FST

srl

FiberSens

srl

2007

2008

Fastenica

WIN

Prensilia

2009 2010

REKNO

Robotics

KIWI

Robotics

- Micromechatronics

- Nanotechnologies

- Bioengineering

- Robotics

- Photonics

- Environment

- Software Engineering

New Spin Off Companies 31 Total employees 178 Total revenues (2010)

8327 K

ASIDEV

HUMANOT

2011

20 Spin Off Companies created by the BRI researchers

2009

WIN Srl (Pisa)

httpwwwwinmedit

Research area Electronics

To create world class wireless medical systems based on cutting-

edge technologies for the wellbeing of the third millenium mankind

18

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 69: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

69

20 Spin Off Companies created by the BRI researchers

2009

Prensilia Srl (Pisa)

httpwwwprensiliacom

Research area Robotics

Prensilia designs customizes and manufactures advanced anthropomorphic under-

actuated robotic hands endowed with embedded actuation sensory and control

systems that can be exploited in research as advanced hand prostheses end effectors

for humanoid robots for rehabilitation andor neuroscientific experiments in general in

all research fields where it is important to have an artificial hand that behaves as a

natural one

19

0

5

10

15

20

25

30

SSSA BRI

31

20 (645)

Spin Off Companies

0

20

40

60

80

100

120

140

160

SSSA BRI

178 128

(80)

Employees (N)

7000000

7200000

7400000

7600000

7800000

8000000

8200000

8400000

SSSA BRI

8327000

7462000 (896)

Revenue (euro)

20 2011

HUMANOT (Firenze)

Robotica umanoide

Alcuni di noihellip

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit

Page 70: BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia del termine “robotica” robotica" venne usato per la prima volta (su carta stampata)

2282012

70

STAY HUNGRY STAY FOOLISH

Steve Jobs

Il vostro dovere egrave non accontentarvi e pensare limpossibile

Ma egrave anche quello di mettere i

vostri talenti a disposizione dei

meno bravi e fortunati

Paolo Dario

Grazie per lrsquoattenzione Paolo Dario

Direttore Polo SantAnna Valdera -

Scuola Superiore SantAnna Viale

Rinaldo Piaggio 34 ndash 56025 -

Pontedera (Pisa)

Tel +39050883420102

Mobile +393488863117

Fax +39050883497

emailpaolodariosssupit