BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia...
Transcript of BioIngegneria e BioRobotica: l’ingegneria al servizio ... · 2/28/2012 2 Il termine "Etimologia...
2282012
1
BioIngegneria e BioRobotica lrsquoingegneria al servizio della vita Paolo Dario
Direttore
Istituto di BioRobotica
Studiare ingegneria alla Scuola Superiore SantrsquoAnna Giornata di orientamento 4 febbraio 2012 San Miniato (PISA)
Etimologia del termine ldquorobotrdquo
Il termine robot fu usato per la prima volta dallo scrittore ceco Karel Čapek nel 1920 nel suo romanzo RUR (Rossums Universal Robots) Deriva dal termine ceco robota che significa lavoro pesante o lavoro forzato In realtagrave il vero inventore della parola robot fu il fratello di Karl Čapek Josef anche lui scrittore e pittore cubista il quale utilizzograve la parola ldquoautomatrdquo (automa) in un suo racconto del 1917 Opilec (ldquoLubriaconerdquo) Il termine greco autogravematon significa ldquoche si muove da seacuterdquo
La Robotica
2282012
2
Etimologia del termine ldquoroboticardquo Il termine robotica venne usato per la prima volta (su carta stampata) nel racconto di Isaac Asimov intitolato Circolo vizioso (Runaround 1942) presente nella sua famosa raccolta Io Robot
In esso egli citava le tre
regole della robotica che in seguito divennero le Tre leggi della robotica
La Robotica
First edition cover
December 2 1950
Le tre leggi della robotica di Asimov
Un robot non puograve recare danno a un essere umano neacute puograve permettere che a causa del suo mancato intervento un essere umano riceva danno
Un robot deve obbedire agli ordini impartiti dagli esseri umani purcheacute tali ordini non contravvengano alla Prima Legge
Un robot deve proteggere la propria esistenza purcheacute questa autodifesa non contrasti con la Prima e la Seconda Legge
2282012
3
Definizioni di Robotica
A robot is a re-programmable multi-functional manipulator designed to move material parts or specialized devices through variable programmed motions for the performance of a task
Un robot egrave un manipolatore multifunzionale
riprogrammabile progettato per muovere materiali componenti o dispositivi specializzati attraverso movimenti variabili programmati per lo svolgimento del compito
Robotics Industry Association (~ 1980)
Jablonsky J Posey J 1985 ldquoRobotics Terminologyrdquo in Handbook of Industrial Robotics ed S Nof J Wiley New
York pp1271-1303
Joseph Engelberger Ingegnere Isaac Asimov
Scrittore
Le origini della
robotica moderna
UNIMATE Il primo robot
industriale Nel 1960 il primo robot industriale fu installato presso un
impianto produttivo General Motors in New Jersey (USA)
2282012
4
Isaac Asimov e Joseph Engelberger
Dalla robotica industriale alla robotica di servizio
Robotica di servizio
Esplorazioni spaziali Esplorazioni sottomarine
Applicazioni domestiche
Igiene urbana e monitoraggio ambientale
Applicazioni militari
2282012
5
January 2007
I robot fuori dalle fabbrichehellip
Condivisione dello spazio di lavoro tra persone e robot
Maggiori capacitagrave percettive
Comportamento reattivo
Servizi
Ambienti ostili
Photo Center for Robot-Assisted Search and Rescue
2282012
6
La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM
Il computer che ha battuto il campione di scacchi Kasparov
Paradigma ldquoMeccatronicordquo per la progettazione di
macchine
Meccanismo
Spazio di lavoro
Interfaccia
uomo-macchina
Attuatori
Energia
Operatore
Controllo
Sensori
Progettazione meccatronica integrata
Avvento della microelettronica cambio
di paradigma
Telecamera digitale
Boeing 777
Ferrari - 550 Maranello
Lavatrice
Meccatronica il paradigma per la progettazione di robot
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
2
Etimologia del termine ldquoroboticardquo Il termine robotica venne usato per la prima volta (su carta stampata) nel racconto di Isaac Asimov intitolato Circolo vizioso (Runaround 1942) presente nella sua famosa raccolta Io Robot
In esso egli citava le tre
regole della robotica che in seguito divennero le Tre leggi della robotica
La Robotica
First edition cover
December 2 1950
Le tre leggi della robotica di Asimov
Un robot non puograve recare danno a un essere umano neacute puograve permettere che a causa del suo mancato intervento un essere umano riceva danno
Un robot deve obbedire agli ordini impartiti dagli esseri umani purcheacute tali ordini non contravvengano alla Prima Legge
Un robot deve proteggere la propria esistenza purcheacute questa autodifesa non contrasti con la Prima e la Seconda Legge
2282012
3
Definizioni di Robotica
A robot is a re-programmable multi-functional manipulator designed to move material parts or specialized devices through variable programmed motions for the performance of a task
Un robot egrave un manipolatore multifunzionale
riprogrammabile progettato per muovere materiali componenti o dispositivi specializzati attraverso movimenti variabili programmati per lo svolgimento del compito
Robotics Industry Association (~ 1980)
Jablonsky J Posey J 1985 ldquoRobotics Terminologyrdquo in Handbook of Industrial Robotics ed S Nof J Wiley New
York pp1271-1303
Joseph Engelberger Ingegnere Isaac Asimov
Scrittore
Le origini della
robotica moderna
UNIMATE Il primo robot
industriale Nel 1960 il primo robot industriale fu installato presso un
impianto produttivo General Motors in New Jersey (USA)
2282012
4
Isaac Asimov e Joseph Engelberger
Dalla robotica industriale alla robotica di servizio
Robotica di servizio
Esplorazioni spaziali Esplorazioni sottomarine
Applicazioni domestiche
Igiene urbana e monitoraggio ambientale
Applicazioni militari
2282012
5
January 2007
I robot fuori dalle fabbrichehellip
Condivisione dello spazio di lavoro tra persone e robot
Maggiori capacitagrave percettive
Comportamento reattivo
Servizi
Ambienti ostili
Photo Center for Robot-Assisted Search and Rescue
2282012
6
La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM
Il computer che ha battuto il campione di scacchi Kasparov
Paradigma ldquoMeccatronicordquo per la progettazione di
macchine
Meccanismo
Spazio di lavoro
Interfaccia
uomo-macchina
Attuatori
Energia
Operatore
Controllo
Sensori
Progettazione meccatronica integrata
Avvento della microelettronica cambio
di paradigma
Telecamera digitale
Boeing 777
Ferrari - 550 Maranello
Lavatrice
Meccatronica il paradigma per la progettazione di robot
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
3
Definizioni di Robotica
A robot is a re-programmable multi-functional manipulator designed to move material parts or specialized devices through variable programmed motions for the performance of a task
Un robot egrave un manipolatore multifunzionale
riprogrammabile progettato per muovere materiali componenti o dispositivi specializzati attraverso movimenti variabili programmati per lo svolgimento del compito
Robotics Industry Association (~ 1980)
Jablonsky J Posey J 1985 ldquoRobotics Terminologyrdquo in Handbook of Industrial Robotics ed S Nof J Wiley New
York pp1271-1303
Joseph Engelberger Ingegnere Isaac Asimov
Scrittore
Le origini della
robotica moderna
UNIMATE Il primo robot
industriale Nel 1960 il primo robot industriale fu installato presso un
impianto produttivo General Motors in New Jersey (USA)
2282012
4
Isaac Asimov e Joseph Engelberger
Dalla robotica industriale alla robotica di servizio
Robotica di servizio
Esplorazioni spaziali Esplorazioni sottomarine
Applicazioni domestiche
Igiene urbana e monitoraggio ambientale
Applicazioni militari
2282012
5
January 2007
I robot fuori dalle fabbrichehellip
Condivisione dello spazio di lavoro tra persone e robot
Maggiori capacitagrave percettive
Comportamento reattivo
Servizi
Ambienti ostili
Photo Center for Robot-Assisted Search and Rescue
2282012
6
La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM
Il computer che ha battuto il campione di scacchi Kasparov
Paradigma ldquoMeccatronicordquo per la progettazione di
macchine
Meccanismo
Spazio di lavoro
Interfaccia
uomo-macchina
Attuatori
Energia
Operatore
Controllo
Sensori
Progettazione meccatronica integrata
Avvento della microelettronica cambio
di paradigma
Telecamera digitale
Boeing 777
Ferrari - 550 Maranello
Lavatrice
Meccatronica il paradigma per la progettazione di robot
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
4
Isaac Asimov e Joseph Engelberger
Dalla robotica industriale alla robotica di servizio
Robotica di servizio
Esplorazioni spaziali Esplorazioni sottomarine
Applicazioni domestiche
Igiene urbana e monitoraggio ambientale
Applicazioni militari
2282012
5
January 2007
I robot fuori dalle fabbrichehellip
Condivisione dello spazio di lavoro tra persone e robot
Maggiori capacitagrave percettive
Comportamento reattivo
Servizi
Ambienti ostili
Photo Center for Robot-Assisted Search and Rescue
2282012
6
La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM
Il computer che ha battuto il campione di scacchi Kasparov
Paradigma ldquoMeccatronicordquo per la progettazione di
macchine
Meccanismo
Spazio di lavoro
Interfaccia
uomo-macchina
Attuatori
Energia
Operatore
Controllo
Sensori
Progettazione meccatronica integrata
Avvento della microelettronica cambio
di paradigma
Telecamera digitale
Boeing 777
Ferrari - 550 Maranello
Lavatrice
Meccatronica il paradigma per la progettazione di robot
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
5
January 2007
I robot fuori dalle fabbrichehellip
Condivisione dello spazio di lavoro tra persone e robot
Maggiori capacitagrave percettive
Comportamento reattivo
Servizi
Ambienti ostili
Photo Center for Robot-Assisted Search and Rescue
2282012
6
La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM
Il computer che ha battuto il campione di scacchi Kasparov
Paradigma ldquoMeccatronicordquo per la progettazione di
macchine
Meccanismo
Spazio di lavoro
Interfaccia
uomo-macchina
Attuatori
Energia
Operatore
Controllo
Sensori
Progettazione meccatronica integrata
Avvento della microelettronica cambio
di paradigma
Telecamera digitale
Boeing 777
Ferrari - 550 Maranello
Lavatrice
Meccatronica il paradigma per la progettazione di robot
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
6
La sfida dellrsquointelligenza artficiale negli anni lsquo80 Deep Blue IBM
Il computer che ha battuto il campione di scacchi Kasparov
Paradigma ldquoMeccatronicordquo per la progettazione di
macchine
Meccanismo
Spazio di lavoro
Interfaccia
uomo-macchina
Attuatori
Energia
Operatore
Controllo
Sensori
Progettazione meccatronica integrata
Avvento della microelettronica cambio
di paradigma
Telecamera digitale
Boeing 777
Ferrari - 550 Maranello
Lavatrice
Meccatronica il paradigma per la progettazione di robot
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
7
Progettazione integrata delle diverse componenti meccaniche elettroniche informatiche del sistema
Progettazione biomeccatronica
Mechanism
Workspace
Human-machine interface
Actuators
Energy Supply
Operator
Control
Sensors
Integrated mechatronic design
Biorobotics Science and Engineering
Biorobotics Science using robotics to discover new pricipleshellip
Biorobotics Engineering using robotics to invent new solutionshellip
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
8
Biorobotica intersezione tra biologia e robotica
BIOLOGIA ROBOTICA BIO
ROBOTICA
Lrsquoinsieme delle scienze e delle tecnologie finalizzate alla
progettazione ed alla realizzazione di sistemi robotici di
ispirazione biologica
A methodology for Biorobotics biomechatronic design
Engineering analysis and modeling
Development of a physical model
Bio-mimetic robot
Biological system
Bio-inspired robot
Validation
Applications
Development of a biomedical robot
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
9
I
O
I
O
HYPOTHESIS AND MODEL
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
Gripforce
Loadforce
Movement
Biorobotics vs simulations and animal models
Interaction
Human model
Model of
interaction
World model
World rdquoIt turns out to be easier to build real robots than to simulate complex interactions with the world including perception and motor control Leaving those things out would deprive us of key insights into the nature of human intelligencerdquo [Rodney Brooks 2000]
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
10
I
O
I
O
HYPOTHESIS AND MODEL
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED
IMPLEMENTATION IN A ROBOT
Gripforce
Loadforce
Movement
G Tamburrini E Datteri ldquoMachine Experiments and Theoretical Modelling from Cybernetic
Methodology to Neuro-Roboticsrdquo Minds and Machines 15 3-4 2005 pp 335-58
HYPOTHESIS AND MODEL (comparison between
numerical results and interpolated experimental data
of living oligochaeta)
Validation of the model
EXPERIMENT Comparison between robot and biological system performance
Biorobotics Science
PHENOMENON TO BE
EXPLAINED (combination of
friction and segment number for effective
locomotion)
IMPLEMENTATION IN A ROBOT
A Menciassi and P Dario Philos
Transact Roy Soc A Math Phys
Eng 2003
D Accoto P Castrataro P Dario
J Theor Biology 2004
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
11
Biorobotics epistemology
Proto-Cybernetics (J Loeb 1905 1912 H S Jennings 1906)
Mechanicism Vs Functionalism for studying the behavior of living organisms If a machine is implemented on the basis of a theory of behavior and it behaves according to what this theory allows to predict this test reinforces the proposed theory
Cybernetics (Rosenblueth Wiener Bigelow 1943)
Unified approach to the study of living organisms and machines
Purposive adaptive behaviors (in animals and humans) are produced by feedback machines (teleology)
Machines as lsquomaterial modelsrsquo useful for testing scientific hypotheses
Machines are used for SCIENCE
Robotics for Biology - This approach can be used for
Corroborationfalsification
hellip if the artificial and the robotic system behave in the
samedifferent way under the same external and internal
circumstances
Deciding between two competing hypotheses
hellip if the behaviour of the robot built according to the
theoretical model M1 is more similar to the target biological
behaviour than the behaviour generated by the robot built
according to the theoretical model M2
Generating new hypotheses on the functional structure of the
biological system
Barbara Webb Biorobotics MIT Press 2001 Datteri E Tamburrini G Bio-robotic experiments and scientific method in Magnani L Dossena R (eds) Computing Philosophy and Cognition College Publications London 2005
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
12
Biorobotics Engineering
Using biological principles of functioning to develop new application solutions
Neuro-robotics
Application of ldquohuman-likerdquo robotic platforms in neuroscience research
Robots used as physical models for validating neuroscience models
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
13
A robotic platform for validating a model of development of sensory-motor grasp control
Objectives
To increase knowledge of brain connectivity (architecture) and brain activity (functioning) concerning sensory motor coordination for object manipulation in children
To integrate an anthropomorphic robotic platform for grasping and manipulation to validate a neurophysiological model of the five learning phases of visuo-tactile-motor coordination in infants
PALOMA EU IST-FET Project
P Dario MC Carrozza E Guglielmelli C Laschi A Menciassi S Micera F Vecchi ldquoRobotics as a ldquoFuture and Emerging Technology biomimetics cybernetics and neuro-robotics in European projectsrdquo IEEE Robotics and Automation Magazine Vol12 No2 June 2005 pp29-43
ldquoUnderstanding the brain by creating the brainrdquo Mitsuo Kawato ATR Kyoto Japan
The goal of the Department of Humanoid Robotics and
Computational Neuroscience is to develop and explore
computational theories of human behavior by implementing
them on humanoid robots and virtual humans
Kawato M ldquoUnderstanding the brain by creating the brain toward Manipulative Neurosciencerdquo Philosophical Transactions of the Royal Society B (2007)
ldquoBrain functions cannot be studied dealing with only the brain We also need to reproduce bodies and surrounding environments Then it is obvious that robotics research is very much related rdquo
Mitsuo Kawato
DB by Sarcos
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
14
The WABIAN humanoid robot as a Robotic Human Simulator
WABIAN testing the Walking Aid Robot for Elderly developed by HITACHI
(WABOT-HOUSE Project Gifu Prefecture)
WABIAN simulating the pathological walking of post-stroke patients
Wabian humanoid robot Waseda University Tokyo Japan Anthropomorphic kinematic model
2-DOF model for the waist mechanism allowing knee stretch walking
Height mm 1500
Weight kg 64 (with batteries)
Degrees of Freedom
(DOF)
Leg 6times2
Foot 1times2 (passive)
Waist 2
Trunk 2
Arm 7times2
Hand 3times2
Neck 3
Total 41
The transition from aquatic to terrestrial locomotion was a key development in vertebrate evolution
The first explanation of a mechanism of gait transition from swimming to walking
The first amphibious robot capable of swimming crawling and walking
Example of a fruitful interaction between robotics and neuroscience
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
15
Biological modeling Models of central pattern generators (CPGs)
Lamprey Salamander Cat Human
Madeleine is similar
in size and weight to
a Kemps Ridley or
Olive Ridley sea
turtle measuring 80
cm by 30 cm and
weighing 24 kg The
robot also has a
comparable power
output between 5
and 10 watts per kg
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
16
A robotic turtle helps engineers build better autonomous underwater vehicles and
answers fundamental questions about how prehistoric and current beasts swim
The robot called Madeleine is already helping researchers understand when it is best
to swim with four flippers and when to use two
The robots polyurethane flippers have the same stiffness as a real turtles but are
operated by electric motors connected to an onboard computer These motors rotate
each flipper so that its back lifts up before rapidly sweeping it down again to generate
propulsion The robot is controlled remotely but has several sensors including video
cameras sonar and altimeter and accelerometer
As real turtles strangely do Madeleine is generally faster when using two active
flippers rather than four This is related to turbolence phenomena between active and
not active flippers together with some power consumptions reasons
Toy car gets stability from lsquolizard tailrsquo
Inspiration from lizard tails will likely lead to far more agile search-and-rescue robots as well as ones having greater capability to more rapidly detect chemical biological or nuclear hazards
Taking inspiration from lizardshellip
Nature January 12 2012
Tail-assisted pitch control in lizards
robots and dinosaurs
T Libby T Moore E Chang Siu D Li Daniel J
Cohen Ardian Jusufi
amp Robert J Full
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
17
Lamprey and salamander-like robots
(b) finding new solutions for high-performance
artificial locomotion in terms of fast-response
adaptability reliability energy efficiency control
Development and use of lampreysalamander
bioinspired artefacts for
The final aim is to go beyond steady state locomotion and investigate locomotion that is
continuously modulated for implementing a rich variety of behaviours
(a) conducting neuroscientific studies on
vertebrate mechanisms involved in the
neural control of goal-directed locomotion
new classes of
biomimetics and
high performance
sensors and
actuators
efficient control
techniques
ICT BioNeurosci
ence
Lamprey Salamander Cat Human
Lamprey and salamander-like robots
Evolution of spinal locomotor CPG for locomotion
The lamprey and the salamander hold a phylogenetic important position in evolution
they possess all basic features of the vertebrate nervous system
Why lamprey and salamander
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
18
Neuroscience provides
information to be transferred to
mathematical models creating a
bridge between biology and
technology
Numerical simulations are used
to analyse the neuroscientific
models and to study system
properties in well defined
situations
Physical artefacts
provide a powerful
addition to the
methodological
repertoire
Methodology
Lamprey and salamander-like robots
Learning from nature a Bioinspired Jumping Robot
The scientific problem addressed is to find what type of locomotion is suitable for a small robot in unstructured environments both in terms of
Energy efficiency
Negotiation on uneven terrains
Robustness to disturbances
Jumping in small animals
By investigating scale effects on locomotion in different sized animals it is evident that
the choice of optimal gait strongly depends upon animal dimensions
For small animals that have to travel rapidly on ground jumping rather
than walking is the only physical solution
Less interaction with ground less dissipated power
[1] RM Alexander Principles of animal locomotion Princeton University Press (2003) [2] CT Farley CR Taylor A mechanical trigger for the trotndashgallop transition in horses Science 253 306ndash308 (1991) [3] RM Alexander Energetics and Optimization of Human Walking and Running The 2000 Raymond Pearl Memorial Lecture (2000)
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
19
Methodology
Study of biological systems experiments on animal locomotion
Analysis of locomotion mechanisms from an engineering point of view
Elaboration of a theory on how scale effects influence locomotion
Understand what can be implemented in robotics (bio-inspiration) and realization of a robotic platform
Realization of a series of prototypes as models of biological systems to verify the theory
Insects collection and breeding
Insects high-speed video recording
Modeling Prototyping
Swarms of robots constituting a sensorcommunication network for monitoringrescue tasks
Results amp Potential Outcomes
We found that during take-off the legs
of both insect and robot exert a fairly
constant force on the ground
Robots for the exploration of remotehostile environments (eg planetary surface exploration)
New modelsrefinement of existing theories on the physiology of jumping in small animals
bull U Scarfogliero G Bonsignori C Stefanini E Sinibaldi F Li D Chen and P Dario ldquoBioinspired Jumping Locomotion in Small Robots Natural Observation Design Experimentsrdquo Springer Tracts in Advanced Robotics 2009 Volume 542009 329-338
bull U Scarfogliero C Stefanini P Dario ldquoThe use of compliant joints and elastic energy storage in bio-inspired legged robotsrdquo Mechanism and Machine Theory Volume 44 Issue 3 March 2009 Pages 58
bull Fei L Bonsignori G Scarfogliero U Dajing C Stefanini C Weiting L Dario P Xin F ldquoJumping mini-robot with bio-inspired legsrdquo Robotics and Biomimetics 2008 ROBIO 2008 IEEE International Conference on pp933-938 22-25 Feb 2009
bull Scarfogliero U Stefanini C Dario P ldquoDesign and Development of the Long-Jumping Grillo Mini Robotrdquo Robotics and Automation 2007 IEEE International Conference on pp467-472 10-14 April 2007
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
20
Swiss National Center of Competence in Robotics Dario Floreano
1988 - MA in visual psychophysics at the University of Trieste
1992 - MSc in Neural Computation from the University of Stirling
1995 - PhD in Cognitive Systems and Robotics from the University of Trieste
2000 - awarded the first Swiss National Science Foundation professorship in bio-inspired robotics at EPFL
2005 - associate EPFL professor and established the Laboratory of Intelligent Systems
2011 - full EPFL professor and Director of the newly established Swiss National Center of Competence in
Robotics
Bibliography
SMA actuated Microglider looking for the Light
bullCapable of autonomous phototaxis
bullWingspan 24cm
bullLength 22cm
bullFlying at around 15msec
To reduce the weight it has a
02g SMA actuator
for rudder control that is
harmoniously integrated in the
airframe structure
Kovac M Guignard A Nicoud J-D Zufferey J-C and Floreano D
A 15g SMA-actuated Microglider looking for the Light
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2007) pp 367-372 (2007)
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
21
The AirBurr Robust Flight in Cluttered Indoor Environments
The goal
to study the physical interaction between indoor flying robots and the
environment The mechanical design of the AirBurr bullLight-weight materials and construction techniques bullAerodynamic constraints required for flight bullSlow speed and maneuverability bullRobustness to contact bullSelf-recovery after a collision
Klaptocz G Boutinard Rouelle A Briod J-C Zufferey and D Floreano
An Indoor Flying Platform with Collision Robustness and Self-Recovery
2010 IEEE International Conference on Robotics and Automation (ICRA 2010) Anchorage Alaska US 2010
The EPFL jumpglider A hybrid jumping and gliding robot with rigid or folding wings
Kovac Mirko Hraiz Wassim Fauria Torrent Oriol Zufferey Jean-Christophe Floreano Dario
IEEE International Conference on Robotics and Biomimetics (ROBIO) Phuket Thailand December 7-11 2011
Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) (2011)
A miniature robot that can prolong its jumps using steered hybrid jumping and gliding locomotion over varied terrain For example it can safely descend from elevated positions such as stairs and buildings and propagate on ground with small jumps
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
22
The octopus as a model
Soft Robotics
o The octopus has no rigid structures and it
can squeeze into small apertures
o The octopus peculiar muscular structure
(muscular hydrostat) provides it with high
strength (up to 40N) in grasping
o The octopus shows rich behaviour learning
capability memory
The octopus muscular hydrostat
Longitudinal muscles
Transverse muscles
Oblique muscles
Constant volume
during contractions
Muscular system as a
modifiable skeleton
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
23
New technologies and design principles
Achievements
Patent
OCTO-Prop Sucker STIFF-FLOP
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
24
Novel Design Principles and Technologies for a New Generation of High Dexterity Soft-bodied Robots Inspired by the Morphology and Behaviour of the Octopus
OCTOPUS (2009-2013)
The OCTOPUS Integrated Project has the objective of designing and developing an 8-arm robot inspired to the muscular structure neurophysiology and motor capabilities of the octopus (Octopus vulgaris)
wwwoctopus-
projecteu
Project Duration
48 months
Project Cost
9745000 euro
EC contribution
7600000 euro
7 partners from 5
countries
Coordinator SSSA
Project Number 231608 ICT-FET Proactive ICT-200785 Embodied Intelligence
Artificial Muscles the scientifictechnical problem
Current actuation technologies represent a real bottleneck in many robotic
applications especially in biomimetic ones
Biological muscle has some unique properties
bull High efficiency
bull High power density
bull High force density
bull Inherent compliance
bull Flexibility
bull Integrated self-sensing
bull Self-healing properties
Inspiration from biology is driving
the development of new generations
of actuators with the aim of matching
or outperforming natural muscle
M Zupan Adv Mat 2002
Main limitations inertia and back-drivability stiffness control power consumption
Mimicking of both ldquoactiverdquo and ldquopassiverdquo
muscle components
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
25
Strategies for artificial muscle development
Different technologies have been developed in the last decade to resemble
muscle performance
Shape memory alloys (SMA)
Pneumatic actuators
Electro-active polymers (EAP)
Dielectric elastomers
Ferroelectric polymers
Liquid crystal elastomers
Conducting polymers
Ionic polymermetal composites
ldquoArtificialrdquo approaches ldquoBio-hybridrdquo approaches
Whole explanted muscles
Recellularized muscle
extracellular matrix (ECM)
Self-organized muscle tissue
engineered in vitro
Elastomeric proteins-based
biomaterials (resembling passive
muscle components)
Protoypes and Publications (1)
Shape memory alloys
P Dario Sens Actuat 1989
D Grant Contr Syst Mag 1997
Y Tadesse J Mech Rob 2011
Pneumatic actuators
CP Chou Rob Autom 1994
B Hannaford Trans Rob Autom 1996
Dielectric elastomers
R Pelrine Proc SPIE 2002
M Cianchetti Sens Actuat B 2009
Ferroelectric polymers
ZY Cheng Sens Actuat A 2001
Conducting polymers
RH Baughman Synth Met 1996
McKeon-Fischer Polymer 2011
Liquid crystal elastomers
L Walter J Appl Phys 1999
CL Van Oosten Nat Mat 2009
M Winkler Macromol Symp 2010
Ionic polymermetal
composites
KJ Kim Polymer 2002
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
26
Protoypes and Publications (2)
Whole explanted muscles
RG Dennis Tissue Eng 2007
Recellularized muscle
extracellular matrix (ECM)
B Perniconi Biomaterials 2011
Self-organized muscle tissue
engineered in vitro
K Morishima Sens Actuat B 2006 AW Feinberg Science 2007
L Ricotti Biomed Microdev 2010
Elastomeric proteins-based
biomaterials (resembling
passive muscle components)
S Lv Nature 2010
The CLONS EU Project (CLOsed-loop Neural prostheses for vestibular
disorderS)
The goal of the CLONS proposal is to develop an innovative closed-loop sensory neural prosthesis to restore vestibular information by stimulating the semicircular canals thanks to the information provided by inertial sensors embedded in a device attached to the head and donned by the user
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
27
State of the art of prosthetic hands
Passive Cosmetic Prosthetic Hands
Active Body Powered Prostheses
Myoelectric Prostheses
Hybrid (myoelectric
elbow and body-
powered hand)
Task Oriented
(designed for specific
tasks)
Trend of neurocontrolled artificial limbs
EMG control
(Graupe 1978 hellip)
Targeted Muscle Reinnervation
(Kuiken 2007)
Implantable intraneural interfaces
(Hoch Micera 2006-)
Neural prostheses will tend to their ideal use ndash the natural neural pathway will be restored to take
advantage of the existingremaining neural
connection
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
28
Extraction of
brain commands
from the motor
nerves
Stimulation of
the sensory
nerves to
provide a
sensory
feedback
The dexterous
prosthesis is re-
connected directly to
the nervous system
LIFE electrodes with a transcutaneous connection
Scheme of the short-term implant
of the CYBERHAND system
CYBERHAND prosthesis
Electronics for recording and stimulation (outside the body of the subject)
Efferent processing control afferent stimulation (on a PC platform)
Collaboration between Scuola Superiore SantrsquoAnna
Campus Biomedico University Fraunhofer Inst Biomed Eng
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
29
Decoding of motor information
results
Micera et al Proc IEEE 2010
bull More channels make a
difference
bull Decoding grasping is
possible
bull Learning is also possible
To evaluate whether it is possible to alter the perceived magnitude
of these sensations a psychometric scaling task has been used
Subject has been asked to assign an open-ended number to the
magnitude of the elicited sensation for each stimulus presentation
We have been able to elicit sensory information in the subject
(mainly tactile information) but only for the first ten days
Protocol for the experiments on sensory
feedback
Rossini Micera et al Clin Neuroph 2010
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
30
What we learnt from these
experiments
Decoding grasping information and
delivering sensory feedback is possible
However a more selective and
effective neural interface must be
developed
Next year the first bidirectional
implant for the online control of
a dexterous hand prosthesis
will be tested
Real-time
decoding of motor
commands and
control of the
prosthesis
Afferent nerve
stimulation to
deliver sensory
feedback
TIME real-time
bidirectional implant
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
31
NEUROBike design and development
Design and Development by Scuola Superiore SantAnna Pisa and Fondazione Instituto San RaffaeleG Giglio Cefalugrave (PA) Sponsored by Fondazione CaRiPisa Pisa
NEUROBike is a movable and versatile robotic platform for lower limb rehabilitation of bedridden patients affected by stroke
NEUROBike basic idea
3 DoF Leg in the sagittal plane managed by control of position and orientation of the foot
NEUROBike design and development
1st part foot manipulator
2nd part walls
3rd part knee wrappers
4th part hip support
XY manipulator 2 5 linear guides 1 4 motors 3 6 saddles 7 constraining linear guide
Foot device
Walls Knee wrappers Hip support
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
32
NEUROBike evaluation of performance on healthy subjects
Test with a physiatrist
Monaco Micera et al 2009
Falling definition
ldquohellip vertical line [hellip] comes to lie beyond the support base and corrections do not take place in timehelliprdquo [Isaacs et coll 1985]
ldquohellip to rest unintentionally on the ground not as a result of a major intrinsic event (such a stroke)helliprdquo [Tinetti 1988]
ldquohellip unintentionally coming to rest on the groundhelliprdquo [Ory et coll 1995]
ldquohellip unintentionally coming to rest on the ground unless stumbleshelliprdquo [Wolf et coll 1996]
ldquohellip unexpected descendent from an upright sitting or horizontal positionhelliprdquo [WHO 1977]
Classification
bull UNEXPECTED bull DOES NOT DEPEND ON INTRINSIC IMPAIRMENTS
bull DIFFICULT TO DEFINE UNIVOCALLY
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
33
Falling in elderly people
Common 30 of adults over 65 experience at least a fall each year
Significant consequences
Traumatic
Slight damage (50 ) serious (6 ) fracture (5)
First cause of accidental death
Reduction of mobility and quality of life
Acceleration of functional decline
Psychological
lost of safety fear of falling depression
They occur during activity of daily life at home 60 due to slipping and tripping
Due to both ageing and enviroment factors reduction of ability to recover balance and increase of falling risk
Increasing of the mean age population social and health care problem
Need to prevent falling and correlate damage
2 independently controlled parallel treadmills (4 engines)
Each one can move in longitudinal and transverse directions
Perturbation can be applied in all direction with sudden movement of one or both treadmills
Ground reaction forces measurement allows precise disturbance triggered moments of the cycle of step (procedure highly repeatable)
SENLY
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
34
SENLY-Fall risk detection
Current work
Identify incipient falling
Mitigation of fall effects
Wearable device
Based on inertial sensors located around waist
Adopts threshold based algorithm
Complex design
Reliability and tolerance
Is it possible to partially compensate ldquoageingrdquo in order to reduce fall risk by means of smart and wearable
devices
Martelli Micera et al submitted
SENLY
The long term view
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
35
Biorobotics Engineering
Diagnosis and rehabilitation in infancy do it earlier make it better
bull It is estimated that overall between 500 and 650 million people worldwide live with a significant impairment
bull According to the World Health Organisation (WHO) around 10 of the children and young people in the world about 200 million have sensory intellectual or mental health impairment
bull High costs for the Healthcare system [eg the average lifetime cost of CP was calculated to be 860 000euro for men and 800 000euro for women (Kruse et al 2009)]
Early diagnosis Early intervention (re-habilitation)
High-quality personalized care
Reduced hospitalization
rate and improved disease
management
Reduced costs for the entire
Healthcare system
ICT
ICT tools for early diagnosis
Rehabilitation robotics Robots for cognitive diseases (eg ASD)
Mechatronic devices for motor rehabilitation
Potential impact
Developmental bioengineering
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
36
Developmental bioengineering our history
2006 TACT project (FP6)
2008 Collaboration with Fondazione Stella Maris
2010 MechTOY project (Tuscan Region)
2011 CareToy project (FP7)
Collaboration with industrial partners Sensorized gym for early diagnosis of hemiplegia
Sensorized toys for early diagnosis of Autism Spectrum Disorders
CareToy A Modular Smart System for Infantsrsquo Rehabilitation
At Home based on Mechatronic Toys
FP7-ICT-2011-7 ICT-201151
Aim to promote early intervention in the first year of life and to reinforce therapy by ldquoCareToyrdquo
a portable low cost smart system telemonitored thus augmenting the clinical effectiveness of the
therapy while reducing the cost for the Healthcare Systems
Maximum financial EC contribution 229300000 euro
Duration of the project 36 Months
Starting date November 1st 2011
Expected results
1 The CareToy system will be able to extract fundamental parameters during infantsrsquo rehabilitation therapy
2 Validate the system as a tool for early intervention of preterm infants with brain injuries such as perinatal stroke
3 Plans for exploitation specific ideas and purposive plans for industrialization will emerge
Developmental bioengineering results and future programs
Research
Exploitation
Toys for infancy
Educational Robotics
Some data
N of projects 4
N of papers 5
Clinical partners 5
Industrial partners 3
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
37
Traditional Stiff and Single-DoF Prostheses
hellipSince 70s
Ottobock LTI Motion Control
RSL Kesheng hellipetc
1-2 DoFs
Reliable
100N power grasp
600g
Precision grasps
[1] wwwottobockuscom wwwutaharmcom wwwliberatingtechnologiescom [online]
[2] MC Carrozza B Massa S Micera R Lazzarini M Zecca P Dario The Development of a Novel Prosthetic Hand - Ongoing Research and Preliminary Results
IEEEASME Transactions on Mechatronics vol 7 n 2 Pages 108-114 June 2002
[3] D H Silcox et al ldquoMyoelectric prostheses A long-term follow-up and a study of the use of alternate prosthesesrdquo J Bone Joint Surg vol 75 no 12 pp 1781ndash1789 1993
bull low functionality Difficult to obtain power grasps due to the low number of contact points during a grasp ie unstable grasps
bull low cosmetics Both static and dynamic properties
bull low controllability No feedback delivered to amputee Not felt as part of their body
30 to 50 do not use their prosthesis regularly
The loss of the upper limb is a traumatic event
that changes the quality of life radically
Actual prostheses are very
different from the natural model
Contact christianciprianisssupit
Dexterous and sensorised FOR ldquoneural intarfacingrdquo
1 Low-Level Control
2 Feedback Delivery Allow natural control
Bidirectional
Large bandwidth
Efference
Afference
Neural Interface Position Touch Pressure [1]
Non-Invasive Interface Touch Temperature Pressure [2]
[1] G S Dhillon and K W Horch ldquoDirect Neural Sensory Feedback and Control of a Prosthetic Armrdquo IEEE TNSRE vol 13 no4 pp 468-472 Dec 2005
[2] T A Kuiken P D Marasco B A Lock R N Harden and J P A Dewald ldquoRedirection of cutaneous sensation from the hand to the chest skin of human
amputees with targeted reinnervationrdquo PNAS vol 104 no 50 pp 20061-20066 2007
Dexterous and
Sensory equipped
Biomechatronic
hand
Neural
electrodes
Implantable system
for neural
stimulation and
recording
Telemetric link
for efferent and
afferent signals Patients intentions
decoding cognitive
feedback delivery and
control unit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
38
Next
(ongoing) Achievementshellip
Non-invasive interface Clinical ev (8 patients) -Lund University Sweden
Recent publications (last 5 years)
bull ~30 papers on ISI journals or IEEE Conf
Current active projects
bull 2 EU FP7
bull 2 National (Ministry of Research)
Current total funding ~15 Meuro
2011 IH2 Azzurra hand
2009 Spin-off company
16 DoF 4 Motors
40 Sensors
SmartHand Prototype (2009)
16 DoF 5 Motors
24 Sensors 500gr
Bioinspired finger design
Contact christianciprianisssupit
Aer-O-Scope Invendotrade endoscope Endotics
Wireless Endoscopic Capsule
Biorobotics Engineering scientific problem
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
39
Capsule shell
26mm in length and
11mm in diameter less
than the commercial
PillCam Colon (11mm
31mm)
Operating channel
air and water injection and endoscopic tools
introduction for therapeutic and surgical procedures
Video module
color VGA
camera and 4
light emitted
diodes (LED)
Hall-effect sensor
on-board magnetic
field sensor that
provides real-time
clues about the
magnetic link
strength
Washing system
injection of water
for the glass
cleaning from a
dedicated channel
and nozzle
Biorobotics Engineering methodological approach
Biorobotics Engineering in-vitro ex-vivo and in-vivo
experimental study
Grasping forceps Biopsy forceps Retrieval basket
Ex-vivo test In-vivo test
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
40
EAES conference
19th International congress of European
association for endoscopy surgery
June 15-18TH 2011
Turin - Italy
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino
P Valdastri G Ciuti A Verbeni A Menciassi P Dario A Arezzo M Morino Magnetic
air capsule robotic system Proof of concept of a novel approach for painless colonoscopy
Surgical Endoscopy submitted
Biorobotics Engineering Robotics Surgery
Robots for surgery and diagnostics should be increasingly safe reliable accurate minimally invasive and affordable for the healthcare system
CHALLENGES
From external robots to endoluminal robots
The quest for miniaturization integrating robotics and nanomedicine
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
41
Case study - Developing a novel reconfigurable robotic system for endoluminal surgery
Case study - Developing a novel bimanual dexterous robotic system for NOTES and single port surgery
Case study - Developing a novel miniaturized robotic system for diagnosis and treatment of vascular diseases
Developing a novel reconfigurable robotic
system for endoluminal surgery
Case study
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
42
From one to many capsules - RECONFIGURABLE robots for the exploration of the human body
Φ154 X 363 56 g 2 DOF
plusmn90 deg
Motors
Battery
Control Board
360 deg
1 Swallowing
the capsules 2 Passing through the esophagus
3 Assembly in the stomach
4 Diagnosis Intervention in the stomach
Target area
Operation
5 Reconfiguration for passing the pyloric sphincter
Prototyping of a robotic module
Camera
Biopsy forceps
Tissue Storage
ARES project European Commision FP7
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
43
Developing a novel bimanual dexterous robotic system for
NOTES and single port surgery
Case study
Common mechanical problems for intra-abdominal robots
bull Motion transmission to the joints of the robot (eg cable pneumatic actuation on-board electromagnetic motors) bull Power requirement bull Miniaturization of the mechanisms bull How to make easy to change tools on the end effectors of the robotic structure bull Cleaning and sterilization
Advantages of on-board actuation bull Wide working space bull High stiffness respect to external later forces bull Possibility of Roll motion of the tip (suturing positioning orientation of the tool) bull High dexterity
Shoulder Elbow
Wrist
on-board actuation
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
44
bull 6 DOFs plus the gripper are internal for each arm 14 internal DOFs in total
bull After positioning the robot no external DOFs are needed Bulky external robots can be avoided using a simple positioner Short preparation time
SPRINT-v01 robot first prototype
International patent WO2011135503A1 Robotic apparatus for minimally invasive surgery
Piccigallo er al ldquoDesign of a Novel Bimanual Robotic System for Single-Port Laparoscopyrdquo IEEEASME TRANSACTIONS ON MECHATRONICS VOL 15(6) 2010
Petroni et al ldquo A novel robotic system for single-port laparoscopyrdquo EAES Conference 2011
SPRINT System simulated pick and place tasks
SPRINT System simulated suturing tasks
SPRINT-v01 robot first prototype
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
45
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
20
40
60
80
100
120
Pegs Mean Transfer Time
peg
me
an
tim
e (
s)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
10
20
30
40
50
60
Percentage of pegs lost
peg
o
f p
eg
s lo
st
Robot Characterization Peg transfer task
Learning Curves Task repeated two times
SURGEON Background 1 2 3 4 5 6
AGE 46 49 37 51 70 47
SPECIALIZATION General Surgery
Urology
General Surgery
General Surgery
Laparoscopic Surgery
Gynecology
OF YEARS OF EXPERIENCE 21 20 12 25 gt30 20
EXPERIENCE WITH ROBOTIC ASSISTED LAPAROSCOPY
YES YES YES YES YES YES
EXPERIENCE IN SINGLE PORT LAPAROSCOPY
YES NO YES YES YES YES
Robot Characterization Suturing task
Petroni et al ldquoA novel robotic system for single-port laparoscopic surgeryrdquo Surgical Endoscopy submitted Niccolini et al ldquoReal-Time Control Architecture of a Novel Single-Port lapaRoscopy bimaNual roboT (SPRINT) ICRA conference 2012 submitted ARAKNES project ndash wwwaraknesorg
Treating Brain Diseases by means of Endoscopic Microrobotic Solutions
Extremely high-impact pathologies
Brain tumors
148 new cases per 100000 inhabitantsyear (USA)
Alzheimer 266 million sufferers worldwide
Parkinson 8-18 new cases per 100000 personsyear
Neurosurgery
Radiotherapy
Chemotherapy Drug therapy
Invasiveness (craniotomy)
Systemic side effects
Systemic side effects high dose
Drawbacks Current treatments
Drawbacks of current solutions endoscopes are typically rigid many portions of the CNS (eg ventricular horns and most CNS boundaries) are difficult to reach + risk to damage CNS tissue
Quest for a flexible yet controllable (dexterous) probe
(to be framed within a CAS platform)
CNS = Central
Nervous System
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
46
Past Expertise miniature tool for endoscopy in the spinal cord (neuro-endoscopy)
bull Application (eg drug release) in the sub-arachnoid space (SAS having a few mm caliber)
bull Teleoperated system navigation by automatic segmentation bull Actuated catheter steering by flexure joints (fabricated via
Graded Material Technology and Injection Molding) + servo-assisted actuation + fluidic navigation system
bull Real-scale spine model (after reconstruction from medical images)
bull In vivo experiments in pigs in (Ozzano Bologna) successful endoscopy of the whole spinal cord from lumbar access up to cervical tract with direct nerve stimulation through endoluminal electrode
Application diagnosis and therapy (biopsy surgery DBS) in the CNS ventricular domain
Kuka LWR arm 7 DoFs mass 15kg (suitable for SOR integration)
CAS framework for a neurosurgical dexterous probe for application in the brain (ongoing development)
Preliminary control tasks for the LWR arm which will support the probe module (end-effector)
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
47
Processing module Pre-operative data
(MRI data) VHD PHD
MRI Scanner NA 3 T
Images type 2D 3D
Images view Axial AxialCoronal Sagittal
Resolution Image 256 x 256 256 x 256
Slice thickness 4 mm 1 mm
Spacing between scans 1 mm 06 mm
Pre-operative imaging 3D reconstruction (Amira sw)
Ultimate goal to operate into the lateral ventricles up to the corners (beyond current capabilities)
Reconstruction also used for fluid-structure interaction modeling
CAS framework for the neurosurgical dexterous probe processing module (ongoing development)
Neurosurgical dexterous probe (ongoing development)
bull morphometrical characterization of the ventricular system (by image processing) definition of the main geometrical constraints (eg curvatures hellip ) Targeted probe diameter around 2 mm (dictated by caliber of Sylvius aqueduct)
bull design of a master-slave system for probe (slave) operation also including a user-interface (integrating sensory -eg visual- feedback)
bull definition of actuation strategies for the (theoretically infinite practically Ngt6-8) probe internal DoFs Definition of on-board sensing capabilitiescomponents
bull development of control strategies (at both arm and probe level) for motion compensation
bull System manufacturing also exploiting (as for probe) micro-fabrication technologiesplatforms available SSSA
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
48
Developing a novel miniaturized robotic
system for diagnosis and treatment of vascular
diseases
Case study
A possible approach to intraluminal navigation
hellipshrinking a centimeter-size capsule down to millimeter-size to approach different sites within the human body (eg vascular system or the spine or the brain vessels)hellip
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
49
years
en
do
lum
ina
l ro
bo
ts s
ize
10 cm
1 cm
1 mm
Millimetric robot
for vascular
diagnosis and
therapy
Micromechanical and microelectronic
systems integrated into the milli-shuttle
can provide for
bulldrug delivery
bullplaque destruction
bullMicro-stenting
bulletc
Additional therapyimaging can be
provided by the help of external energy hellip
1995 2000 2010 2005
Cardiovascular disease is the leading cause of death in industrialized countries (19 million deaths in the European Union) Just by considering Italy approximately 70000 angioplasty interventions are yearly performed (wwweatlasidforgcvd)
Scientific Problems
Main Goal
Within this group coronary heart disease (CHD) is a major cause of death mainly due to atherosclerotic plaque rupture accounts for the largest part
More than 50 of plaque ruptures occur without significantly observable stenosis Identification of relevant anatomical structure and definitive therapy for atherosclerotic lesion is still far from being achieved
hellip to develop novel diagnostic and therapeutic procedures in the vascular
system by exploiting micronano-system technologies integrated in robotic
platforms for usable clinical applications
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
50
Surgeon
US Visual Interface
Control Unit
External Robotic Platform
Intravascular Robotic Device
Magnetic Link
Patient
Processing Unit
Pre-operative Data
Intra-operative Data
Pre-operative Imaging
Virtual Path
Localization System
US Imaging Data
The Platform
Trad
itio
nal C
AS
arch
itectu
re
Magnetic dragging and US tracking (intra-operative)
Imaging and locomotion
Intra-operative data coming from the US localization system for ultrasound-based servoing
control
Ultrasounds can be adequate for effective and safe localization and
tracking of an endovascular device combining an adequate resolution with minimal adverse health effects high speed and acceptable frame rates
Robotic-aided magnetic navigation
Ultrasound (US) imaging
Externally applied magnetic fields that control movement and position of magnetically tipped instruments
External permanent magnet (EPM) attached to the end-effector of a 6 DoFs
robotic arm Miniaturized capsule (diameter of 5 mm 106 mm in length) with 6 disk-shaped
internal permanent magnets (IPM)
US PROBE
EPM
IPM
Tognarelli et al ldquoPlatform for Magnetic Propulsion and Ultrasound Tracking of Endovascular Devicesrdquo Journal of Robotic Surgery accepted
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
51
Magnetic guidance of miniaturized devices within pulsatile flows
First tests with the EVE simulator magnetic dragging (by a robotic arm) of a capsule-like prototype
within a pulsatile flow
Vascular MicroRobot Test Bench EVE Endovascular Simulation System
MicroVAST project ndash wwwmicrovastit
DustBot e post-DustBot
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
52
DustBot from a project to a product
DustBot system
develop
DustBot demon-strations
DustBot Deep Demo
Extensive testing
(gt 3 months)
of the real service
in real environments
with real end users
under the supervision
of real customers
Industrial develop
market
DustBot Project
Venture Capital
DustBot Exploitation Plan
bottleneck Laws
Regulations Insurance
DustBot End-user analysis
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
53
Ethical Legal and Social issues (ELS)
bull To advance knowledge in the field of Robotics taking into account the ethical legal and social (ELS) implications emerging from the interactions between robots and human beings and the natural environment ndash Ethics to identify and address the ethical problems brought about by
robotics research and applications such as military robots and the right to kill human beings restoring vs augmenting human capabilities in bionics controlling biological systems by artificial stimulation
ndash Law to investigate the main challenges brought about by robotics in the legal realm Among the main open issues are the legal status of autonomous robots liability in case of damages regulation of learning capabilities insurance safety standards
ndash Social to explore the consequences of robotics deployment in society at large by identifying social resistance attitudes and the social and psychological impact on human beings resulting from interaction with autonomous human-like robots endowed with social and emotional capabilities
Main achievements in roboethics activities
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
54
The ROBOETHICS Symposium aims to open a debate among scientists and scholars of Sciences and Humanities with the participation of people of goodwill about the ethical basis which should inspire the design and
development of robots The Symposium is an opportunity to encounter scientists and scholars committed to discuss new and sensitive
problems that humankind is glimpsing at the horizon Philosophers jurists sociologists anthropologist and moralists together with robotic scientists are called to contribute to lay the fundations of the Ethics in the design development and employment of the Intelligent
Machines the Roboethics For this reasons the Distinguished Speakers will report their experience in a general way with a special focus on the
social and ethical problems they are identifying in their fields
First International Symposium on
ROBOETHICS The ethics social humanitarian and ecological aspects of Robotics
30th - 31th January 2004 Villa Nobel Sanremo Italy
Program Commitee Paolo DARIO Joseacute M GALVAacuteN Fiorella OPERTO Jovan PATRNOGIC Gianmarco VERUGGIO
Organiser
Scuola di Robotica
Co-Organisers ARTS-Lab Scuola Superiore SantAnna Pisa Italy
International Institute of Humanitarian Law School of Theology Pontifical University of the Holy Cross Rome Italy
Main publications in ELS topics
bull Salvini P Teti G Spadoni E Laschi C Mazzolai B Dario P Peccioli The Testing Site for the Robot DustCart Focus on social and legal challenges IEEE Robotics and Automation Magazine Special Issue on Roboethics Vol18 Issue 1 March 2011
bull Salvini P Laschi C Dario P Design for Acceptability Improving Robotsrsquo Coexistence in Human Society International Journal of Social Robotics Volume 2 Issue 4 2010
bull Salvini P Teti G Spadoni E Frediani E Boccalatte S Nocco L Mazzolai B Laschi C Comandeacute G Rossi E Carrozza P Dario PAn Investigation on Legal Regulations for Robot Deployment in Urban Areas A Focus on Italian Law Advanced Robotics 24 (2010)
bull Salvini P Datteri E Laschi C Dario P Scientific models and ethical issues in hybrid bionic systems research AI and Society Vol 22 No 3 2008
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
55
Other achievements
The RoboLaw EU funded project ndash Programme ldquoCapacitiesldquo - Call ID ldquoFP7-SCIENCE-IN-SOCIETY-2011-1rdquo
Topic SiS2011111-3 Regulating emerging scientific and technological developments
ndash EU Financial Contribution 1497966 EUR ndash Start date March 2012 ndash Duration 24 Months ndash Consortium 1 Scuola Superiore SantrsquoAnna Pisa Italy (Coordinator) 2
Tilburg University the Netherlands 3 University of Reading School of Systems Engineering United Kingdom 4 University of Humboldt Department of Philosophy Germany
ndash Objective to understand how emerging robotic technologies in the field of biomedical research will make the setting of hard and soft laws even more sensitive in the coming years by generating new ethical legal and safety implications such as human enhancement and human teleoperation or affecting already known issues such as surveillance privacy and dual-use
Educational Robotics
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
56
Il nostro obiettivo educare lrsquoingegnere del
XXI secolo
Il nostro modello dellrsquoingegnere inventore
Un nuovo ingegnere capace di governare i cambiamenti e le opportunitagrave per la Societagrave e per lrsquoIndustria
Il metodo coinvolgere i giovani in grandi sfide progetti di ricerca di frontiera e nuove opportunitagrave
Il nostro modello dellrsquoingegnere inventore
Micro-robot per esplorare il corpo umano Robot Umanoidi
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
57
Il nostro ldquolabrdquohellip
hellipcome una bottega rinascimentale
dove decine di studenti di dottorato
imparano come si fa la ricercahellip
Il nostro modello dellrsquoingegnere
inventore
Lrsquoinnovazione ldquodisruptiverdquo
(ldquoradicalerdquo) la fanno gli
innovatori (non le macchine)
Ersquo quindi fondamentale
formare innovatori
Lrsquoassunto di partenza
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
58
Se lrsquouniversitagrave egrave il motore con cui viene generata la conoscenza il ldquocarburanterdquo sono i giovani innovatori attraverso cui egrave possibile valorizzare i risultati prodotti dalla conoscenza portando ricchezza sul territorio
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
Oggi lrsquoingegneria egrave sempre piugrave collegata alla scienza
In molte nuove aree lrsquoidentificazione tra possibili funzioni di prodotto e servizi egrave impensabile senza una profonda comprensione delle proprietagrave fisiche (chimiche biochimiche) della materia
Allo stesso tempo in tali aree la conoscenza scientifica egrave essa stessa il risultato di sofisticati principi ingegneristici
Ingegneria e scienza sono strettamente interconnesse
Esempi Micromeccanica Scienze dei materiali Nanotecnologie Ingegneria biomedica Semiconduttori
Lrsquoesperienza del PSV come ldquoComunitagrave educanterdquo
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
59
Il modello dellrsquoingegneria guidata dalla scienza richiede alta creativitagrave e capacitagrave di problem solving
Ciograve non va in contrasto con i tradizionali metodi di educazione dellrsquoingegnere focalizzati su criteri di ottimizzazione e sullrsquoefficienza tecnica dati tutti i requisiti di un problema tecnologico
Ciograve di cui crsquoegrave bisogno egrave un ingegnere capace di risolvere problemi mal posti piuttosto che problemi ben strutturati
Il nostro modello dellrsquoingegnere inventore
Karl Popper ha scritto che tutti gli sforzi tesi a classificare e a distinguere le discipline costituiscono una questione relativamente priva di importanza e superficiale Noi non siamo studiosi di certe materie bensigrave di PROBLEMI
Engineering Education at MIT (IEEE Spectrum 1995)
ldquoOrganizzatori di Creativitagraverdquo
Il nostro modello dellrsquoingegnere inventore
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
60
bull Inter-disciplinarietagrave fra discipline tecniche e trans-disciplinarietagrave fra lrsquoingegneria le scienze della vita e le scienze sociali e umane
bull Educazione alla visione globale dei problemi combinata con una formazione in profonditagrave
bull Capacitagrave di formulare un ldquopensiero sistemisticordquo
bull Spirito imprenditoriale bull Forte competenza e attenzione ai
problemi sociali
Il nostro modello dellrsquoingegnere inventore
Un modello europeo per lrsquoeducazione del nuovo ingegnere
bull Elevata competenza tecnica
bull Capacitagrave di innovazione (adattabilitagrave flessibilitagrave creativitagrave coraggio hellip)
bull Capacitagrave di risolvere problemi
bull Capacitagrave di lavorare in gruppo
bull Apertura mentale e capacitagrave di dialogo con differenti discipline
Le qualitagrave dellrsquoingegnere ldquorinascimentalerdquo secondo il modello americano (MIT e Stanford)
Il nostro modello dellrsquoingegnere inventore
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
61
Lrsquoobiettivo
bull Educatore giovani ricercatori con forti competenze ed il potenziale di leader ndash in un ambiente stimolante e multidisciplinare ndash sia attraverso corsi di alto livello sia attraverso
un lavoro di ricerca creativo e originale ndash sviluppato in laboratori molto ben attrezzati
per sviluppare attivitagrave in settori quali la bio-robotica le micro- e nano-tecnologie la biomimetica etc
ndash In lavoro di gruppo e con la guida di supervisori a tempo pieno altamente qualificati
Il nostro modello dellrsquoingegnere inventore
LrsquoInnovazione egrave cruciale al benessere umano (basta guardare la storia)
LrsquoInnovazione richiede Innovatori Chi sono gli Innovatori Come possiamo selezionare e allevare gli
innovatori
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
62
Il nostro modello dellrsquoingegnere inventore
Non tutti gli individui sono Innovatori Gli Innovatori sono persone speciali che
sentono insoddisfazione e lrsquoesigenza di migliorare e cambiare la loro situazione attuale (nel lavoro come nella societagrave e cosigrave anche per la conoscenza scientifica)
Gli Innovatori are a sono ldquoribelli organizzatirdquo
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
La maggior parte degli ingegneri dovrebbero essere Innovatori (ldquogli scienziati scoprono gli ingegneri inventanordquo)
I giovani dovrebbero sognare di diventare Innovatori ed eccellere e distinguersi per le loro Innovazioni
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
63
helliplrsquoIngegnere del 21-mo secolo
Il nostro modello dellrsquoingegnere inventore
bull Per fare questo occorrono
ndash solide competenze di base (scientifiche ed ingegneristiche)
ndash la capacitagrave di concepire e realizzare nuovi e originali progetti di ricerca
ndash ed un autonomo spirito imprenditoriale
Innovazione e Innovatori
Il nostro modello dellrsquoingegnere inventore
Innovazione e Innovatori
Allevare gli Innovatori egrave fondamentale per il progresso dellrsquoumanitagrave ed in particolare egrave strategico per la competitivitagrave dei Paesi sviluppati
Il primo problema egrave come educare e formare i potenziali Innovatori
Il secondo problema per la societagrave lrsquoindustria e le varie differenti organizzazioni egrave come trarre vantaggio dal talento e dalle qualitagrave degli Innovatori incoraggiandoli opportunamente nella loro volontagrave di guidare il cambiamento
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
64
Educare i giovani ricercatori attraverso
GRANDI SFIDE
Il nostro modello dellrsquoingegnere inventore
Sognatori e Leader
Coltiva i tuoi sogni
Sii un sognatore ma sii concreto
Sii un leader e convinci chi ti sta attorno a condividere i tuoi sogni
Raggiungi i risultati e possibilmente
Condividi tali risultati con gli altri (utili soluzioni al miglioramento della qualitagrave della vita) e rendili economicamente vantaggiosi (nuovi prodotti industriali e nuove opportunitagrave di lavoro)
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
65
Primary Education (3-14 years)
Product
specifications
Design
Factory
organization
management
Product
Mark
et
Problem
(curiosity and
creativity
driven)
Modelling
discovery
Invention
Prototypes
experiments
Specifications
Pre-school (3-6 years old)
bull Introduction to robotics
bull Robot as interactive games
Elementary (6-11 years old)
bull What is a robot
bull The robots already among us
bull Manual activities
bull Contest robot design or project
Secondary schools (11-14 years old)
bull Introduction to robotics
bull Experimental activities using robotic kits
bull Robot contests
Secondary Education
(14-19 years)
(14-19 years old)
Advanced interdisciplinary course on robotics (Sciences Technologies and Humanities)
bull History
bull Philosophy
bull Language and Linguistics
bull Art
bull Biology
bull Sciences
Involvement of childrenteenagers form 3 to 19 years old
Completing the education of the new
engineer of the XXI Century a
scientist an inventor an entrepreneur
Educational Robotics Educational activities since the 1990s
The BioRobotics Institute approach to educational activities
Robotic contestICAR rsquo91 Pisa Italy 1991
LDT in Pontedera (PI) Italy 2011
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
66
Educational Robotics La Scuola SantrsquoAnna sul territorio
Piscina comunale_Pontedera
Piscina comunale_Pontedera
Ecce Robot_Pisa
Settembre Pedagogico_Pisa
Main results and publications
bull Foundation of the Local Educational Laboratory on Robotics (LELR) ndash In collaboration with the local schools and the municipalities of the Valdera area in
Tuscany (Italy) the LELR strives to foster the development of scientific and technological knowledge in the Valdera community starting from school level (from primary education onwards) Furthermore robotics is considered as Robotics as a strategic tool to promote development in industry and services in the area
bull Main publications and presentations ndash Salvini P Macrigrave G Cecchi F Orofino S Coppedegrave S Sacchini S Guiggi P Spadoni E
Dario PTeaching with minirobots The Local Educational Laboratory on Robotics Proceedings of the 6th International Symposium on Autonomous Minirobots for Research and Edutainment (AMiRE) 23-25 May Bielefeld Germany 2011
ndash P Dario F Cecchi P Salvini lsquoThe ldquoLocal Educational Laboratory on Roboticsrdquo methodology and results on teaching with robotsrsquo 2011 IEEE International Conference on Robotics and Automation Forth Workshop on Roboethics (ICRA) May 13 Shanghai China 2011
ndash P Salvini lsquoRobotics and Education The ldquoEducational Laboratory on Roboticsrdquo SSSArsquo Italy-Japan Workshop on lsquoRobotics Education Tokyo Japan December 4 2010
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
67
Permanent Robot Exhibition
bull Directors Paolo Dario and Mario Zen
bull Coordianaion Evelina Dario Giorgio Leonardelli Pericle Salvini Claudio Visintainer
bull Catalogue and staging Roberto Festi
bull Quantity of material presented 220250 pieces (estimation)
bull Exposition space 800900m2
In collaboration with
The
BioRobotics
Institute
Spin-off Companies at SSSA
Number of Active Companies 27 (1991-2011) (20 from PSV Labs) Product versus Services 252 Employers 178
Areas ICT 7
Electronics (ElectronicsSensors) 5
Biomedical Instruments 4
Mechatronics
3
EnvironmentEnergy 2
Robotics
3
Optoelectronics
1
Domotics
1
Consultancy- Due Diligence
1
2
Pisa19
2
1
2
1
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
68
The
BioRobotics
Institute
Scientia
Machina
le srl
1991
HUMANWARE
srl
IDEA
srl
1994
PRAGMA
srl
1995
SYNAPSIS
srl
1996
ICUBE
srl
1997
TechnoDeal
srl
2000
DOMOTICA 2000
srl
MicroTech srl
AEDIT
srl
2001
VR Media
srl
2002
EVIDENCE
srl
AMIC
srl
2003
ENCREA
srl
2004
ERA
ENDOSCOPY
srl
DEDALO
srl
PhoTrix
srl
2005 2006
ROBOTECH
srl
MEDEA
srl
ERGO
srl
MINT Publishing
srl
Henesis
srl
FST
srl
FiberSens
srl
2007
2008
Fastenica
WIN
Prensilia
2009 2010
REKNO
Robotics
KIWI
Robotics
- Micromechatronics
- Nanotechnologies
- Bioengineering
- Robotics
- Photonics
- Environment
- Software Engineering
New Spin Off Companies 31 Total employees 178 Total revenues (2010)
8327 K
ASIDEV
HUMANOT
2011
20 Spin Off Companies created by the BRI researchers
2009
WIN Srl (Pisa)
httpwwwwinmedit
Research area Electronics
To create world class wireless medical systems based on cutting-
edge technologies for the wellbeing of the third millenium mankind
18
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
69
20 Spin Off Companies created by the BRI researchers
2009
Prensilia Srl (Pisa)
httpwwwprensiliacom
Research area Robotics
Prensilia designs customizes and manufactures advanced anthropomorphic under-
actuated robotic hands endowed with embedded actuation sensory and control
systems that can be exploited in research as advanced hand prostheses end effectors
for humanoid robots for rehabilitation andor neuroscientific experiments in general in
all research fields where it is important to have an artificial hand that behaves as a
natural one
19
0
5
10
15
20
25
30
SSSA BRI
31
20 (645)
Spin Off Companies
0
20
40
60
80
100
120
140
160
SSSA BRI
178 128
(80)
Employees (N)
7000000
7200000
7400000
7600000
7800000
8000000
8200000
8400000
SSSA BRI
8327000
7462000 (896)
Revenue (euro)
20 2011
HUMANOT (Firenze)
Robotica umanoide
Alcuni di noihellip
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit
2282012
70
STAY HUNGRY STAY FOOLISH
Steve Jobs
Il vostro dovere egrave non accontentarvi e pensare limpossibile
Ma egrave anche quello di mettere i
vostri talenti a disposizione dei
meno bravi e fortunati
Paolo Dario
Grazie per lrsquoattenzione Paolo Dario
Direttore Polo SantAnna Valdera -
Scuola Superiore SantAnna Viale
Rinaldo Piaggio 34 ndash 56025 -
Pontedera (Pisa)
Tel +39050883420102
Mobile +393488863117
Fax +39050883497
emailpaolodariosssupit