Rehabilitation and prosthetics

Limb rehabilitation and prosthetics are paramount applications of the techniques developed in biomimetic robotics. We focus upon human-computer interfaces to aid the disabled regain the lost limb functionality. In our view, both rehabilitation and prosthetics rely on re-establishing the sensori-motor loop with the missing limb. This includes both ways: feed-forward control by detecting the patient’s will to move and sensorial feedback by transducing digital readings to feelings.

In particular, we study the use of surface electromyography (sEMG) to detect the intention and force of movement of the patient, either amputated or left with lesser muscle functionality, such as hit by stroke or nerve-degenerative conditions. At the same time, we investigate innovative ways of delivering sensorial feedback such as impedance-controlled mechatronic devices and the direct application of force to the stump.

1. THE FEED-FORWARD PATH. To interpret the patient’s (residual) muscle commands and translate them to a realistic feed-forward control signal for a hand proxy, either a mechanical hand or a graphic model:

  • building a new generation of sEMG electrodes: more dense, more accurate, more flexible
  • applying machine learning techniques to interpret the (residual) muscle signals and translate them to movement and force commands
  • building and refining hand proxies, mechanical and/or virtual

 

2. THE FEED-BACK PATH. To send to the patient accurate, real-time signals which can be interpreted as sensorial feedback from hand proxy, associated to the actions delivered through the feed-forward path and integrated in a better sensori-motor loop:

  • 1D force feedback through the application of force (patent pending)
  • 3D force feedback using impedance-compliant robotic devices (patent pending)

3. GOING CLINICAL. To apply our findings to patients and check that they meet their needs and taste. To this end, we actively seek help from private patients as well as clinical institutions such as hospital and rehab clinics.

Non-invasive feed-forward real-time control of hand

In a joint effort with the University of Genova, Italy and INAIL, Bologna, Italy, we showed that as few as five commercial sEMG electrodes suffice to enable lower-arm amputees feed-forward control a dexterous mechanical hand such as the DLR-II. A first implementation was realised in 2007 at the DLR (see clip egg.avi); in 2008 we then showed that the same techniques could enable amputees do the same.

sEMG control of a robot hand for hand rehabilitation

In 2006, the DLR 4-finger hand was set up for functional hand recovery of subjects with partial loss of correct muscle control, resulting from, e.g, stroke, spinal cord injury or hand allograft. Standard rehab therapy relies on assisted movement of the defective limb with support by a specialized therapist (physiatrist), over days and possibly months. This involves time, money, specialised assistance and is hospital-based.

The system is especially designated for patients who need to re-learn to control their fingers and re-develop spontaneous muscle control. sEMG (ten electrodes placed on the patient’s forearm) is used thru a support vector machine to classify the EMG patterns into hand gestures. The system is able to distinguish nine hand gestures; the coupling between the patient’s and the robotic hand is realized over flexible neoprene gloves. (see clip control.avi)

Picture of  Claudio Castellini

Claudio Castellini

DLR: postdoc
prosthetics and rehabilitation
claudio.castellinidlrde, +49 8153 28-1093
Picture of  Patrick van der Smagt

Patrick van der Smagt

TUM: Director of BRML labs
smagtbrmlorg, +49 89 289-25793
Picture of  Jörn Vogel

Jörn Vogel

DLR: PhD candidate
BCI robot control
joern.vogeldlrde, +49 8153 28-2166



2012

    Atzori M, Gijsberts A, Heynen S, Mittaz-Hager A, Deriaz O, Smagt P van der, Castellini C, Caputo B, Müller H (2012). Building the NINAPRO Database: A Resource for the Biorobotics Community. IEEE International Conference on Biomedical Robotics and Biomechatronics

2011

    Castellini C, Passig G (2011). Ultrasound image features of the wrist are linearly related to finger positions. Proc. IROS---International Conference on Intelligent Robots and Systems
    Smagt P van der (2011). Neue Entwicklungen in der Rehabilitation von Handfunktionsstörungen: Humanrobotik. In Dennis A. Novak (Eds.) Handfunktionsstörungen in der Neurologie: Klinik und Rehabilitation 433-451.
    Castellini C, Smagt P van der (2011). Preliminary evidence of dynamic muscular synergies in human grasping. Proceedings of ICAR - International Conference on Advanced Robotics

2009

    Castellini C, Smagt P van der (2009). Surface EMG in Advanced Hand Prosthetics. Biological Cybernetics. 100 (1), 35--47.
    Orabona F, Castellini C, Caputo B, Fiorilla E, Sandini G (2009). Model Adaptation with Least-Squares SVM for Hand Prosthetics. Proc. ICRA---International Conference on Roboptics and Automation

2008

    Castellini C, Smagt P van der, Sandini G, Hirzinger G (2008). Surface EMG for Force Control of Mechanical Hands. Proceedings - IEEE International Conference on Robotics and Automation 725--730.

2006

    Bitzer S, Smagt P van der (2006). Learning EMG control of a robotic hand: towards active prostheses. Proceedings 2006 IEEE International Conference on Robotics and Automation 2819-2823.