Invited Talk at the Frankfurt Institute for Advanced Studies (FIAS), Germany

Learning to Plan through Reinforcement Learning in Spiking Neural Networks

Abstract: Movement planing is a fundamental skill that is involved in many human motor control tasks. While the hippocampus plays a central role, the functional principles underlying planning are largely unexplored. In this talk, I present a computational model for planning that is derived from theoretical principles of the probabilistic inference framework. Optimal learning rules are inferred and links to the widely used machine learning techniques expectation maximization and policy search are established. As computational model for hippocampal sweeps, we show that the network dynamics are qualitatively similar to transient firing patterns during planning and foraging in the hippocampus of awake behaving rats. In robotic tasks, non-Gaussian hard constraints are modeled, dozens of movement plans are simulated in parallel, and forward and inverse kinematic models are learned simultaneously through interactions with the environment.




Invited Talk at the Institute of Neuroinformatics (INI), Zurich, Switzerland

Probabilistic computational models of human motor control for robot learning.




Invited Talk at the Albert-Ludwigs-Universität Freiburg, Germany

Neural models for brain-machine interfaces and anthropomorphic robotics




Journal Paper Accepted at Nature Publishing Group: Scientific Reports.

Rueckert, Elmar; Camernik, Jernej; Peters, Jan; Babic, Jan

Probabilistic Movement Models Show that Postural Control Precedes and Predicts Volitional Motor Control 

Nature Publishing Group: Scientific Reports, (28455), 2016.




Journal Paper Accepted at Nature Publishing Group: Scientific Reports.

Rueckert, Elmar; Kappel, David; Tanneberg, Daniel; Pecevski, Dejan; Peters, Jan

Recurrent Spiking Networks Solve Planning Tasks

Nature Publishing Group: Scientific Reports, (21142), 2016.




Postdoctoral fellow at IAS, Darmstadt

Elmar Rueckert joined the Autonomous Systems Labs of Prof. Jan Peters as Post-Doc in March 2014.




Ph.D. Defense – Summa Cum Laude (with honors).

At the Technical University Graz, Austria with Prof. Wolfgang Maass.




Two Journal Papers Accepted at Frontiers in Computational Neurosciene

Rueckert, Elmar; d’Avella, Andrea
Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems

Rueckert, Elmar; Neumann, Gerhard; Toussaint, Marc; Maass, Wolfgang
Learned graphical models for probabilistic planning provide a new class of movement primitives




M.Sc. defense – Summa Cum Laude (with honors).

At the technical University Graz with Prof. Horst Bischof.