image_pdfimage_print

Robot FRANKA EMIKA Panda

FRANKA EMIKA’s Panda robot arm is a complient, light-weight robot arm with seven degrees-of-freedom.

Links

Videos

  • Research videos using the robot will be presented here. 
 

Publications

2020

Xue, H.; Boettger, S.; Rottmann, N.; Pandya, H.; Bruder, R.; Neumann, G.; Schweikard, A.; Rueckert, E.

Sample-Efficient Covariance Matrix Adaptation Evolutional Strategy via Simulated Rollouts in Neural Networks Proceedings Article

In: International Conference on Advances in Signal Processing and Artificial Intelligence (ASPAI’ 2020), 2020.

Links | BibTeX

Sample-Efficient Covariance Matrix Adaptation Evolutional Strategy via Simulated Rollouts in Neural Networks

GitHub LEGO Robotic EV3 Python

Dieses open-source Projekt enthält Tools und Demos für die Python-Entwicklung mit den Lego Mindstorms EV3 und EV3Dev Bricks. 

Die Inhalte sind verständlich aufbereitet und wir haben zahlreiche Tutorials und Aufgaben für Schüler*innen erstellt. 

GitHub Code & Links

Details to the Software Development

Dieser Einführungsvortrag beschreibt die grundlegenden Schritte um einen LEGO Roboter zu bauen und mit Python zu programmieren. 

Weitere Links und Tutorials

GitHub High-Accuracy Sensor Glove, ROS, Gazebo

Sensor gloves are gaining importance in tracking hand and finger movements in virtual reality applications as well as in scientific research. In this project, we developed  a low-budget, yet accurate sensor glove system that uses flex sensors for fast and efficient motion tracking. 

The contributions are ROS Interfaces, simulation models as well as motion modeling approaches. 

GitHub Code & Links

Details to the Software Development

The figure shows a simplified schematic diagram of the system architecture for our sensor glove design:

(a) Glove layout with sensor placements, the orange fields denote the flex sensors, while the IMU is marked as a green rectangle,

(b) Circuit board which is wired with the sensor glove, has 10 voltage dividers for reading each flex sensor connected to ADC pins of the microcontoller ESP32-S2 and the IMU is connected to I2C pins,

(c) The ESP32-S2 sends the raw data via WiFi as ROS messages to the computer, which allows a real-time visualization in Unity or Gazebo,

(d) Post-processing of the recorded data, e.g. learning probabilistic movement models and searching for similarities.

Publications

A research publication by Robin Denz, Rabia Demirci, M. Ege Cansev, Adna Bliek, Philipp Beckerle, Elmar Rueckert and Nils Rottmann is currently under review. 

190.003 CPS Research Seminar I (2SH SE, SS)

Univ.-Prof. Dr. Elmar Rueckert is organizing this research seminar. Topics include research in AI, machine and deep learning, robotics, cyber-physical-systems and process informatics. 

Language:
English only

Are you an undergraduate,  graduate, or doctoral student and want to learn more about AI?

This course will give you the opportunity to listen to research presentations of latest achievements. The target audience are non-experts. Thus no prior knowledge in AI is required.

To get the ECTS credits, you will select a research paper, read it and present it within the research seminar (10-15 min presentation). Instead of selecting a paper of our list, you can also suggest a paper. This suggestion has to be discussed with Univ.-Prof. Dr. Elmar Rueckert first.

After the presentation, the paper is discussed for 10-15 min.

Further, external presenters that  are leading researchers in AI will be invited. External speakers will present their research in 30-45 min, followed by a 15 min discussion.

Location & Time

List of Talks and Dates

The specified time windows do not include discussions. 

Some Research Paper Candidates

Humanoid Robotics Exercise (RO5300)

Univ.-Prof. Dr. Elmar Rueckert was teaching this course at the University of Luebeck in 2018, 2019 and 2020.

Teaching Assistant:
Nils Rottmann, M.Sc.

Language:
English and German

Course Details

On this page you can find short videos which explain the exercise 02 given in the lecture Humanoid Robotics.

Datenstrukturen und Algorithmen (708.031)

Univ.-Prof. Dr. Elmar Rueckert was teaching this course at the Technical University Graz in the winter semester in 2012/13 and in 2013/14.

Language:
German only

Link to the university's course page

Link to the course in the TUG online system.

Course Details

  • Elementare Datenstrukturen (Felder, Stapel, Schlange).
  • Asymptotische Laufzeitanalyse von Programmen (O-Notation).
  • Sortierverfahren (Einfügen, Auswahl, Quicksort, Mergesort, Heapsort, Fachverteilung, i-größte Zahl, Randomisierung, untere Laufzeitschranken).
  • Gestreute Speicherung (Hashing; Überläuferlisten, offene Adressierung, Hashfunktionen).
  • Suchmethoden (sequentiell, binär, interpolativ, quadratische Binärsuche).
  • Baumstrukturen (Binärbäume, (a-b)-Bäume, amortisierte Umstrukturierungskosten, optimale Suchbäume).
  • Dynamische Datenverwaltung (Wörterbuchproblem, Warteschlangenproblem, Union-Find Problem).
  • Algorithmische Techniken (Inkrementelles Einfügen, Elimination, Divide & Conquer, dynamisches Programmieren, Randomisierung).

Mit bis zu 390 Teilnehmern*innen pro Vorlesung.

Literature

  • Cormen, Leiserson, Rivest: Introduction to Algorithms, MIT Press, London, 1990.

Probabilistic Learning for Robotics (RO5601)

Univ.-Prof. Dr. Elmar Rueckert was teaching this course at the University of Luebeck in the winter semester in 2018.

Language:
English only

Course Details

[WS2018/19] In the winter semester, I will teach a course on Probabilistic Learning for Robotics which covers advanced topics including graphical models, factor graphs, probabilistic inference for decision making and planning, and computational models for inference in neuroscience. The lecture will take place in the Seminarraum Informatik 5 (Von Neumann) 2.132 from 12.00 – 14.00 on selected Thursdays.

In accompanying exercises and hands on tutorials the students will experiment with state of the art machine learning methods and robotic simulation tools. In particular, Mathworks’ MATLAB,  the robot middleware ROS and the simulation tool V-Rep will be used. The exercises and tutorials will also take place in the seminar room  2.132 on selected Fridays (see the course materials and dates below).

Prerequisites (recommended) 

  • Humanoid Robotics (RO5300)
  • Robotics (CS2500)

Follow this link to register for the course: https://moodle.uni-luebeck.de/course/view.php?id=3793.

Location & Time: Room: Seminarraum Informatik 5 (Von Neumann) 2.132 12.15 – 14.00

Course materials and dates

  1. Probabilistic Learning for Robotics Intro (L1: October, 18th)
  2. Introductions to Topics I-III: Bayesian Inference, Gaussian Processes & Kalman/P. Filters (L2: October, 25th)
  3. Introductions to Topics IV-VI: Bayesian Optimization, Spiking Networks for Planning, Probabilistic Movement Primitives (L3: November, 1st)

RAS Research Seminar

Univ.-Prof. Dr. Elmar Rueckert was teaching this course at the University of Luebeck in 2018, 2019 and 2020.

Language:
English only

Course Details

In this research seminar we discuss state of the art research topics in robotics, machine learning and autonomous systems. Presenters are invited guest speakers, researcher, and graduate and under graduate students.

The seminar takes place on Fridays where in

Here is the event calendar with upcoming talks. Click on this link to add this calendar to your account. You may register for this course via moodle.

Probabilistic Machine Learning (RO5101 T)

Univ.-Prof. Dr. Elmar Rueckert was teaching this course at the University of Luebeck in the winter semester in the years 2019 and 2020.

Teaching Assistant:
Nils Rottmann, M.Sc.

Language:
English only

Course Details

Follow this link to register for the course: https://moodle.uni-luebeck.de

Some remarks on the UzL Module idea: The lecture Probabilistic Machine Learning belongs to the Module Robot Learning (RO4100). In the winter semester, Prof. Dr. Elmar Rueckert is teaching the course Probabilistic Machine Learning (RO5101 T). In the summer semester, Prof. Dr. Elmar Rueckert is teaching the course Reinforcement Learning (RO5102 T). Important: Due to the study regulations, students have to attend both lectures to receive a final grade. Thus, there will be only a single written exam for both lectures. You can register for the written exam at the end of a semester. 

Important dates

  • Written exam: 04. February 2021 (2nd appointment 04.03.2021)
  • Assignment I: Freitag, 11. Dezember 2020, 23:00
  • Assignment II: Freitag, 22. Januar 2021, 23:00

The course topics are

  1. Introduction to Probability Theory (Statistics refresher, Bayes Theorem, Common Probability distributions, Gaussian Calculus).
  2. Linear Probabilistic Regression (Linear models, Maximum Likelihood, Bayes & Logistic Regression).
  3. Nonlinear Probabilistic Regression (Radial basis function networks, Gaussian Processes, Recent research results in Robotic Movement Primitives, Hierarchical Bayesian & Mixture Models).
  4. Probabilistic Inference for Filtering, Smoothing and Planning (Classic, Extended & Unscented Kalman Filters, Particle Filters, Gibbs Sampling, Recent research results in Neural Planning).
  5. Probabilistic Optimization (Stochastic black-box Optimizer Covariance Matrix Analysis Evolutionary Strategies & Natural Evolutionary Strategies, Bayesian Optimization).

The learning objectives / qualifications are

  • Students get a comprehensive understanding of basic probability theory concepts and methods.
  • Students learn to analyze the challenges in a task and to identify promising machine learning approaches.
  • Students will understand the difference between deterministic and probabilistic algorithms and can define underlying assumptions and requirements.
  • Students understand and can apply advanced regression, inference and optimization techniques to real world problems.
  • Students know how to analyze the models’ results, improve the model parameters and can interpret the model predictions and their relevance.
  • Students understand how the basic concepts are used in current state-of-the-art research in robot movement primitive learning and in neural planning.

Location & times

Interactive Online Lectures

In the lecture, Prof. Rueckert is using a self made lightboard to ensure an interactive and professional teaching environment. Have a look at the post on how to build such a lightboard. Here is an example recording.

Requirements

Strong statistical and mathematical knowledge is required beforehand. It is highly recommended to attend the course Humanoid Robotics (RO5300) prior to attending this course. The students will also experiment with state-of-the-art machine learning methods and robotic simulation tools which require strong programming skills.

Grading

The course is accompanied by two written assignments. Both assignments have to be passed as requirement to attend the written exam. Details will be presented in the first course unit on October the 22nd, 2020.

Materials for the Exercise

The course is accompanied by three graded assignments on Probabilistic Regression, Probabilistic Inference and on Probabilistic Optimization. The assignments will include algorithmic implementations in Matlab, Python or C++ and will be presented during the exercise sessions. The Robot Operating System (ROS) will also be part in some assignments as well as the simulation environment Gazebo. To experiment with state-of-the-art robot control and learning methods Mathworks’ MATLAB will be used. If you do not have it installed yet, please follow the instructions of our IT-Service Center.

Literature

  • Daphne Koller, Nir Friedman. Probabilistic Graphical Models: Principles and Techniques. ISBN 978-0-262-01319-2
  • Christopher M. Bishop. Pattern Recognition and Machine Learning. Springer (2006). ISBN 978-0-387-31073-2.
  • David Barber. Bayesian Reasoning and Machine Learning, Cambridge University Press (2012). ISBN 978-0-521-51814-7.
  • Kevin P. Murphy. Machine Learning: A Probabilistic Perspective. ISBN 978-0-262-01802-9