image_pdfimage_print

190.017 Advanced Machine and Deep Learning (5SH IL, WS)

Course Content & Topics

Theoretical and practical aspects of computing and learning with neural networks. Examination of the most commonly used algorithms for deep learning. From a practical point of view, different learning algorithms and types of neural networks are implemented and applied to artificial and real-world problems.

Initially, the selected methods are developed in 5-6 lecture units. Students then select a machine learning method and apply it independently. The project work is accompanied by weekly tutorials with tips and tricks. Finally, the project results are discussed in a written report and finally presented for 10-15 minutes. The grade is based on the quality of the code, the report and the final short presentation.

Learning Objectives

After successfully completing the integrated course, students will be able to:

  • describe and apply basic concepts and commonly used architectures of deep learning.
  • explain in detail how deep neural networks are designed and trained in supervised and unsupervised learning scenarios.
  • describe the advantages of different neural network models and algorithms, as well as their relationship to important machine learning concepts such as generalization and regularization.
  • apply the acquired practical skills in the implementation and application of state-of-the-art deep learning methods to solve various problems.

Location & Time

Location: TBD. Starting in November, lectures are planned to be held in HS 3 Studienzentrum (35SZ02211).

Time: TBD. 

Grading

Immanent examination character. Details will be presented in the first lecture unit.

* Active participation: 0-10 bonus points for active participation.

* Task sheets: 0-30 points for independent work on theoretical aspects.

* Project submissions:
– The implementation (Python code) will be graded 0-30 points.
– The report is assessed with 0-20 points.
– The slides, the final presentation and the discussion are awarded 0-20 points.

* Grading scale: 0-49.9 points (5), 50-65.9 points (4),66-79 points (3), 80-91 points (2), 92-100 points (1)

(With an overall result of up to 79%, an additional oral performance review MAY (!) also be prescribed if the positive performance record is not clear. In this case, you will be informed as soon as the grades are released. If you have already received a grade via MU online, you will not be invited to another oral examination).

Prerequisites

Literature

– Ian Goodfellow, Yoshua Bengio and Aaron Courville, “Deep Learning”, 2016.
– Christopher M Bishop, “Pattern Recognition and Machine Learning”, 2006.

After Business Trip Paperwork

New Obligation: Submit along comparitive offers

(This starts from 30 July 2024)

You are required to submit a comparative analysis of the prices for your trip along with other documents for claims.

Documents to submit and print in hard copy:

  • Conference/summer school schedule
  • Transport ticket (flight/intercity train/city train/bus)
  • Registration fee
  • Spesenabrechnung/Reisekostennachweis (from SAP)
  • Accomodation
  • Comparative analysis of the prices (only be paid 50% of the flight costs, if this document is not submitted along)

New Obligation: Monthly data entry for öbb tickets

(This starts from 26 Jun 2024)

You can find the entry form at here: https://cloud.cps.unileoben.ac.at/index.php/s/GTFTrT8btK7mMtW

Procedure to submit paperwork to Financial Department

Published on 21 May 2024

Update 1 on 26 Jun 2024

Update 2 on 30 July 2024

1. Login into SAP

At your SAP, click on “Meine Reisen und Spesen”.

2. Click on your desired Trip

In my case, I will show example in Austria.

 

Click “Welter” to proceed.

3. At the Main Page with 4 steps

Step 1: Verify every information especially Kontierung (Your project number)

Next, click on checkbox with * and then proceed with “Belege erfassen”

Step 2: Add all related claims

Step 3: Validate

There are two options: Save it for future or Sent it to financial department


4. Final step

  • Prepare all the original receipts and keep a copy with you.
  • Print out the above from system
  • Put the documents at “Dienstreisen Folder” at Regina’s place
  • Bring the folder to Uni Post Office at 1st floor of old building.

Print a Poster

Kindly ask for permission before proceed to poster printing.

 

To print a poster, you can either go for:

Option 1: Mail Boxes Leoben

Price list:

A0: ~20.00 euro

CPS account: KST 101900

Email them, and they will record at CPS account.

Option 2: ÖH Leoben

Fill the form at : https://www.oeh-leoben.at/de/plotauftrag

Price list:

A0: ~6.63 euro

A1: ~3.35 euro

Only cash payment, and pay it when obtaining.

B.Sc. Thesis: Reineke Peter on Deep Learning for Predicting Fluid Dynamics

Supervisor: Univ.-Prof. Dr Elmar Rückert

Project: K1-MET P3.4
Start date: 1st of May 2024

Theoretical difficulty: high
Practical difficulty: mid

Topic

The the steel production, the steel quality heavily depends on the dynamic processes of the meniscus level fluctuations in the mold. These complex dynamic  processes can be observed using IR cameras observing the surface level and the casting powder temperature. 

The goal of this thesis is to develop and compare deep learning approaches (CNNs, transformers) for predicting fluid dynamics in lab prototype environment. 

Tasks

  • Literature research of state of the art, see references
  • Lab prototype environment for generating complex (structured and chaotic) fluid dynamics
  • Dataset recording, visualization and annotation
  • Deep Learning algorithm implementation (CNNs & Transformers)
  • Evaluation on different datasets (predictable dynamics, complex dynamics, synchronous and async. surface level dynamics, chaotic dynamics).
  • Thesis writing.

References

B.Sc. Thesis: Sukal Tanja on Creating a Python development environment for LEGO Ev3 robot systems

Supervisor: Univ.-Prof. Dr Elmar Rückert

Start date: 1st of August 2023

Theoretical difficulty: mid
Practical difficulty: mid

Thema der Arbeit

LEGO Ev3 Robotersysteme werden am Lehrstuhl in der Lehre eingesetzt, um einen einfachen Einstieg in die Robotik zu ermöglichen. Zahlreiche Algorithmen können erprobt werden: 

  • Pfadplanung und Navigation
  • Kalman Filter
  • Kartierung / SLAM
  • Objektmanipulation 
  • Kamerabasierte Objekterkennung
  • Regelungsalgorithmen
  • Telemetrieaufgaben
  • usw.

Unsere EV3 Systeme sind mit einem Linux Betriebsystem (https://www.ev3dev.org) ausgestattet und können in der Programmiersprache Micro-Python bespielt werden. 

Ziel dieser Arbeit ist es eine Entwicklungsumgebung für die klassische Python Programmiersprache zu schaffen. Dabei sollen Beispielprojekte umgesetzt und Limitierungen dokumentiert werden. 

Aufgaben

  • Recherche und Dokumentation zur State-of-the-Art
  • Beispielprojekte Implementieren
  • Git Repository mit Dokumentation erstellen.
  • Dokumentation der Arbeitsschritte & Verfassen der Diplomarbeit

Wissenschaftlicher Beitrag

  • Entwicklung und Implementierung einer Entwicklungsumgebung in Python für die Lehre. 
  • Veröffentlichung des Source Codes. 

Abschlussarbeit

B.Sc. Thesis by Tanja Sukal on Open-Source LEGO EV3 Python Framework for Teaching, 2024.

M.Sc. Thesis: Einberger Stefan on Retrofitting of a Cyber-Physical System to a reactive molding machine for thermoset resins

Supervisor: Univ.-Prof. Dr Elmar Rückert

Company: Ottronic GmbH
Start date: 1st of October 2023

Theoretical difficulty: mid
Practical difficulty: mid

Thema der Arbeit

Bei Ottronic bildet die Verkapselung unserer Elektroniken und Motoren mittels eines eigens adaptierten Reactive Injection Molding (RIM) Verfahren die Grundlage für die Produktion von medienresistenten Elektroniken und elektrischen Hochleistungsantrieben. Im Zuge des RIM werden sogenannte b-staged Duroplaste unter einem präzisen Druck- und Temperaturprofil verarbeitet, geformt und final ausgehärtet. Um die angestrebte höchste Produktqualität, mit Blick auf Medizintechnik-Applikationen, zu gewährleisten, muss dieser Prozess mit jedem Schuss optimal eingestellt sein. Daher soll ein Cyber Physical System (CPS) entwickelt werden, welches auf unsere RIM-Anlagen nachgerüstet wird.

Ziel der Diplomarbeit ist, dass das finale CPS selbstständig Prozessschwankungen (Chargenschwankungen, Hallen-/Maschinentemperatur, Feuchte, etc.) erkennen kann und Regelparameter des Spritzgussvorgangs (Schmelzzeit, Aushärtezeit, Einpresskraft, etc.) anpassen um eine gleichbleibende Produktqualität ohne menschliche Kontrolle zu garantieren.

Dabei soll in einem ersten Schritt der aktuelle Prozess beschrieben werden. Daraus sollen die notwendigen Produktionsparameter abgeleitet und deren Auswirkungen auf den Prozess analysiert sowie die Kernpunkte zur Prozessoptimierung definiert werden, sowie ein Modell dafür entwickelt werden. Das zu entwickelnde Modell dient dann in weitere Folge als Basis für das CPS um den Prozess zu bewerten zu können, Abweichungen zu detektieren und Regelparameter abzuändern.

In weiterer Folge soll das Modell auf der Maschinensteuerung CPS integriert und implementiert werden. Abschließend muss noch die Verknüpfung der neu gewonnen Intelligenz des CPS mit der aktuellen Regelung der Maschine verknüpft werden um eine nahezu autonome Prozessführung zu garantieren, sowie eine neue ressourcen- als auch energieeffizientere Spritzpressmethode garantieren.

Aufgaben

  • Recherche und Dokumentation zur State-of-the-Art
  • Erfassung aller notwendigen Produktionsparameter sowie Analyse derer auf Produktqualität
  • Entwicklung eines Modelles zur virtuellen Beschreibung des Spitzgussprozesses Implementierung des Modells auf Maschinensteuerung als Basis für ein CPS
  • Identifizierungen von Abweichungen im Prozess sowie Implementierung von Gegenmaßnahmen
  • Verknüpfung der Prozessregelung mit Steuerungsempfehlungen des CPS.
  • Dokumentation der Arbeitsschritte & Verfassen der Diplomarbeit

Wissenschaftlicher Beitrag

  • Entwicklung und Implementierung eines CPS, welches einen RIM Prozesses erfassen und abbilden kann.
  • Aufbau von Methoden um auf Basis des CPS Änderungen des RIM-Prozesses erkennen und bewerten zu können
  • Retrofitting der gewonnen Intelligenz in eine bestehende Maschinensteuerung

Booking a Trip for a Conference/Visit/Summer School

Put your documents at TravelApplications/drafts

Here: https://cloud.cps.unileoben.ac.at/index.php/f/977844

Create the folder with your name

 

Travel Planning Checklist

Approval and Registration

  • Initial Planning: Check for a reasonable flight itinerary. Check if 1-2 days before and after the event have a substantially lower price. 
  • Obtain Approval: Secure trip approval from Elmar. Argue according to the initial planning.
  • Travel System Entry: Request Regina to input the trip details into the travel system. Specify which days are for official duties (e.g., conference, lab visits) and which are for personal stay. Provide Regina with the proof of acceptance, or reason to travel.

Booking Essentials

  • Accommodation and Commute Options: Provide a comparison spreadsheet of different options within the budget. Opt for reasonable over the cheapest options.
  • Booking Approval: Get approved by Elmar.
  • Accommodations and Commute: After obtaining approval, book your stay, conference registration, accommodations, etc. 

Travel Insurance

  • Carry Insurance Documentation: If traveling abroad, particularly outside the EU, bring a printed copy of the university’s or other relevant insurance policy

Visa Requirements

  • Include Embassy Commute: If a visa is necessary, incorporate the embassy commute in the travel system and communicate this to the secretary for travel cost reimbursement.
  • Visa Application Time: Visa application efforts are recognized as working hours.

After the Travel

  • Receipts: After the end of the trip, provide Regina with all the receipts, invoices, and tickets from:
      • Airplanes, trains, buses, and boats: tickets, invoices, bank statement
      • Accommodation: invoice, bank statement
  • Registrations: invoice, bank statement
  • etc.

 

Important Notes

  • OEBB Trains: The chair has a membership with OBB, please book the ticket in the user’s name. You can obtain the user’s login information from Regina.
  • After the travel: Keep all original receipts and submit them to Regina after returning.
  • Report Everything: Due to Austrian law for work insurance coverage, you must inform Regina by email if you will be outside the university zone during working hours, even for a few hours.
  • Private Stay: A private stay cannot exceed 50% of the duration of the working days. For example, if a conference is for six days, your private stay must be a maximum of three days. Otherwise, the university will cover only 50% of the flight tickets and hotel.

Tips:

  • Credit card with travel coverage (check if hospitalization is included for overseas)

Organizing Wiki Page Categories

Here’s a guide on how to label your categories effectively:

  1. wiki_phds: This category should encompass all aspects of your day-to-day life as a PhD student.

  2. wiki_road_to_thesis: Include guidelines, tips, and resources related to various stages of thesis writing, from proposal development to final defense preparations.

  3. wiki_hard_software: Use this category to share information, tutorials, and updates about the hardware and software used in your research projects.

  4. wiki_scientific_research_aspects: Discuss methodologies, data analysis techniques, experimental setups, and anything else related to the scientific rigor of your work.

  5. wiki_teaching_aspects: This category is dedicated to sharing insights, strategies, and resources for effective teaching, whether it’s leading a seminar, designing a course, or mentoring undergraduates.

  6. wiki_career_aspects: This category covers everything related to career development and professional growth.

The category label determines where the post will appear in its respective section.

 

Lange Nacht der Froschung – 24th of May 2024

Date & Location: 24.05.2024 17:00-21:00

We expect many visitors and will prepare some beverages. Please let us know if you plan to join! 

Chair of Cyber-Physical-Systems 
Metallurgiegebäude 1.Stock
Montanuniversität Leoben
Franz-Josef-Straße 18,
8700 Leoben, Austria

Impressions of the last open lab day in 2024.  

English: Immerse yourself in the fascinating world of artificial intelligence and robotics. We present self-learning robots, mobile robot guides and how deep neural networks are learned. Children can experiment with our Lego EV3 robots and try to deliver snacks autonomously. Catering will be provided.

Deutsch: Tauchen Sie ein in die faszinierende Welt der künstlichen Intelligenz und Robotik. Wir präsentieren selbstlernende Roboter, mobile Roboterguides und wie tiefe neuronale Netze gelernt werden. Kinder können mit unseren Lego EV3 Robotern experimentieren und versuchen Snacks autonom auszuliefern. Für Verpflegung ist gesorgt.

The pictures above are from October 2023 and will be updated after the event. 

Program