Google Scholar LinkedIn arXiv ResearchGate ORCID Web of Science
Cart-Pole Ball-on-Plate
Niklas Schmid
Niklas Schmid
Ph.D. Student
Automatic Control Laboratory (IfA), ETH Zürich
Mentors: Prof. John Lygeros, Prof. Tobias Sutter
Physikstrasse 3, ETL K12
8092 Zürich, Switzerland

Summary

I am a Ph.D. student at the Automatic Control Laboratory at ETH Zürich under the supervision of Professor John Lygeros and Professor Tobias Sutter. My research focuses on the control of stochastic systems under safety constraints, which includes the analysis of reachability, invariance, and chance-constrained optimal control problems. Therefore, I utilize tools from dynamic programming and convex optimization.

News
  • 30.03.2026 Our webpage for the Ball-on-Plate System, a motorized ball-balancing screen that visualizes funademental principles of control, is now live!
  • 22.01.2026 Our paper "Maximizing Reach-Avoid Probabilities for Linear Stochastic Systems via Control Architectures" is now available on Arxiv!
  • 06.01.2026 Our paper "Parameter-Robust MPPI for Safe Online Learning of Unknown Parameters" got accepted for publication in the Robotics and Automation Letters (RA-L); preprint available on Arxiv!
  • 25.09.2025 I just launched my own hands-on course on the nonlinear control of cart-pole systems.
  • 01.09.2025 I completed my research visit at Professor Chuchu Fan's group at REALM, MIT. Thanks to everyone who made this possible and especially Professor Fan for hosting me! The results will become accessible around December.
  • 22.05.2025 Our paper "Distributionally Robust Optimization over Wasserstein Balls with iid Structure" is now available on Arxiv!
  • Research

    Scalable Safety Maximization of Stochastic Systems

    Real-world systems are often subject to uncertainties and disturbances, which may stem from external influences or dynamics which are hard to model. Accordingly, these effects are often difficult to predict and approximated as stochastic perturbations, which can lead to an unsafe control behavior if not properly managed.

    I research control approaches for stochastic systems which maximize the probability of safety. My main focus is on the development of scalable algorithms for the analysis and control of high-dimensional systems. Therefore, I developed theory on approximate dynamic programming approaches as well as stochastic control architectures.

    Selected publications:



    Safety-Constrained Stochastic Systems

    Beyond safety, systems are usually subject to performance objectives. However, there might be trade-offs between safety and performance. Designing controllers which trade-off risks against performance are challenging to compute, as they pose non-Markov constraints.

    I proved that such problems can be reformulated as Markov Decision Processes on an augmented state space, which allows solving them using (approximate) dynamic programming approaches.

    Selected publications:



    Stochastic Control for Biological Systems

    Related to my theoretical work, I am interested in practical applications involving biological systems, such as medical instruments and precision agriculture. Not only do such systems have highly nonlinear dynamics, making them challenging to control. But they are also subject to biological variability, introducing uncertainties in the evolution of the system state.

    I am currently working on the design and control of a hydroponics system, which is a soil-less cultivation method that allows for a precise control over plant growth conditions. The goal is to develop an optimal, learning-based control strategy that maximizes crop yield vs. resource usage (water, electricity). I further study the optimal fertilization of fields. Publications on these topics will become available in 2026.

    Biography

    2025
    Research visit at REALM, MIT (Cambridge, USA)
    Visiting Prof. Chuchu Fan's group to work on stochastic control architectures
    Since Nov 2021
    Ph.D. at the Automatic Control Laboratory, ETH Zürich (Switzerland)
    Supervisors: Prof. John Lygeros, Prof. Tobias Sutter
    2020 - 2021
    Internship at Olympus Surgical Technologies Europe (Berlin, Germany)
    Control of electrosurgical generators and modelling of tissue impedance
    2019 - 2021
    M.Sc. in Medical Engineering, University of Lübeck (Germany)
    Thesis: Gaussian Process based MPC of Tethered Quadcopters
    2016 - 2019
    B.Sc. in Medical Engineering, University of Lübeck (Germany)
    Thesis: Cooperative Localization of Quadcopters using Factor Graphs

    Publications

    All of my code & publications are open-access! Manuscripts: Arxiv, Code: GitHub.

    Preprints

    • N. Schmid, J. Choi, O. So, C. Fan, "Maximizing Reach-Avoid Probabilities for Linear Stochastic Systems via Control Architectures", Arxiv, 2025, Arxiv-Link.
    • A. Kharitenko, M. Fochesato, A. Tsiamis, N. Schmid, J. Lygeros, "Distributionally Robust Optimization over Wasserstein Balls with iid Structure", Arxiv, 2025, Arxiv-Link.
    • J. Miller, N. Schmid, M. Tacchi, D. Henrion, R. S. Smith, "Peak Time-Windowed Risk Estimation of Stochastic Processes", Arxiv, 2024, Arxiv-Link.

    Journal Articles

    • M. Vahs, J. Choi, N. Schmid, J. Tumova, C. Fan, "Parameter-Robust MPPI for Safe Online Learning of Unknown Parameters", IEEE Robotics and Automation Letters (2026). Arxiv-Link, Publisher-Link.
    • Y. Li, A. Karapetyan, N. Schmid, J. Lygeros, K. H. Johansson and J. Martensson, "Parallel Rollout for Deterministic Optimal Control", IEEE Transactions on Automatic Control (2025). Arxiv-Link, Publisher-Link.
    • N. Schmid, M. Fochesato, S.H.Q. Li, T. Sutter and J. Lygeros, "Computing Optimal Joint Chance Constrained Control Policies", IEEE Transactions on Automatic Control (2025). Arxiv-Link, Publisher-Link.
    • J. F. Werner, F. Pennazio, N. Schmid, E. Fiorina, D. Bersani, P. Cerello, J. Kasprzak, N. Mosco, S. Ranjbar, R. Sacchi, V. Ferrero and M. Rafecas, "Stopping Power and Range Estimations in Proton Therapy based on Prompt Gamma Timing: Motion Models and Automated Parameter Optimization", Physics in Medicine & Biology, 2024. Publisher-Link.
    • N. Schmid, M. Fochesato, T. Sutter and J. Lygeros, "Joint Chance Constrained Optimal Control via Linear Programming", IEEE Control Systems Letters, 2024. Arxiv-Link, Publisher-Link.

    Conference Papers

    • J. Miller, N. Schmid, M. Tacchi, D. Henrion, R. S. Smith, "Peak Time-Windowed Mean Estimation using Convex Optimization", 2024 IEEE 63rd Conference on Decision and Control (CDC), Milano, Italy, 2024, ETH-Link, Publisher-Link.
    • N. Schmid and J. Lygeros, "Probabilistic Reachability and Invariance Computation of Stochastic Systems using Linear Programming", 22nd IFAC World Congress, Yokohama, Japan, 2023. Arxiv-Link, Publisher-Link.
    • J. Gruner, N. Schmid, G. Männel, J. Grasshof, H. S. Abbas and P. Rostalski, "Recursively Feasible Model Predictive Control using Latent Force Models Applied to Disturbed Quadcopters", 2022 IEEE 61st Conference on Decision and Control (CDC), Cancun, Mexico, 2022. Publisher-Link.
    • N. Schmid, J. Gruner, H. S. Abbas and P. Rostalski, "A real-time GP based MPC for quadcopters with unknown disturbances", 2022 American Control Conference (ACC), Atlanta, USA, 2022. Arxiv-Link, Publisher-Link.

    Teaching

    Teaching has a high priority for me. I believe that it is our responsibility to share our fascination and knowledge to inspire future generations of students in the same way that it has been shared with us.

    Courses

    Term Course Role/Activity Lecturer(s)
    Fall 2025 - Spring 2026 Mission Impossible: Cart-Pole 4.0 My own hands-on control class! Niklas Schmid :)
    Fall 2024/23 Control Systems Presenting exercise sessions Prof. Florian Dörfler
    Spring 2024 Nonlinear Systems and Control Presenting exercise sessions Dr. Eduardo Gallestey, Dr. Raffaele Soloperto
    Spring 2022 - Fall 2023 Control Systems Laboratory Organization of hands-on lab courses Prof. John Lygeros
    Fall 2018 - Spring 2021 Electronics Design and presentation of exercise sessions Prof. Philipp Rostalski
    Fall 2018 Radioactivity (practical exercises) Supervision of students Prof. Christian Hübner

    Student Projects

    I usually have several open student projects available. Feel free to contact me at any time if you are looking for a Bachelor-, Semester-, or Master-project based around control theory and hands-on applications.

    Name Title Type Year Co-Supervisor
    Oliver Baumgartner Optimal Remembering with Memoryless Policies for Partially Observable Markov Decision Processes BT 2026 Liam Cregg, Kevin Wallington
    Oliver Baumgartner
    Samuel Baumgartner
    Louis Miller
    David Lammering
    Florian Borchard
    Interactive Control Research Communication using the Ball-on-Plate system GP 2025 André Warnecke
    Peter Schmitt Meta-Learning Model Predictive Controllers for Unseen Tasks and Changing Environments SP 2025 Riccardo Zuliani, Gabriele Fadini
    Salma Elfeki High-Performance MPC Controllers Under Environmental Changes MT 2025 Riccardo Zuliani
    Rye Gleason Optimal Crop Fertilization Control Strategies and Verification MT 2025 Kevin Wallington
    Tristan Zeller Joint Chance Constrained Reinforcement Learning SP 2025 Marta Fochesato
    Daniel Böhler Iterative Learning Control for Plants in Controlled Environments SP 2025 Kevin Wallington
    Jair Reyes Optimal Control of Plants in Controlled Environments SP 2025 Kevin Wallington
    Nicola Scagnetti Design and Control of a Hydroponics System MT 2025
    Jonathan Hilberg Model Free Joint Chance Constrained Optimal Control MT 2024 Marta Fochesato
    Andrey Kharitenko Robust Covariance Steering MT 2024 Marta Fochesato, Anastasios Tsiamis
    Simon Dreher Redesign of an Hydroponics System SP 2024
    Ariel Bergmann Control of an Inverted Pendulum BT 2024
    Alexander Kaspar Meta-Learning Model Predictive Control for the Ball-On-A-Plate System SP 2024 Jiaqi Yan, Riccardo Zuliani
    Mirco Vandeventer Meta-Learning Reinforcement Learning for the Ball-On-A-Plate System SP 2024 Jiaqi Yan
    Simon Frölich Hardware Reconfiguration and Control of the Ball-On-A-Plate System BT 2024
    Gian-Andrin Coolen Hydroponics - Mechanics BT 2024
    Oscar Kläsi Hydroponics - Electronics BT 2024
    Leo Noth Hydroponics - Sensing and Control BT 2024
    Daniel Böhler* Hydroponics - Software Design and Control BT 2024
    Alexander Kaspar MPC of the Mounted-Helicopter Experiment BT 2023
    Elias Bai Improved Reinforcement Learning Control of the Ball-On-A-Plate System BT 2023
    Joram Ebinger LQR and Reinforcement Learning Control of a Ball-On-A-Plate System BT 2023
    Gentrit Gashi Water-Level Sensing for the Quad-Tank Experiment BT 2023

    GP: Group Project, BT: Bachelor Thesis, SP: Semester Project, MT: Master Thesis
    * Awarded Best Bachelor Thesis 2024 by the Swiss Control Association (Schweizer Gesellschaft für Automatik).

    Outreach

    Research means responsibility. We promise that our work has real-world impact, and paves the way for a sustainable, healthy and prosperous future. Therefore, we receive tax money. It is our responsibility to show the public that their investment is well spent. Further, sharing our results and fascination for innovation is a unique opportunity to inspire future generations of students and researchers.

    The Ball-on-Plate System

    To communicate the foundations and importance of control, I designed the Ball-on-Plate system, a motorized ball-balancing screen. The system displays the basic principles of various control algorithms in interactive games and will be exhibited at several Swiss museums in 2026. Details are available on the Ball-on-Plate website. The following is a short sneak peek of some controllers we implemented for a museum exhibition.

    Two-part NCCR Automation Blog Post on Safe Automation

    Together with Jared Miller, I wrote a two-part blog post for the NCCR Automation on the topic of safe automation targeted to the general public and undergraduate students. The blog posts explains the importance of safety in automation, and principles by which controllers achieve safety. It is a great read for anyone interested in learning about the safe control and getting a first overview in an accessible way. Check it out here: Part 1 and Part 2

    Grants & Funding

    I am grateful for the financial support I have received during my Ph.D. studies, which enabled me to pursue my vision in research and teaching. I was supported by the European Research Council under grant 787845 (OCAL) and the Swiss National Science Foundation under NCCR Automation under grant 51NF40_225155. I further received the following grants and funding.

    Amount Source Description Year
    85,735 CHF KIM (Commission of Computer Science, ETH Zürich) Grant for designing a hands-on control class using cart-pole systems 2024
    20,000 CHF NCCR Automation, Swiss National Science Foundation Grant for my research visit at MIT, Boston, USA 2024
    - ACC (American Control Conference) Student Travel Grant 2022