Maximilian Hüttenrauch

me.jpg

Welcome to my personal homepage. I’m a machine learning researcher interested in reinforcement learning, optimization, and deep learning in general.

I hold a Ph.D. from the Karlsruhe Institute of Technolgy (KIT) in Computer Science and an M.Sc. in Electrical Engineering and Information Technology (ETiT) from the Technical University of Darmstadt (TU Darmstadt). During my Ph.D., I focussed on reinforcement learning and my thesis is concerned with state representation in homogeneous swarms, as well as exploration of high dimensional action spaces in episode-based reinforcement learning.

I also worked as an AI Researcher at appliedAI, a German AI engineering, strategy, and research start-up where I contributed to tianshou, gave a seminar talk on episode-based reinforcement learning with movement primitives, and taught the basics of machine learning in an Introduction to AI course to industry partners.

In my free time, I enjoy riding road and gravel bikes, going to concerts, and dabbling in sound engineering.

news

Apr 17, 2025 I have a website :tada:

latest posts

Jun 26, 2025 Mean Embeddings

selected publications

  1. more_jmlr.png
    Robust Black-Box Optimization for Stochastic Search and Episodic Reinforcement Learning
    Maximilian Hüttenrauch and Gerhard Neumann
    Journal of Machine Learning Research, 2024
  2. mfe_jmlr.png
    Deep Reinforcement Learning for Swarm Systems
    Maximilian Hüttenrauch, Adrian Šošić, and Gerhard Neumann
    Journal of Machine Learning Research, 2019