Daniel Herbst

prof_pic.jpg

TUM Chair of Foundations of Deep Neural Networks

Friedrich-Ludwig-Bauer-Str. 5

85748 Garching, Germany

I am a PhD student in ML at Technical University of Munich under the mentorship of Prof. Stefanie Jegelka. Before starting my PhD, I earned an MSc in Mathematics at TU Munich, where I worked with the DAML group on symmetries and long-range interactions in graph neural networks (GNNs) as a research assistant, and was advised by Stefanie Jegelka for my Master thesis on transferability of GNNs. During my MSc, I also completed various industry internships as well as an exchange at University of Waterloo. Prior to this, I obtained a BSc in Mathematics at Karlsruhe Institute of Technology.

My current research interests lie in the theory of machine learning, especially the interplay between weight-space geometry, parameter symmetries, training dynamics, and scaling. I am also interested in the theoretical foundations of graph learning and, more broadly, in principled approaches to learning with structure.

I am always open to collaborations and thesis/project supervisions (math or CS)—feel free to reach out! :slightly_smiling_face:

Publications

  1. NeurIPS 2026 Oral, NA@NeurIPS26
    spectral-rebasin.png
    Spectral Re-Basin for Aligning Neural Weights
    Advances in Neural Information Processing Systems, Sep 2026
  2. ICML 2026 Oral, WSS@ICML26
    beyond-structural-symmetries-lmc.png
    Beyond Structural Symmetries: Linear Mode Connectivity via Neuron Identifiability
    International Conference on Machine Learning, Apr 2026
  3. GFM @ICML 2026
    lost-in-serialization.png
    Lost in Serialization: Invariance and Generalization of LLM Graph Reasoners
    Daniel Herbst*, Lea Karbevska*, Divyanshu Kumar*, Akanksha Ahuja*, Fatemeh Gholamzadeh*, and Fabrizio Frasca
    Workshop on Graph Foundation Models: A New Era for Graph Machine Learning at ICML 2026, Nov 2025
  4. ICLR 2025
    Spotlight
    higher-order-gnn-approx-cut-dist.png
    Higher-Order Graphon Neural Networks: Approximation and Cut Distance
    Daniel Herbst, and Stefanie Jegelka
    International Conference on Learning Representations, Feb 2025
  5. NeurIPS 2024
    spatio-spectral-gnn.png
    Spatio-Spectral Graph Neural Networks
    Advances in Neural Information Processing Systems, Sep 2024