projects

You can find my publications on my Google Scholar profile. This page gives an overview on some of my public projects over the years.
2022
- Paper: Compute Trends Across Three Eras of Machine Learning (Summary on Twitter)
-
Compute, data, and algorithmic advances are the three fundamental factors that guide the progress of modern Machine Learning (ML). In this paper we study trends in the most readily quantified factor - compute. We show that before 2010 training compute grew in line with Moore’s law, doubling roughly every 20 months. Since the advent of Deep Learning in the early 2010s, the scaling of training compute has accelerated, doubling approximately every 6 months. In late 2015, a new trend emerged as firms developed large-scale ML models with 10 to 100-fold larger requirements in training compute. Based on these observations we split the history of compute in ML into three eras: the Pre Deep Learning Era, the Deep Learning Era and the Large-Scale Era. Overall, our work highlights the fast-growing compute requirements for training advanced ML systems.
-
Article: Estimating training compute of Deep Learning models (Summary on Twitter)
-
Blogpost: Compute Trends — Comparison to OpenAI’s AI and Compute (Summary on Twitter)
-
Blogpost: Projecting compute trends in Machine Learning (Summary on Twitter)
-
2021
- Blogpost series on Transformative AI and Compute
- Paper: Measuring what Really Matters: Optimizing Neural Networks for TinyML (GitHub)
- Paper: Playing Tetris Lets You Rate Odors as Less Intense
- Paper: Some like it, some do not: behavioral responses and central processing of olfactory–trigeminal mixture perception
2020
- Master Thesis at ETH Zürich: Evaluation and Deployment of Resource-Constrained Machine Learning on Embedded Devices (slide deck)
- Seminar report about IoT Security (slide deck)
2019
- Distraction Free Homescreen - Nov 19
- Presentation on Humane Tech in Munich
- Distraction Free Homescreen - May 2019
- Presentation on Humane Tech in Aachen
- Hostapd Config Tester
2018
- Seminar report about LoRA (Low Power Wide Area Network) (slide deck)
- Designing a Sleep Tracker
- THEPort at CERN - Humanitarian Hackathon
- Summer School: Environmental Footprint at ETH Zuerich
- Photography in Iceland
2017
- Photography in North America