We are looking for a new PhD student in AI Interpretability (filled!)
We are seeking a highly motivated and skilled research assistant to join our Research Team at IOL Lab at Zuse Institute Berlin. The successful candidate will work closely with our team on cutting-edge research projects in the field of Numerical Optimisation and Explainable AI.
Someone with a maths, theoretical physics or computer science background is preferred, but we are willing to consider anyone who can credibly demonstrate good reasoning and programming skills.
Apply till 17th 28th of May or until fitting candidate is found
The position is part of the MATH+ project “Expanding Merlin-Arthur Classifiers - Interpretable Neural Networks through Interactive Proof Systems”. This research project is part of the Emerging Fields Area “Extracting dynamical Laws from Complex Data”. Our work focuses on the mathematical analysis of interpretability in AI systems. We want to investigate under which conditions interacting agents have to communicate honestly about their reasoning process. Our aim is to develop a theoretically sound foundation to make modern AI systems safe for deployment in sensitive ares. MATH+, the Berlin Mathematics Research Center, is a cross-institutional and interdisciplinary Cluster of Excellence. It sets out to explore and further develop new approaches in application-oriented mathematics. For more information see: https://mathplus.de.
Broad Research Direction:
We want to build a theory that guarantees Interpretability (e.g. in the form of information bounds) for modern AI systems. Can we play AI agents against each other, so they are forced to cooperate with humans? Is it possible that AI systems prove the soundness of their reasoning to us? Can we give interpretations in text form? How robust are these approaches? Do the explanations degenerate when the AIs are incentivised to obscure their reasoning? Can we use a form of error-correction to prevent this?
For preliminary results see our paper. See here for one possible angle for this project.
Requirements:
- completed university degree (Diplom, Master or equivalent) in Mathematics, Computer Science or a closely related course of studies,
- experience in theoretical research (e.g. proving mathematical theorems),
- solid knowledge of probability theory,
- good programming skills (Python),
- knowledge in computational complexity theory, graph theory and game theory are an advantage,
- fluent in English,
- independent thinker.
To apply, write to (aschulz@math.tu-berlin.de). Write me (waeldchen@zib.de) for further information. If you know a candidate that might be a good fit for this position, please forward them this announcement.
Please Include:
- how you fulfill the requirements,
- how you found out about this position
- link to your website, previous projects or papers,
- whether you can physically be present at our Berlin office,
- what your interests are and what motivates you for this position.