{"id":5,"date":"2019-07-01T10:05:24","date_gmt":"2019-07-01T10:05:24","guid":{"rendered":"http:\/\/elmahdielmhamdi.com\/?page_id=5"},"modified":"2026-04-26T09:15:33","modified_gmt":"2026-04-26T09:15:33","slug":"5-2","status":"publish","type":"page","link":"https:\/\/elmahdielmhamdi.com\/","title":{"rendered":""},"content":{"rendered":"
\n
\"\"<\/figure>\n<\/div>\n\n\n

Research: <\/strong>Starting from mathematical formalisations of Robust Distributed Learning<\/a><\/em>, my research has so far led to the first provably resilient algorithm for distributed machine learning and a series of follow-ups, some of the algorithms my co-authors and I devised, like Krum and Bulyan are deployed in industrial settings and have set the standard formalism (Byzantine ML<\/a>) largely used in the field, e.g. as listed in the 2024 report on Adversarial Machine Learning<\/a> by the US government’s National Institute of Standards and Technology (NIST)<\/strong> as state-of-the art defence mechanisms (4 out of the 9 solutions<\/strong> listed by NIST as state of the art for model poisoning). But there are caveats<\/a>.

Recent work:<\/strong> Some of the most recent works from my group at polytechnique provided an optimal notion of robustness<\/a> in distributed machine learning, introduced novel methods to probe AI models’ robustness, including the discovery of <\/a>indirect data poisoning<\/a><\/strong>, the original use of gradient inversion<\/strong> techniques in the context of both developing new data ownership verification techniques<\/a> and understanding the capabilities of data poisoning<\/a>, as well as the formalisation<\/a>, a better understanding<\/a>, and new questions<\/a> on the AI alignment problem. I am also interested in questions on the fine-grained robustness in neural networks<\/a> that overlap with the theory of deep learning<\/strong>. If any of these fits your interests, please scroll to the “prospective senior scientists” paragraph.

Teaching: <\/strong>at the \u00c9cole polytechnique, I am co-chair of the Master of Science program in Data Science and Machine Learning (formerly M2DS, +125 students), responsible for the research-based projects offered to undergrads in applied mathematics (+90 students), responsible for the data science and machine learning track in the research-based courses offered to graduate students (+ 70 students, at both the engineering cycle and the MSc program) and teach the “Collaborative and Reliable Learning” and the “Foundations of Machine Learning” graduate courses.

Editorial<\/strong> Service:<\/strong> Starting from 2025-2026, I am again accepting selected requests for editorial service and serving as area chair for ICLR, NeurIPS and ICML.
I will also serve as session chair for ICLR 2026 for the Bridging theory and practice<\/strong> session, see you then.<\/p>\n\n\n\n

Awards: <\/strong>

2025: France’s top 100 scientific inventors,<\/strong> among the list of 10 scientific inventors for work on cybersecurity <\/strong>(by a jury made of Nobel\/ Turing laureates and leading French CEOs<\/a>).
2020: VentureKick<\/strong> 10k CHF award (for Calicarpa<\/a>).
2020: Best computer science PhD<\/strong> award from the \u00c9cole Polytechnique de Lausanne (EPFL) for my work on Robust Distributed Learning.
2020: Best student paper award<\/strong> at the 26th International Conference on Principles of Distributed Systems (Opodis).
2018: Yearly performance award<\/strong> from the Dean of the IC faculty at EPFL for research excellence.
2012: Breaking borders award for freedom of speech<\/strong> from Global Voices Online, Thomson Reuters and Google (with the team of the media Mamfakinch<\/a>).
2010: EPFL fellowship<\/strong> for academic excellence in materials science.
2007: Excellence scholarship<\/strong> from the French ministry of foreign affairs.

Book: <\/strong>With my co-author L\u00ea Nguy\u00ean Hoang, we used to organize a philosophy and mathematics reading group<\/a> and published (in 2019) a book<\/a> on the safety, reliability and ethics of large-scale information processing, decision making, and AI safety in particular.
Some ideas of the book or my research are discussed in an accessible language
– in this interview<\/a> by Celia Luterbacher from EPFL (English)
– in this conversation<\/a> with Chris Benson (English).
– in the AI Alignment podcast<\/a> of the Future of Life Institute (English)
– in this interview<\/a> with the Swiss national radio (French)
– in critics (in French) of the book such as in Le Monde<\/a> (by Science journalist Dr. David Larousserie), atlantico<\/a> (by Paul Leli\u00e8vre) or my favourite, this blog post<\/a> from digital expert Herv\u00e9 Kabla.
I discuss other ideas on reliable information processing in this essay on rationality and inductive thinking<\/a> (English) or this Op-Ed in Le Monde<\/a> (French) on the benefits of scientific methodology especially<\/em> during a crisis. These are not covered in the published French version of the book but will be covered and expanded in the upcoming English version.

Disclaimer re: Morocco: <\/strong>I apologise for declining requests for in-person events in Morocco, my home country, due to more than two years of death, torture and jail threats, in addition to various other tactics such as constant harassment and reception of spywares. I have strong evidence pointing to the Moroccan authorities and diplomats and have started legal procedures in Switzerland on March 16, 2022. If you want to understand why, read this text.<\/a>

Bio: <\/strong>I grew up in Morocco where I did a bachelor-level curriculum in physics, mathematics and philosophy, followed by studies in France, Germany and Switzerland thanks to merit-based scholarships. After that I was a researcher in Physics<\/a>, created a media in Morocco<\/a> then launched an online science tutorials<\/a> project before coming back to research.
My scientific interest is in the (un)reliability of information processing by machines, biological systems, and society.
I currently work for \u00c9cole polytechnique, I did my PhD at EPFL, and in between, I was a senior research scientist at Google.

Prospective PostDocs and senior scientists:<\/strong> I have secured funding for postdoctoral (and senior scientists including a research engineer<\/strong>) positions, please reach out by email<\/strong> if you are interested and if you believe there are interesting intersections between our works. (This was last updated on February 2026<\/strong> and will remain valid until removed from this webpage).
The working conditions at \u00c9cole polytechnique for postdocs and senior scientists are well above French standards, you will be protected from the time-consuming drama that faculty with teaching and administrative duties have to deal with, and can focus on developing your research portfolio and agenda.

Prospective PhD students: <\/strong>To ensure the quality of supervision for my current and incoming PhD students, I can unfortunately not accept any commitment to supervise a new PhD project. (This was last updated on February 2026<\/strong> and will remain valid until at least Spring 2027).
If you are already supervised, but are extremely motivated to explore external collaborations (without commitment to formally supervise you), we can of course discuss opportunities for that. But focusing on your current PhD agenda without much dispersion is always a valid advice to take from your current supervisor(s), so this is only valid if it benefits your current PhD plans.

Prospective undergrad students<\/strong>: For the same reasons as above, I am currently unavailable to offer quality mentorship for undergrad projects outside those that already fall under my duties at polytechnique. (This was last updated on February 2026<\/strong> and will remain valid until at least Spring 2028).<\/p>\n\n\n\n

Below is an outdated list of talks and publications from my time at EPFL, for recent publications, check the<\/strong> Google Scholar page<\/a>.<\/p>\n\n\n\n

News<\/strong>:
– Nov. 2019: my PhD “Robust Distributed Learning<\/a>“<\/em> has just been accepted and nominated for the EPFL best thesis award by a jury comprised of professors Francis Bach (ENS Ulm) & Martin Jaggi (EPFL) from the machine learning side, professors Rachid Guerraoui (EPFL) & Maurice Herlihy (Brown University) from the distributed systems side, and presided by prof. Babak Falsafi. Thanks to all of them for the time they put into reviewing my work.
(2020 UPDATE: the thesis now received the doctoral award for computer science and is short-listed for the cross-department award, thanks again to my jury members for their feedback).

– Nov. 2019: Our book Beneficial and Robust AI, written with game-theorist Dr L\u00ea Nguy\u00ean Hoang and edited by EDP Sciences is out! the French version is already in libraries, the English version is following soon. Here is a concise interview with EPFL <\/a>media service detailing what it is about.


Current Research: <\/strong>The focus is on the robustness of distributed learning systems<\/strong> and is two-fold.

–Robustness of biological networks<\/strong> (neural networks, biomolecular networks, gene-regulatory networks\u2026): in this direction, I am interested in bounds on error propagation that might help, e.g., explain the emergence of essential genes<\/a>.

–Robustness of distributed machine learning systems<\/strong>: in this direction (which took the bigger chunk of my PhD), I am looking for algorithms that enable a group of agents to learn together while not everyone involved is trusted. This covers situations such as data-poisoning, hacked machines, buggy software or asynchronous communication. My PhD work encompassed all these situations under the umbrella of Byzantine resilient machine learning<\/strong><\/em> and coined a series of provably safe algorithms (c.f. publications bellow or this interview with the Future of Life Institute<\/a>).

I am fortunate to have Rachid Guerraoui<\/a> -a world leader in distributed computing- as a PhD host who, while not doing any AI, machine learning or computational biology himself, provided me with the full freedom to initiate research directions of my own in these domains.<\/p>\n\n\n\n

Talks:<\/strong>

International Conference on Machine Learning (ICML<\/strong>), Stockholm, Sweden. 2018:
–Asynchronous Byzantine Machine Learning (the case of SGD).<\/em> Long talk.<\/strong>
–The Hidden Vulnerability of Distributed Learning in Byzantium.<\/em> Long talk.<\/strong>

IEEE International Parallel and Distributed Processing Symposium (IPDPS<\/strong>), Orlando, USA. 2017
–When Neurons Fail.<\/em> (also given at the 2016 Biological Distributed Algorithms workshop in Chicago)

IEEE Symposium on Reliable Distributed Systems (SRDS<\/strong>), Hong Kong, China. 2017
–On the Robustness of a Neural Network.<\/em>

International Conference on Silicon Photovoltaics (SiliconPV<\/strong>), Hamelin, Germany, 2013:
– Cyclic behaviour in a-Si:H Degradation – Understanding Passivation in High Efficiency Silicon Heterojunction Solar Cells. Plenary oral presentation.<\/strong>

Berkeley Center for Human Compatible Artificial Intelligence, Google Brain Seattle (federated learning), Ecocloud 2019 and the Applied Machine Learning Days 2019:
– Byzantine Resilient Machine Learning <\/em>(invited)<\/strong>.

AI governance forum Geneva 2019:
– AI safety beyond the killer robot clich\u00e9 : from poisoning public debates to social media addiction<\/em> (invited).<\/strong>

I was also invited to the 2019 Beneficial AI conference in Puerto Rico<\/a>, in which I presented our work on Byzantine resilient machine learning, see for example this podcast<\/a> recorded there or these two panels on controlling long-term AI <\/a> and action items for the next generation of researchers in AI safety<\/a>.

Public outreach<\/strong> :
The Practical AI podcast:<\/a> on poisoning social media with false information, Byzantine machine learning and short term AI safety in general.
Swiss national radio<\/a> (french): on Byzantine ML and Interruptibility.
EPFL Zettabytes:
AI safety and the three types of adversarial attacks<\/a>,
why the safe interruptibility question matters ,<\/a>
Byzantine fault tolerant machine learning<\/a>.
Science4all (french): on poisoning AI with unreliable data.<\/a><\/p>\n\n\n\n

Publications: <\/strong>

Note: In the research group I work for, authors order is alphabetical. Exceptions to this rule are specified with *.
“Main publications<\/strong><\/em>“<\/strong> are those for which I played a key role (coming up with the problem, algorithms, proofs, manuscript etc), “other publications<\/strong><\/em>” are those in which I played a secondary role (as detailed).

Main Publications :<\/strong>

-G. Damaskinos, E.M El Mhamdi, R. Guerraoui, A. Guirguis, S. Rouault. AggregaThor: Byzantine Machine Learning via Robust Gradient Aggregation.<\/em> <\/em><\/strong>the conference on Systems and Machine Learning (SysML)<\/strong> 2019. <\/em><\/strong>paper<\/a><\/em>.  <\/em><\/strong> code (by G.D, A.G & S.R).<\/a>
-E.M. El Mhamdi, R. Guerraoui, S. Rouault. The Hidden Vulnerability of Distributed Learning in Byzantium.<\/em> International Conference on Machine Learning (ICML)<\/strong> 2018. Long Talk<\/strong>. paper<\/a>.
-G. Damaskinos, E.M. El Mhamdi, R. Guerraoui, R. Patra, M. Taziki. Asynchronous Byzantine Machine Learning (the case of SGD)<\/em>, International Conference on Machine Learning (ICML) <\/strong>2018. Long Talk<\/strong>. paper<\/a>.
-E.M. El Mhamdi*, A. Kucharavy*, R. Guerraoui, R. Li. Predicting Complex Genetic Phenotypes Using Error Propagation in Weighted Networks<\/em>, under review for a biology journal. Presented at the European Molecular Biology Laboratory (EMBL)<\/strong> November 2018 conference “from functional genomics to systems biology” and at the 2017 Biological Algorithms Workshop. preprint<\/a>.
-P. Blanchard, E.M. El Mhamdi, R. Guerraoui, J. Stainer. Machine Learning with Adversaries: Byzantine Tolerant Gradient Descent,<\/em> Neural Information Processing Systems (NeurIPS)<\/strong> 2017. paper<\/a>. video<\/a>. (also appeared as a brief announcement at the 2017 ACM Principles of Distributed Computing conference (PODC)).
-E.M. El Mhamdi, R. Guerraoui, S. Rouault. On the Robustness of a Neural Network, <\/em>IEEE Symposium on Reliable Distributed Systems (SRDS)<\/strong> 2017. paper<\/a>.
-E.M. El Mhamdi, R. Guerraoui. When Neurons Fail<\/em>, IEEE International Parallel and Distributed Processing Symposium (IPDPS)<\/strong> 2017. paper<\/a>.
-E.M. El Mhamdi*, J. Holovsky, B. Demaurex, C. Ballif, S. De Wolf. Is Light-Induced Degradation of a-Si:H\/c-Si Interface Reversible? <\/em>Applied Physics Letters<\/strong>. 2014. paper<\/a>.
-E.M. El Mhamdi, R. Guerraoui. Fast and Secure Distributed Learning in High Dimension. preprint<\/a>.<\/em>

Other Publications : <\/strong>

E.M. El Mhamdi, R. Guerraoui, A. Maurer, V. Tempez. Exploring the Borderland of the Gathering Problem.<\/em> Bulletin of the European Association of Theoretical Computer Sciences (EATCS<\/strong>) 2020. my colleague A.M. has some papers on the “gathering problem” (how agents, such as fish schools, agree on a position), the solutions to this problem from the distributed computing community are typically rule-based algorithms that each agent follows. I suggested that the gathering problem could easily be learnt by multi-agent reinforcement learning and V. Tempez joined us for his master thesis, resulting in this preprint,<\/a> mainly based on his thesis, later merged with another work and compiled by A.M here.
<\/p>\n\n\n\n

E.M. El Mhamdi, R. Guerraoui, A. Guirguis, L.N. Hoang, S. Rouault. Genuinely Distributed Byzantine Machine Learning. ACM Principles of Distributed Computing conference<\/em> PODC <\/strong><\/em>2020. preprint<\/a>.
In this paper, we take our first step outside the parameter-server setting where the server is trusted, and provide a Byzantine resilient solution for distributed learning with untrusted servers.
S.R. did most of the heavy-lifting (algo+proofs), A.G. provided experimental assistance and algorithmic contribution on the synchronous case. I provided the initial algorithmic idea, together with elements of the proofs and the manuscript writing as I was mentoring S.R. during his first years of PhD. LNH joined for the last iteration of the paper where he provided critical corrections to the proof.<\/p>\n\n\n\n

E.M. El Mhamdi, R. Guerraoui, H. Hendrikx, A. Maurer. Dynamic Safe Interruptibility for Decentralized Multi-Agent Reinforcement Learning.<\/em> Neural Information Processing Systems (NeurIPS)<\/strong>. 2017. Spotlight talk.<\/strong>paper<\/a>.
This paper generalises the safe-interruptibility framework of Orseau and Armstrong to multi-agent systems. H.H. did all of the heavy-lifting here. (I was his master’s semester project mentor and only provided conceptual problem setting, together with pointers to classic RL proofs that were re-adapted from Singh et al., Littman et al. etc.).<\/p>\n\n\n\n

R. R\u00f6\u00dfler*, L. Korte, C. Leendertz, N. Mingirulli, E.M. El Mhamdi, B. Rech, ZnO: Al\/(p) a-Si: H Contact Formation and Its Influence on Charge Carrier Lifetime Measurements<\/em>. 27th European Photovoltaic Solar Energy Conference (euPVsec). 2012. paper<\/a>. This paper uses some of my undergraduate physics work.<\/p>\n\n\n\n

E.M. El Mhamdi, R. Guerraoui, S. Volodin. Fatal Brain Damage<\/em>. 2019. preprint<\/a>.
in this paper, we provide a series of bounds on the fault tolerance properties of neural networks (this improves on and go beyond my two IPDPS and SRDS papers listed above). The work is led by S.V. whom I advised as a Masters research scholar. He worked on all the proofs while I only provided initial conjectures, problem setting and the writing.<\/p>\n\n\n\n

E.M. El Mhamdi, R. Guerraoui, L.N Hoang, A. Maurer. Removing Algorithmic Discrimination (With Minimal Individual Error). 2019. preprint<\/a>.<\/em>
This work started from an informal group discussion that L.H.N and me mathematically formalised, then I realised that if you try to define what an “almost-non-discriminating”<\/em> function is, you could somehow generalise the definition of “differential privacy”. We found that this was already proven<\/a> by Cynthia Dwork, Moritz Hardt et al. in 2011 and discarded the project. Later on, A.M. revived it by proving that you could prove some interesting results on “de-biasing” group discrimination while preserving some individual accuracy.<\/p>\n\n\n\n

H. Aslund, E.M. El Mhamdi, R. Guerraoui, A. Maurer. Virtuously Safe Reinforcement Learning<\/em>. 2018. preprint<\/a>.
This work is based on the master thesis of H.A which I supervised. He worked on all the technical proofs and most of the writing, I provided the initial problem setting, a few conjectures and the idea of relaxing the Greedy in the Limits with Infinite Exploration (GLIE) property to trade-off safe interruptibility with perturbed perception.<\/p>\n\n\n\n

Teaching:<\/strong>

Main instructor:<\/strong>
In 2018, I designed and taught a 40-hours course on the fundamentals of machine learning , statistics and the epistemology of induction <\/a>to the 1st cohort of PhD students and executive Masters at the newly founded Benguerir university in Morocco.

TA<\/strong>: Master-level courses (all at EPFL):
– Distributed Algorithms (2016,2017,2018) with Rachid Guerraoui.
– Optimisation for Machine Learning<\/a> (2018) with Martin Jaggi.
– Distributed Information Systems (2017) with Karl Aberer.
plus several Bachelor-level courses, mainly on probabilities, statistics, physics and pure mathematics .

Master thesis \/ projects supervision (all at EPFL):<\/strong>
– Isabela Constantin,  <\/em>Spring 2019, now resident at Microsoft AI research.
– Sergei Volodin, Fall 2018, now at University of California, Berkeley (CHAI)
– Henrik Aslund, Spring 2018, now a PhD candidate at Imperial College London
– Hadrien Hendrikx, Fall 2017, now a PhD candidate at Ecole Normale Sup\u00e9rieure and INRIA.
– Philip Yazdani, Spring 2017, now data scientist at Swisscom.
– S\u00e9bastien Rouault, Fall 2016, now a PhD candidate at EPFL and my most frequent co-author !
– Vladislav Tempez, Spring 2016, now a PhD candidate in Grenoble INP.<\/p>\n\n\n\n

Reseach Grants & Service <\/strong>:

Grants<\/strong>: I wrote the research plans (~15pages) of the following grants
– A Theoretical Approach to Robustness in Biological Distributed Algorithms. (written with Alexandre Maurer). 400 k$<\/strong>. P.I: R. Guerraoui.
– Machine Learning in Byzantium. 800 k$<\/strong>. P.I: R. Guerraoui.

Service<\/strong>: I have been a reviewer \/ program committee member for:
– Neural Information Processing Systems (NeurIPS) 2018, 2019 (ranked among top reviewers in quality)<\/strong>
– International Conference on Learning Representations (ICLR) 2019, 2020
– International Conference on Machine Learning (ICML) 2019
– Association for the Advancement of Artificial Intelligence (AAAI) 2020
– Uncertainty in Artificial Intelligence (UAI) 2019
– International Conference on Distributed Computing (DISC) 2017 (external reviewer)
– Safe Machine Learning Workshop (SafeML) at ICLR 2019<\/p>\n\n\n\n

MISC:<\/strong>

Before the PhD, I started Wandida, now an EPFL library of university-level scientific tutorials.<\/a> Before that, I co-founded Mamfakinch<\/strong><\/em> a moroccan web-media that won the 2012 Breaking Borders for free expression <\/a><\/em>award<\/a> from Google and Global Voices Online. I also worked for about a year as a research engineer in condensed matter physics.

With Dominique Boullier<\/a> (professor of Sociology at Sciences Po Paris), we wrote a paper on the conceptual and epistemological toolboxes that social sciences might borrow from theoretical computer science and learning theory. It is due to appear in November 2019 in the Revue\u00a0d’Anthropologie\u00a0des\u00a0Connaissances.<\/em>

If you survived until this paragraph and understand French, then you can probably survive this 3h podcast<\/a> with Science4all, one of the most prominent French science YouTubers. We discuss the important but highly overlooked question of why computer science should be regarded as quantitative epistemology<\/em>,<\/strong> i.e the science of how much can be done and how much can be known.<\/em><\/strong>
<\/p>\n\n\n\n


“\u0627\u0644\u0628\u062d\u0631 \u0645\u0646\u064a\u0646 \u0643\u0627\u064a\u0646\u0628\u0639 \u0648 \u0644\u0627\u0631\u0636 \u0627\u0644\u0644\u064a \u0643\u0648\u0651\u0631\u0647\u0627 \u0634\u0643\u0648\u0646”
(\u0627\u0644\u0645\u0639\u0637\u064a \u0622\u064a\u062a \u062d\u062c\u0651\u0648)

“\u0628\u0627\u063a\u064a \u0648\u064a\u062f\u0627\u0646 \u0645\u0646 \u0644\u0651\u0627\u062f\u0631\u064a\u0646\u0627\u0644\u064a\u0646 \u0641 \u0627\u0644\u062c\u0651\u0646\u0651\u0629 \u0645\u0627 \u0628\u0627\u063a\u064a \u0643\u0627\u0633 \u0645\u0627 \u0628\u0627\u063a\u064a \u062a\u064a\u062a\u064a\u0632\u0627\u062a”
(\u062c\u0648\u0627\u062f \u0623\u0633\u0631\u0627\u062f\u064a)<\/p>\n","protected":false},"excerpt":{"rendered":"

Research: Starting from mathematical formalisations of Robust Distributed Learning, my research has so far led to the first provably resilient algorithm for distributed machine learning and a series of follow-ups, some of the algorithms my co-authors and I devised, like Krum and Bulyan are deployed in industrial settings and have set the standard formalism (Byzantine ML) largely … Continue reading “”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-5","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/pages\/5","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/comments?post=5"}],"version-history":[{"count":300,"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/pages\/5\/revisions"}],"predecessor-version":[{"id":549,"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/pages\/5\/revisions\/549"}],"wp:attachment":[{"href":"https:\/\/elmahdielmhamdi.com\/index.php\/wp-json\/wp\/v2\/media?parent=5"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}