Raphaël Reynouard

Postdoc Researcher · Generative AI · Software Verification
University of Luxembourg · Luxembourg

I possess a PhD in Machine Learning, devoted chiefly to its application to critical systems through the rigours of Model Checking.
My most recent postdoctoral appointment at Eawag saw me applying deep learning to the rather less theatrical, though no less obstinate, domain of hydrology.
I am now pursuing a postdoc at Université du Luxembourg, where I contrive generative AI methods to assist the training of critical systems, with particular attention to the ambitions of spatial and Martian exploration.
I also bring extensive experience in Python, most visibly embodied in the development of the Jajapy library.


Skills

Programming Languages & Tools
  • python
  • pytorch
  • numpy
  • scikit
  • r
  • github
  • node
  • react
  • js
Technical Knowledge
  • AI, Deep Learning, Computer Vision, Statistical Foundations of Machine Learning
  • Data Analysis and Visualization
  • Full-stack development
  • Automata Theory & Markov Models, Model Checking
  • Algorithm Design
  • Numerical Methods
Languages
  • French, native
  • English, full professional proficiency
  • German, basics
  • Icelandic, basics

Experiences

Postdoc Researcher

University of Luxembourg (SnT) · Luxembourg, Luxembourg
  • Generative AI · Software Testing & Verification
since October 2025

Chief Technology Officer

Kleidrobe · Berlin, Germany
  • Deep learning · Computer vision · Fashion
  • Built an AI model for online customer sizing
January 2025 - August 2025

Project Leader

Bains de Saillon · Saillon, Switzerland
  • Algorithmic · Full Stack
  • Developed Janus, a HR management software
  • Automatic generation of employees schedules following legal constraints and personal preferences
  • Python Backend, Flask API, SQL database, Bootstrap frontend
November 2024 - February 2025

Postdoc Researcher

EAWAG · Dübendorf, Switzerland
  • Deep Learning · Generative AI · Hydrology
  • Developed deep learning and generative AI methods for structure learning and parameter estimation of mass-conserving process-based models
January 2024 - September 2024

IT Specialist

Expo Kilim · Brussels, Belgium
  • Database management
  • Maintained internal website and managed CCTV system setup
June 2018 - September 2019

Education

Ph.D. in Computer Science

Reykjavík University · Reykjavík, Iceland
  • Machine Learning · Model Checking
  • Anna Ingólfsdóttir · Giovanni Bacci
  • On learning stochastic models: from theory to practice
  • Developed and implemented unsupervised machine learning methods for parameter estimation of Markov models.
  • Managed my own research agenda and gave talks across Europe (Belgium, Switzerland, Germany, Denmark, Italy)
August 2020 - November 2023

M.S. in Computer Science

Université Libre de Bruxelles · Brussels, Belgium
September 2018 - June 2020

B.S. in Computer Science

Université Libre de Bruxelles · Brussels, Belgium
September 2018 - June 2020

Publications

On learning stochastic models: from theory to practice

R. Reynouard
PhD Thesis

A MM Algorithm to Estimate Parameters in Continuous-time Markov Chains

G. Bacci, A. Ingólfsdóttir, K. G. Larsen, R. Reynouard
QEST'23

Jajapy: a learning library for stochastic models

R. Reynouard, G. Bacci, A. Ingólfsdóttir
QEST'23

Active Learning of Markov Decision Processes using Baum-Welch algorithm

G. Bacci, A. Ingólfsdóttir, K. G. Larsen, R. Reynouard
ICMLA'21

Online Learning of non-Markovian Reward Models

G. Rens, J.-F. Raskin, R. Reynouard, G. Marra
ICAART'21

Tool

Jajapy

A Machine Learning Python library for Markov models
A python library implementing the Baum-Welch algorithm on various kinds of Markov models.
  • Learning HMMs, MCs, MDPs and CTMCs from traces.
  • Parameter estimation for synchronous composition of CTMCs.
  • Parameter estimation for PCTMCs.
  • Compatibility with Prism and Storm.
Since 2022

Research activities

Artifact evaluation committee member

QEST'23

Artifact evaluation committee member

QEST+FORMATS'24


Side Projects

Playground

Visualization of several algorithms that facinate me

Which is AI

Guess which of the pictures is AI generated
(Offline)