Research engineering and scientific machine learning for adaptive biomedical systems.

I build sequential decision-making, generative modelling and simulation methods for complex biological systems—from closed-loop insulin delivery to neuromodulation.

Reinforcement LearningScientific MLDynamical SystemsComputational Neuroscience
Two closed-loop research systems: glucose measurements guide a reinforcement-learning algorithm that selects insulin doses, while EEG observations guide an algorithm that selects transcranial alternating-current stimulation.
Closed-loop control across (a) insulin delivery and (b) brain stimulation: physiological signals inform a learning algorithm, which selects the next intervention.

Featured work

NeuroStimEnv

Closed-loop brain stimulation as a computational control problem

Full project →

NeuroStimEnv is an open-source simulation framework for combining biophysical neural circuits, simulated EEG, transcranial stimulation and reinforcement learning for treatment discovery.

It integrates NEURON, LFPy and SimNIBS and supports reinforcement-learning formulations in which neural activity provides observations and stimulation parameters define treatment actions.

Technical summary

  • Biophysically detailed depression and healthy cortical microcircuits
  • A 1,000-neuron case study evaluated at 0.025 ms temporal resolution
  • MPI/HPC experiments reported using 624 CPU processes
Closed-loop NeuroStimEnv workflow: a human cortical microcircuit produces simulated EEG observations; a reinforcement-learning agent selects stimulation actions that feed back into the circuit. NEURON, LFPy and SimNIBS provide circuit, signal and stimulation modelling.
The simulation loop: neural activity provides observations, a learning agent chooses stimulation parameters, and the circuit responds. This framework supports computational experiments; it is not clinical validation.
Reinforcement LearningComputational NeuroscienceEEGNEURONSimNIBSLFPy

CAPSML / G2P2C

Towards fully closed-loop artificial pancreas systems

Full project →

A research ecosystem for learning adaptive insulin-dosing strategies that reduce dependence on manual meal announcements and carbohydrate estimation.

G2P2C combines reinforcement-learning policy optimization with glucose dynamics modelling and short-horizon planning. CAPSML exposes the research through an interactive simulation platform, while GluCoEnv and RL4T1D provide reusable open-source research infrastructure.

Technical summary

  • A POMDP formulation for insulin dosing without meal announcements
  • Policy optimization augmented with learned glucose dynamics and short-horizon planning
  • Reusable simulation and RL infrastructure in GluCoEnv and RL4T1D, with interactive analysis in CAPSML
An illustrative in-silico glucose-control experiment. Blue shows sensed glucose, red marks meals, and green shows insulin delivery. Use the playback controls to pause or replay the animation. These are simulated signals, not patient data.
Reinforcement LearningSequential Decision-MakingControlPOMDPsPyTorchBiomedical AI

NeuroStimFlow

Conditional flow matching for simulated EEG dynamics

A conditional generative emulator that learns EEG transitions from biophysical neural-circuit simulations, exploring a surrogate for costly simulation runs.

A disorder-conditioned flow-matching backbone models shared EEG dynamics; lightweight residual adapters model stimulation-conditioned changes. Evaluated on simulated signals, with therapeutic outcome prediction remaining an open challenge.

Technical summary

  • Conditional flow matching for one-step EEG transitions
  • Residual and low-rank adapters for stimulation conditioning
  • Evaluation of spectral realism, disorder-related structure and stimulation-response fidelity
NeuroStimFlow overview: biological neural circuits are modelled with biophysical simulations of EEG and brain stimulation, then emulated with a flow-matching neural surrogate.
From biophysical neural-circuit simulations to a conditional flow-matching EEG emulator. View full-size figure.
Flow MatchingGenerative ModellingScientific MLEEGSurrogate Modelling

Preprint forthcoming. Public paper and code links are not yet available here.

What I build

Methods and systems that connect learning algorithms to scientific models, simulation environments and real experimental constraints.

Sequential decision-making

Reinforcement learning, offline RL, contextual and multi-armed bandits, adaptive control and POMDP formulations.

Scientific machine learning

Generative modelling, flow matching, learned dynamics, surrogate modelling and time-series ML.

Computational modelling

Biophysical neural circuits, physiological simulation, EEG and signal processing, and dynamical systems.

Research engineering

PyTorch, NEURON, LFPy, SimNIBS, MPI/HPC, experiment infrastructure and reproducible open-source research.

Contact

If you would like to discuss research systems, sequential decision-making or machine learning for biomedical science, email is the most direct route.