Decisions under non-stationarity
Planning and reinforcement learning in large, stochastic, partially observable environments whose dynamics drift, detecting the change and then adapting online.
I am Ayan Mukhopadhyay, Assistant Professor of Computer Science at the College of William & Mary, where I direct the RAIL group. We build robust, adaptive, and interpretable algorithms for decision-making under uncertainty, and deploy them in emergency response, public transit, energy, public health, and conservation.
Featured project
Visiting from the NSF Civic Innovation Challenge PI meeting?
Sensor-enabled enforcement of non-compliant traffic right-of-way closures, our NSF CIVIC project with the city of Nashville. The project site walks through how detection, prioritization, and officer dispatch fit together, and includes a demo you can try.
What we work on
Our problems come from partners who operate real systems: fire departments, transit authorities, public-health non-profits, and utilities. That constraint shapes the methods: the models must stay calibrated as the world shifts, the decisions must be explainable to the people who act on them, and the whole pipeline has to keep running when conditions are nothing like the training data.
Planning and reinforcement learning in large, stochastic, partially observable environments whose dynamics drift, detecting the change and then adapting online.
Many agents acting at once under partial information and shared constraints. In transportation, healthcare, and sustainable energy, a decision made for one of them changes the problem for the rest.
Explanations a dispatcher or planner can interrogate, built from formal logic and language models rather than post-hoc rationalization.
News