2026 · arXiv · Preprint

STEMGym: Benchmarking Sequential Decision-Making under Dose Budgets in Autonomous Electron Microscopy

Can Polat , Erchin Serpedin , Mustafa Kurban , Hasan Kurban

Research highlights

STEMGym: measuring useful information per electron dose

Benchmark perception and sequential decisions under a shared microscopy dose budget.

Why we investigated it

Every STEM measurement deposits dose, so better acquisition must be assessed against information gained per exposure.

What the work contributes

STEMGym separates perception, navigation, and planning across 15 simulated worlds and four characterization tasks.

What the evidence shows

In the reported comparison, adding a trained CNN analyst to raster scanning raises dose-efficiency score by 5.5 times; adaptive navigation adds no statistically significant gain.

Build on this work

Use the benchmark design to isolate which part of an autonomous imaging system improves performance under a fixed budget.

  • Autonomous microscopy
  • STEM
  • Sequential decision-making
  • Dose efficiency
Abstract
A central premise of autonomous scientific imaging is that smarter navigation, whether Bayesian, RL-based, or otherwise adaptive, is the principal lever for sample-efficient acquisition. We present evidence to the contrary in scanning transmission electron microscopy (STEM), an atomic-resolution imaging modality whose every measurement deposits damaging electron dose. We introduce STEMGym, an open-source Gymnasium benchmark of 15 physics-simulated STEM worlds spanning five materials, three difficulty levels, and four characterisation tasks, scored by the Dose-Efficiency Curve area (DEC-AUC), a single scalar capturing the information-vs-dose Pareto frontier. Across 33 agent configurations under realistic dose budgets, the dominant determinant of dose efficiency is the analyst (perception) pipeline, not the navigator: pairing a trained CNN analyst with naïve raster scanning raises DEC-AUC by 5.5x over a CNN-free raster baseline (0.287 vs.\ 0.052), while substituting Bayesian or adaptive finite-state-machine navigation for raster yields no statistically significant further gain. Production-tier vision-language models further underperform task-specific CNNs by {\sim}13x on crystallographic defect analysis. By decoupling perception, navigation, and planning under a unified dose budget, STEMGym reframes where ML effort should be invested in autonomous electron microscopy and provides the measurement infrastructure to test it.
Cite
@misc{polat2026stemgym,
  title = {STEMGym: Benchmarking Sequential Decision-Making under Dose Budgets in Autonomous Electron Microscopy},
  author = {Can Polat and Erchin Serpedin and Mustafa Kurban and Hasan Kurban},
  year = 2026,
  journal = {arXiv},
  doi = {10.48550/arxiv.2606.29592},
  url = {https://arxiv.org/pdf/2606.29592},
}