2026 · Zenodo (CERN European Organization for Nuclear Research)

SCALAR: cross-scale nanoparticle benchmark generation pipeline and evaluation code

Can Polat , Erchin Serpedin , Mustafa Kurban , Hasan Kurban

Resource highlights

SCALAR generation and evaluation tools

Generate nanoparticles and evaluate model reasoning using explicit geometric controls.

Why we investigated it

A benchmark's reported behavior depends on how structures, rotations, and evaluation splits are constructed.

What the work contributes

The software implements cell expansion, spherical carving, SO(3) rotations, radius-based partitioning, and model-evaluation tasks.

What the evidence shows

The release documents regeneration checks against the archived seed structures, including the cases that do not reproduce atom counts exactly.

Build on this work

Use the software with the separately archived seed inputs to run direct prediction, reasoning, and retrieval evaluations.

  • Benchmark software
  • Nanoparticle generation
  • Foundation-model evaluation
  • SCALAR
Abstract
Code and generation pipeline for the SCALAR cross-scale nanoparticle benchmark. Phase I builds nanoparticles from unit-cell CIFs: primitive-cell setup, supercell replication to at least 2Rmax + δbox in every direction, carving-centre selection, spherical truncation for R = 10–30 Å, and box-margin verification. Phase II samples rigid rotations on SO(3) under a geodesic-spacing constraint. Phase III applies split-aware partitioning by carving radius. Also included: the language-model evaluation tasks (direct property prediction, chain-of-thought variants, inverse retrieval), graph-neural-network baselines, and the dataset characterisation analyses. Regenerating all 83 materials at all 21 radii reproduces the archived seed structures' atom counts exactly for 1,737 of 1,743 structures, with coordinates agreeing to 10-8 Å or better for 82 of the 83 materials. The seed inputs are archived separately; the concept DOI 10.5281/zenodo.20631920 resolves to the latest version of that record.
Cite
@article{polat2026software,
  title = {SCALAR: cross-scale nanoparticle benchmark generation pipeline and evaluation code},
  author = {Can Polat and Erchin Serpedin and Mustafa Kurban and Hasan Kurban},
  year = 2026,
  journal = {Zenodo (CERN European Organization for Nuclear Research)},
  doi = {10.5281/zenodo.22234832},
}