Attacks
Defenses
Rows are attacks and columns are defenses: the baselines first, then the oldest papers first. Each cell is the mean over seeds, with the standard deviation and the number of seeds. A grey cell is not applicable, invalid or failed: hover for the reason.
Verification log
Every rerun of a shown cell. The verify-lite workflow reruns each lite cell on a GitHub runner after merge: a match within the lite tolerance makes the cell reproduced, a mismatch disputed.
Each ported attack reruns the setting of its paper with three seeds. The papers report ASR over every test sample, the target class included, so replications compare ASR (target class included).