metrics

pcfg-matryoshka/fmt_2308_s1

Layer 2 · PCFG toy 4L d_model=448 / pcfg · matryoshka_hook_resid_post_L2 · 1,792 latents in 8 blocks · 646,000 tokens over 2000 docs · edge: reverse coverage ≥ 0.5, both endpoints fire ≥ 20

The same metric battery as the gemma layers, on an SAE from a different source. Nothing in metrics/ changed to produce these numbers; the block structure, the model and the dictionary all come from the run’s own cached statistics.

Page What is on it
Dashboard filter funnel and the per-block-pair distributions
In-block same-level edges and duplicates inside one block, where no block ordering fixes direction
Metrics report the numbers behind the dashboard, as text
In-block report the same-level edges and duplicates per block, as text

The exp0_stats.pt cache and the token cache behind these numbers are not in git – they are rebuildable from the run directory by adapters/from_pcfg.py.