metrics

Exp 0 - metrics report

Layer 2 · PCFG toy 4L d_model=448 / pcfg · matryoshka_hook_resid_post_L2 · 1,792 latents in 8 blocks · 1,022,000 tokens over 2000 docs · edge: reverse coverage ≥ 0.5, both endpoints fire ≥ 20

Block pair 0->1 - 184 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
99 -> 424 0.99 0.01 1.15 5.24/0.19 Y 1.00 0.08 feature 99 feature 424
156 -> 424 0.98 0.16 4.02 1.05/0.19 Y 1.00 0.15 feature 156 feature 424
156 -> 330 0.97 0.08 4.01 2.10/0.13 Y 1.00 0.15 feature 156 feature 330
29 -> 317 0.96 0.07 3.72 1.56/0.15 Y 1.00 - feature 29 feature 317
140 -> 430 0.95 0.15 2.07 0.35/0.07 Y 1.00 0.09 feature 140 feature 430
126 -> 424 0.95 0.13 3.80 2.45/0.19 Y 1.00 0.31 feature 126 feature 424
140 -> 317 0.92 0.01 2.03 0.68/0.15 Y 1.01 0.09 feature 140 feature 317
181 -> 317 0.83 0.01 1.51 0.71/0.15 Y 1.01 0.00 feature 181 feature 317

Block pair 1->2 - 3 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
229 -> 645 0.67 0.00 1.99 0.02/0.00 n 0.93 - feature 229 feature 645
376 -> 645 0.66 0.00 1.78 0.01/0.00 n 1.02 - feature 376 feature 645
299 -> 562 0.61 0.00 2.11 0.02/0.29 Y 1.02 - feature 299 feature 562

Block pair 2->3 - 2 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
615 -> 752 0.61 0.00 2.51 0.03/0.01 n 1.01 - feature 615 feature 752
594 -> 888 0.54 0.00 2.08 0.02/0.02 Y 1.14 - feature 594 feature 888

Block pair 3->4 - 0 candidate edges

Block pair 4->5 - 0 candidate edges

Block pair 5->6 - 1 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
1167 -> 1541 0.55 0.00 3.37 0.13/-0.00 n 0.81 - feature 1167 feature 1541

Block pair 6->7 - 1 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
1463 -> 1710 0.68 0.01 4.10 0.20/0.02 Y 0.90 - feature 1463 feature 1710