metrics

Exp 0 - metrics report

Layer 2 · PCFG toy 4L d_model=448 / pcfg · matryoshka_hook_resid_post_L2 · 1,792 latents in 8 blocks · 646,000 tokens over 2000 docs · edge: reverse coverage ≥ 0.5, both endpoints fire ≥ 20

Block pair 0->1 - 27 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
14 -> 253 1.00 0.02 1.30 1.91/0.54 Y 1.00 - feature 14 feature 253
11 -> 307 0.99 0.02 1.45 3.35/0.06 Y 1.00 0.00 feature 11 feature 307
68 -> 307 0.99 0.02 1.47 1.57/0.06 Y 1.00 0.00 feature 68 feature 307
11 -> 337 0.99 0.05 1.45 3.98/0.11 Y 1.00 0.00 feature 11 feature 337
68 -> 337 0.99 0.05 1.46 2.86/0.11 Y 1.00 0.00 feature 68 feature 337
200 -> 307 0.99 0.02 1.18 3.78/0.06 Y 1.00 0.00 feature 200 feature 307
192 -> 337 0.99 0.08 1.93 3.60/0.11 Y 1.00 - feature 192 feature 337
200 -> 337 0.99 0.04 1.17 5.60/0.11 Y 1.00 0.00 feature 200 feature 337

Block pair 1->2 - 5 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
375 -> 522 0.88 0.01 1.85 0.08/-0.01 n 1.01 - feature 375 feature 522
405 -> 522 0.68 0.01 1.85 0.03/-0.01 n 1.02 - feature 405 feature 522
239 -> 522 0.67 0.01 1.97 0.02/-0.01 n 0.99 - feature 239 feature 522
397 -> 522 0.63 0.01 1.79 0.02/-0.01 n 0.97 - feature 397 feature 522
342 -> 522 0.57 0.01 1.61 0.02/-0.01 n 0.99 - feature 342 feature 522

Block pair 2->3 - 1 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
578 -> 881 0.98 0.30 5.26 0.85/0.53 Y 1.00 - feature 578 feature 881

Block pair 3->4 - 0 candidate edges

Block pair 4->5 - 2 candidate edges

parent -> child R F PMI recon P/C gain recon? surv sib parent label child label
1031 -> 1292 0.94 0.14 4.35 0.68/0.06 Y 0.99 0.01 feature 1031 feature 1292
1031 -> 1252 0.81 0.26 4.20 0.38/0.19 Y 1.00 0.01 feature 1031 feature 1252

Block pair 5->6 - 0 candidate edges

Block pair 6->7 - 0 candidate edges