AI Initiative logoAI Initiative
Reading room / Modular ANN

Head-only activity: selected local result

Reports three-seed quadrant classification with engineered hidden features, frozen parameter and moment checks, independent checkpoint readback and explicit exact-rule comparison.

Historical bounded experimental result
This is the retained source text, not a new validation of its claims. Numerical results and comparative claims require the accompanying source review before public reuse.

Read the connected case study or article →

Not stated in document opening · 2026-10-05

Provenance, authorship and editorial notes

Head-only activity: selected local result

Id

modular-ann-docs-head-only-results-2026-10-05

Project

modular-ann

Source path

modular-ann/docs/HEAD-ONLY-RESULTS-2026-10-05.md

Source sha256

f0bfc9f30591078e9680f9e1f7a12c7ba1f3f897c3b84eb505f1aa75aa8e7aa4

Repo head

22e72c05bb0b180b6b59f3936c9f5afcd9ef6de3

Date

2026-10-05

Date provenance

Date in source filename or dated directory; not publication date

Git last change

2026-10-05T10:22:35+01:00

Author

Not stated in document opening

Document status

Historical bounded experimental result

Summary

Reports three-seed quadrant classification with engineered hidden features, frozen parameter and moment checks, independent checkpoint readback and explicit exact-rule comparison.

Topics
  • NN
  • ANN
  • evaluation
Related ids
  • modular-ann-docs-checkpoint-2026-10-05
  • modular-ann-docs-modular-skill-roadmap
  • modular-ann-docs-head-only-training
  • modular-ann-evidence-historical-retention-context-2026-10-05-ann07-retention-audit
  • modular-ann-evidence-historical-retention-context-2026-10-05-ann06-cohort-review
Evidence concerns
  • 99–100% held-out accuracy is for the authored synthetic quadrant task; no measured training speedup, representation discovery or useful repair transfer.
Word count

660

Headings
  • Head-only activity: selected local result
Publication status

Publication or peer-reviewed acceptance not established by discovery

Format

md

Private review scan
Known secret pattern hits

0

Customer or player record sets

None identified in selected narrative/design documents; no gameplay records, account databases or hand datasets copied.

Scope

Pattern scan plus document review; not a formal exhaustive privacy audit.

Head-only activity: selected local result

The research branch passed 39 local regressions, including the original frozen
90-example/350-update Task A replay and 13 new scope tests. Source verification
passed for all 34 recorded files. The numerical and original full-training
bodies remain byte-identical to the extraction baseline.

The separately predeclared quadrant activity used an engineered feature basis,
64 training points, 100 disjoint evaluation points and three fixed seeds. Both
fitted arms cloned the same parent, using 200 iterations, batch size 16 and
learning rate 0.01. No seeds, data, recipe or thresholds changed after results.

SeedFresh accuracyHead-only accuracyFull-training accuracyExact rule
119%100%100%100%
2930%100%100%100%
4735%99%100%100%

Each head arm passed its predeclared accuracy-gain and loss-reduction thresholds.
Head-only cross-entropy fell by 0.7294, 0.7268 and 0.7272 respectively. The full
arms achieved lower final loss than head-only. No speed comparison is qualified.

Head-only updated 20 policy-head parameters and preserved the 37 frozen
parameters, frozen moments, value predictions and active parent checkpoint.
The tests additionally preserve nonzero frozen momentum, signed zero and array
identity. Receipts join parent/result, binding, encoded data and sampler state.
Canonical JSON digests normalize signed zero, so those direct tests remain
necessary beside digest comparisons.

The selected profiles finished within their 30/180/120-second wall deadlines.
The activity retained 111,849 bytes in 11 files, below its predeclared 1 MiB
post-run file limit. This is an observed retained-output check, not an operating
system allocation quota or a whole-process memory/CPU bound. Execution occurred
on one local macOS arm64 runtime with Node 24.5.0 and Python 3.14.5.

The exact selection (../evidence/head-only-2026-10-05/VALIDATION-SELECTION.json),
validation receipt (../evidence/head-only-2026-10-05/VALIDATION.json),
activity receipt (../evidence/head-only-2026-10-05/ACTIVITY-RECEIPT.json) and
stdout/stderr logs are retained. These are coordinator-executed results;
independent source review preceded them. An
independent readback (../evidence/head-only-2026-10-05/INDEPENDENT-READBACK.json)
verified all nine persisted checkpoints and reconstructed held-out predictions,
class counts and loss from their weights using separate mathematical code.
This was result verification, not a training rerun. A genuine read-only
Claude source review (../evidence/head-only-2026-10-05/CLAUDE-SOURCE-REVIEW.md)
accepted the source with limits and no blocking defect.

Claude identified regression gaps for staged bound failures, non-writable head
state and tensor aliasing at optimizer creation. The initial 39-test run did not
exercise those specific cases. A separately selected follow-up added three test
declarations with eight cases; all 16 tests in train-scope.test.mjs passed.
These assert that staged bound failures and non-writable state refuse before
weights, moments or step change, and that valid-shaped aliases refuse at
optimizer creation. Production sources stayed unchanged; removing the additions
restores the original 13 tests and helpers byte for byte.

The follow-up selection (../evidence/head-refusal-2026-10-05/VALIDATION-SELECTION.json),
receipt (../evidence/head-refusal-2026-10-05/VALIDATION.json), raw logs and
independent readback (../evidence/head-refusal-2026-10-05/INDEPENDENT-READBACK.json)
are retained with a capture inventory (../evidence/head-refusal-2026-10-05/CAPTURE.json).
This closes Claude's specific F2 coverage gap. Only the selected 16-test file ran
in the follow-up; the current 42-test full suite was not rerun. Independent
readback verified artifacts and source, without executing the tests again.

The canonical JSON example restrictions and callback receiver behavior are
documented in the training contract. Prose updates after the initial execution
have a separate provenance record; production sources and the activity protocol
stayed fixed. The follow-up test change has its own selection and results above.

The activity capture (../evidence/head-only-2026-10-05/activity/CAPTURE.json)
also retains the three parents, six fitted inference checkpoints and exact
training/evaluation data. These weights serve the synthetic quadrant task;
they do not carry repair or security skill. To reproduce on a new output path:

npm run verify:source
npm test
mkdir -p artifacts
node scripts/verify-head-only-activity.mjs --output "$PWD/artifacts/head-only-new-run"

Preserve existing output directories. The original protocol and its thresholds
remain fixed; a fresh result on another runtime is a separate observation.

This demonstrates selective readout learning for the authored quadrant task.
It does not establish representation discovery, learned-module transfer,
retention of changed policy behavior, scientific confidence, useful network
repair or hostile-agent security. The exact rule remains a perfect, simpler
reference. Historical ANN06/ANN07 failures, full ANN08/ANN09 campaigns and
container containment Q0-Q5 remain separate and unfinished.

Continue exploring