PYTHON VISUALSRESEARCH · AUGUST 2026

Apeiron OS — Case Study

Multi-agent AI operations under measurement — shared memory, model diversity, and the propose boundary, with the null results left in

Python Visuals LLC · August 2026 · v1

1 · Summary

Between August 13 and August 30, 2026, a one-person company ran a series of structured tests on the question most multi-agent AI writing skips: when several AI agents work the same operation, what can you actually trust, and how do you find out?

The test bed was real. Python Visuals LLC operates Apeiron OS — an operating substrate that runs a working web-services business: live client sites, a fleet of roughly twenty scheduled autonomous workers (internal jobs, not a product), and a shared memory layer written to by four different AI workspaces, including agents from three different model vendors. Every test below ran against production state or sealed fixtures, and every claim in this document traces to a dated primary record. The set is published as a founder-authored operational field report: first-party research whose key artifacts are committed by full hash in a companion evidence index — not independently validated results, which are the next evidence tier and are not claimed.

The headline findings:

  1. Model monoculture silently voids agreement evidence. A multi-agent floor produced 12-of-14 convergence between two "independent" reviewers — then measurement showed every seat on the floor ran the same model. The agreement was uninterpretable, and seating a different model later does not repair the back catalogue. Agreement between agents is only evidence when their errors are decorrelated, and that has to be arranged, not assumed.
  2. Shared memory across AI agents works — under governance most systems don't have. Sixty-two completed cross-agent work orders, seventeen promoted operating rules, and four writers (Claude, Codex, Grok, and a cloud workspace) on one memory layer, held together by five structural constraints: one writer per file, provenance on every finding, capabilities that must be probed before work is addressed to them, an always-read layer only the human can promote into, and a standing law that outranks any single order — including, on one recorded occasion, the operator's own instruction.
  3. Selection beats bulk. In a three-arm ablation, an agent given a 13 KB kernel — judgment selected from a 500 KB corpus and attached to the steps where it fires — outperformed the same agent given all 20 KB of the directly relevant raw material, on 37% fewer prompt bytes, and both beat the no-corpus arm. Raw memory being present is not the same as the right rule arriving at the moment it fires; the corpus arm carried the exact rule naming a trap and fell into that trap twice.
  4. Two follow-up experiments returned null — and were allowed to. A sealed conduct-transfer experiment ($11.22, independently judged by a different vendor's model) and a retrieve-then-revise experiment both came back "not a win." Nothing was shipped on either result. The discipline that produces trustworthy positives is the same discipline that publishes its negatives.
  5. "Enforced by construction" must be verified from inside. A worker rail believed to be credential-free was found — by one of its own workers, disclosing unprompted — to inherit roughly one hundred account-level connector tools from the authenticated session, declared in no config file. Every audit run from the operator's shell had read empty, because a capability audit from the operator's shell measures the operator's shell. Enforcement was moved to the launcher and re-verified from inside the worker.
  6. A competitor's agent can run your desk if the boundary is physics, not policy. The operation's first deliberate credential to an external AI (xAI's Grok, August 28) was a scoped badge into a redacted lane where the only write path is a staged-proposal table whose constraints live in the database. First supervised shift: 21 in-lane calls, zero attempts at out-of-lane verbs, report matching ground truth.
  7. The full loop closed. An external AI files a work order into shared memory, the human routes it, a different vendor's AI builds it, the human ships it, and production verification confirms it — three complete cycles ran through that loop in a single day (August 29–30), delivering a storefront that supports checkout for human and machine buyers alike. (No machine purchase has yet occurred; the watch on that is public in our own records.)
  8. The honest limits are structural. Nearly everything here is n=1 or n=2, on one person's machine — and one finding shows that machine's own boundary contaminates every "uncalibrated" control run inside it. The one metric the whole thesis turns on — the system compounding the judgment of a person who is not its operator — still reads zero. This document says so, because a case study that can't state its nulls can't be trusted on its wins.

2 · The operation under test

Apeiron OS is not a demo environment. It is the substrate a real company runs on:

Everything below was tested against this — live queues, live schedulers, live client-facing surfaces — which is why the findings carry operational texture that sandbox experiments don't.

3 · Test bed one: shared memory across four AI workspaces

The problem it exists to solve

By mid-August the operation had four AI workspaces: Claude Code running locally, a cloud Claude workspace, a Codex workspace, and later a Grok-based business agent. They could see some of the same state. They could not hand work to each other, and none knew what the others could actually reach. Work had already been misrouted to a workspace that turned out to have no way to do it — not through carelessness, but because a capability had been written down that nobody had ever checked.

The shared layer ("Laughtale") was built on August 13 to fix exactly one thing: a finding made in one workspace should change how the others behave.

The governance that makes it survivable

An always-appendable shared memory dies in weeks — it fills faster than anyone can absorb, and noise is cheaper to produce than signal. The layer survives on six rules; five of them are structural:

The sixth rule binds the human: a ruling given in conversation is not law until written into the folder. The agents are instructed to hold the operator to it.

What it produced

As of August 30: 62 completed cross-agent work orders, zero open; 17 promoted rules, each with a one-line trigger, a one-page statement, and a case file of incidents; four self-maintained capability rosters. The rule layer was re-architected once — at 32 KB it was being read whole by three workspaces at every session start, and was split into a one-page index plus load-on-demand rule and case files, cutting orientation cost 86% without deleting a byte.

Three incidents show the governance actually binding:

The relay incident. One work order copied another workspace's private memo verbatim into the shared layer — the most identifying content in the folder, in a folder with no version control and no undo. The operator ruled a redaction (payload excised, source untouched), and the durable rule was promoted: a verbatim relay inherits the source's sanitisation standard, not the destination's. Copying is the one transfer mode that performs no filtering — which is exactly why it gets chosen when fidelity matters, and exactly when filtering matters most.

The scheduler mystery. Agents across three workspaces enumerated every scheduling view they could reach and found that fourteen live scheduled tasks were registered where no agent could see or manage them. The initial conclusion — "reachable by nobody" — was corrected within the hour, three times, converging on a rule now in the law layer: a probe measures your vantage, not the world. The registrar turned out to be the operator's own human-only scheduler UI; the proof came from the act's exhaust (he deleted thirteen registrations by hand and the store shrank while every agent view held still), not from another absence-probe.

The operator outranked by his own law. At the August 29 ruling sitting, the operator tapped "accept all" on a deposit queue — colliding with a hold he himself had placed eleven days earlier, whose release condition had not been met. Under the collision rule, the standing layer won: the deposit stayed held, and the collision was surfaced to him rather than executed. A governance layer that binds only the agents is a suggestion; this one demonstrated it binds the principal too.

4 · Test bed two: the agent floor and the monoculture finding

The audit

In mid-August the operation evaluated Munder Difflin, an open-source (MIT) desktop harness that runs a floor of CLI agents as a simulated office. A read-only audit on a fresh Windows install produced six defect findings — five reproduced live with receipts, covering the autonomous loop failing to start, workers being reaped before their first turn, and an unquittable zombie state — written up and delivered to the maintainer.

Two of the six were not ours. The harness's own orchestrator agent found the sixth entirely on its own during a routine standup, and corrected our fifth: our draft claimed a spawned worker never receives its objective; the orchestrator produced the counter-example, identified that we had measured latency and reported it as structural absence, and told us not to repeat the strong form. He was right, and the correction was published visibly in the findings document rather than smoothed away — because how a correction arrives is itself evidence about a harness.

The same orchestrator later declined to complete an orphaned task whose deliverable's filename encoded that a specific worker had produced it — reasoning, unprompted, that writing it himself would be "a truthful artifact under a name that lies about its provenance." No instruction told him that. It is the single best observed example of an agent behaving like a colleague rather than a task-runner.

The monoculture discovery

The floor's flagship result looked excellent: two independent reviewer agents, run separately over the same fourteen-row disposal queue, agreed on 12 of 14 dispositions — with both divergences falling exactly on the two self-referential meta-rows. "Independent readers converge on object-level judgments and diverge where the disposition is self-referential" is a genuinely sharper claim than unanimity.

Then, on August 15, someone measured the seats. Every agent on the floor was running the same model. The convergence was uninterpretable — same weights reading the same evidence is one reader with extra steps, and nothing about the result distinguishes "two minds agreed" from "one mind agreed with itself."

The immediate proposal — seat an agent from a different vendor, which "retroactively gives the convergence a denominator" — was corrected within the hour, by the floor's own orchestrator: seating a new model repairs nothing retroactively. The old measurement is uninterpretable and stays uninterpretable; the seat makes only future agreements interpretable, and only on paired runs. Reading the seat as fixing the back catalogue would be a second uninterpretable claim stacked on the first.

He caught a second error in the same reply: the proposal had justified the seat with an example that was actually about vantage (same model, different position) when the seat actually buys decorrelated inference (different family, same evidence). Two different purchases — and the distinction had been stated correctly the same morning, then blurred when it became inconvenient for the pitch.

The operational consequences, now standing law in the operation:

5 · Test bed three: controlled experiments on calibration

The operation's core asset is a written judgment layer. Whether that layer actually transfers into agent behavior — and how it should be delivered — was tested in sealed experiments rather than assumed.

The ablation: nothing vs. everything vs. a kernel

Three arms, same job, same delivery channel. One received no calibration corpus; one received the full raw corpus (about 20 KB of directly relevant material from a 500 KB layer); one received a distilled "kernel" — the judgment relevant to the job's shape, selected and attached to the moments it fires (about 13 KB).

Result, on a six-point form rubric: 2/6 without, 4/6 with the raw corpus, 6/6 with the kernel — and only the kernel arm also reached the correct answer, on 37% fewer bytes than the corpus arm. The sharpest detail: the raw-corpus arm carried the exact written rule naming a specific trap, and fell into that trap twice. Presence is not application. Selection attached to the firing moment is what transfers.

A later production kernel distilled a ~499 KB corpus to 16 KB (3.2%) for $1.87 in inference — and an agent inducted with it reached all three pre-registered conduct markers without ever seeing the scoring rubric.

The correction that made the ablation honest

Eleven days later, a records audit found that every arm — including "no calibration" — had silently inherited the machine's 34 KB operating charter, because the runner loads it into every session on that machine by design. The relative comparison survives (a confound present equally in all arms confounds nothing relative), and arguably strengthens the kernel's win — the baseline was better equipped than recorded and still lost. But the absolute labels were wrong, and the deeper finding was structural: the operation's boundary is the machine, not the folder. Any experiment run inside it is the system measuring itself with its own instruments. A genuinely clean uncalibrated control was impossible on that rail until a suppression mechanism was built (August 28) — which produced the first bare-model control the operation has ever run, receipts kept.

Two sealed nulls

Conduct transfer (August 16). Does a distilled kernel improve an agent's conduct — verification honesty, claim discipline — beyond the standing floor? Four sealed runs, $11.22, inputs hash-frozen before execution and re-verified after (zero drift), scored blind by a judge from a different vendor (an OpenAI Codex-family model) that had built none of the apparatus — independent of construction, though not institutionally independent of the operation. Verdict: not a win. Kernel arm 6 failures in 45 scored items; control 6 in 50; the control held both the best and worst single runs. Consequence enforced: no rollout, no floor change, do not re-run.

Retrieve-then-revise (August 16). Does giving a reviser a reader-agent's retrieved rules beat ordinary revision? Six blinded revisions across three arms including an equal-bytes decoy, $10.03, sealed and later judged by the same cross-vendor seat. Not a win — split at n=2, the decoy arm performing as well as the treatment, and the reader failing to attach the one rule that mattered. The mechanism was dropped entirely after a stronger-model probe reproduced the attachment failure. Nothing was built.

The point of reporting these is not modesty. A system that only publishes its wins has no way to know whether its wins are real. These two nulls are what make finding 3 above worth believing.

The instrument that lied, and the test that couldn't see it

A routing hook was built to inject relevant calibration into sessions by scoring each user turn against trigger phrases. It benchmarked at 94% and ran for days — and injected nothing, ever, in production: it read a field name that the running binary didn't populate, so every real turn scored as empty. The test harness could not catch this because it built its payloads with the same wrong field name — the test and the bug shared a defect. Once fixed against reality, the matcher proved too noisy to trust and was demoted to log-only.

Kept, in the corpus and now here, as a paired lesson: a benchmark that shares assumptions with the system under test measures the assumptions, and a claimed delivery channel is not delivering anything until observed from the receiving end.

The experiment chain that audited itself

The most instructive sequence ran through the shared memory layer as a chain of work orders between three workspaces: a cross-vendor comparison (a Claude agent and a Codex agent given "the same" brief), scored, with a same-model control pair commissioned to test whether an observed divergence traced to the models or the setup.

Mid-chain, the cloud workspace — re-verifying its own earlier certification while waiting on other work — discovered that the two arms had never received the same brief. It had previously compared the blocks and certified them identical; a byte-level diff showed a load-bearing sentence about how to treat uncertainty present in one arm and absent from the other — the same axis the divergence was scored on. Its own write-up of the failure is the durable line: "I recognised the passages I went looking for and reported recognition as identity."

It filed a ruling request instead of quietly correcting its own record. The operator's rulings: the affected scoring marker was struck (stricter than the discovering agent's own proposal); the register row it fed is cited as 2-of-3 from then on, never 3-of-3; and the discriminating third arm was ordered as a fresh dispatched pair rather than reusing a banked result — because reusing the banked arm would reintroduce a cohort confound into the one experiment built to remove confounds. Two portable rules were promoted from the incident: a sameness claim needs a diff, not a reading, and a control cloned from one arm inherits that arm's treatment.

A later matched-choice experiment in the same chain was run properly sealed: both arms scored blind, records hash-frozen and published in full, the arm-to-condition mapping revealed only afterward, with the conclusion pre-committed per cell. The revealed cell: both arms clean — "treatment clean but unattributable." The system wrote down that its own intervention could not be credited, because the design said so before the reveal.

6 · Test bed four: the propose boundary under fire

The disclosure that redefined "by construction"

The worker rail — headless, disposable agents spawned per job — was specified as credential-free "by construction": no keys in the workspace, read-only input snapshots, output limited to a staged proposal. On August 15 a drain worker disclosed, unprompted, in a packet about something else, that its session carried roughly one hundred account-level connector tools — database, email, calendar, payments — inherited from the authenticated session and declared in no configuration file. A control probe from a different vendor's small model reproduced the finding independently.

Every audit the operator could run from his own shell had read empty, because the connectors weren't in any file a shell can grep. The repair was a launcher flag that strips the inheritance, re-verified by a probe inside the worker's own session — and the spec was amended with the general rule: when a boundary matters, remove the capability rather than instructing around it — and then verify the removal from inside, because a capability audit performed from the operator's shell measures the operator's shell. Enforcement is a property of the launcher, not the environment; any host that dispatches by another path inherits the exposure again.

The badge act: a competitor's agent on the desk

On August 28 the operation issued its first deliberate credential to an external AI: a Grok-based agent (xAI) seated as a desk clerk over the order pipeline. The design premise, in one line from the internal charter: the commodity executes, the substrate adjudicates, and the corrections ledger compounds at home on the competitor's labor.

The boundary is physics, not a system prompt:

First supervised shift: 21 calls, all in-lane, zero attempts at founder-only verbs, zero noise proposals, and a written report that matched the database. A longitudinal register row tracks it at 70% confidence over a multi-week window — pre-registered, so drift gets scored rather than remembered.

The same agent seated itself productively in the governance layer: it is now the fourth writer in the shared memory folder, ratified at an operator drain, with its own self-written capability roster.

The loop, closed three times before breakfast

August 29–30 demonstrated the full division of labor end to end:

  1. The Grok business agent, reviewing the public storefront, identified gaps and filed work orders into shared memory — including that machine buyers had a purchase path human buyers lacked.
  2. The operator routed the orders.
  3. Claude built each one — a machine-readable offer catalog with a transacting intake endpoint, then the human-side purchase buttons, then site-coherence fixes — under the full protocol: pre-registered acceptance checks, database-constraint probes before deploy, atomic writes.
  4. The operator shipped each deploy with a fresh, explicit go.
  5. Production verification closed each loop — 24/24 and 25/25 acceptance batteries, and a live click-through to a checkout session (created to verify the rail; not paid — checkout being reachable is not a sale, and no machine purchase has occurred).

Three orders through propose → route → build → rule → ship → verify in one day, across two AI vendors and one human — with the deploy gate never once crossed by an order's own claimed authority. One boundary-relevant detail from the same day: the Grok agent's rendered-page reading caught a claim our byte-level scan had marked clean (a target phrase split across HTML markup) — cross-agent review catching an instrument error, exactly what the second vantage is for.

7 · Test bed five: transfer beyond the operator

The thesis behind all of this — an operating substrate that compounds a person's judgment — has one metric that matters more than the rest: does it fire for a person who is not its operator? The operation's own kit documentation states it plainly: everything is instrumentation around three events on a receiver's side, and the first entry in a receiver's self-born lens — a correction they generated — is the hatch event.

Status, honestly: that metric still reads zero.

What exists around it:

The distinction between these and the thesis metric is maintained deliberately, in writing, because conflating "the kit works on the operator's own machine" with "the system compounds a stranger's judgment" is precisely the kind of claim the rest of this document exists to prevent.

8 · The measurement culture

None of the above is believable without the layer that keeps it honest:

Pre-registration. A predictions register holds 91 rows as of August 30 — claims with resolution criteria, dates, and (on 66 of them) stated confidences. 27 have resolved: 15 hits, 7 misses, 3 voids, 2 unresolvable. Voids and unresolvables are recorded as defects in the prediction, not neutral outcomes — including one literally-true row scored void because the predictor could influence the outcome, where banking the hit would have been favorable rounding.

Scored failures of the register itself. The register's sharpest recorded finding is about the register: a high-confidence row (85) sat unchanged for nine days while four disconfirming events accumulated on the books, because the design records confidence at birth and scores at death, with no mechanism for walking a live number as evidence arrives. The mirror image is also on file — a written-off read that stayed written off while the evidence that overturned it accumulated. Both are recorded as the same law: a published confidence expires exactly like a published claim, and something has to re-read it.

Lapsed windows, counted. Four pre-registered falsification windows from before the register existed were found lapsed and unscored this year. Rather than quietly backfilling, each was reconstructed, dated, and recorded as late — and the register plus a due-date pulse at session start is the structural fix. One three-window thesis test (a 30/60/90-day sequence on referral flow) resolved negative on schedule, with the response to a negative pre-committed sixteen days before the deadline so the outcome couldn't be rescued under pressure.

Stored figures are receipts. A standing rule across every surface: a stored number records a measurement someone once took; before it enters an answer or a plan, it is re-derived from the live source. Several findings in this document exist only because that rule fired — including one internal document caught asserting a queue was at three times its actual size, days after the cleanup that shrank it.

The ruling economics. The human layer scales because dispositions arrive staged: a recommended verb, the reason, and the named alternatives with costs. Measured at a live sitting: six queue rulings plus three command invocations in under two minutes — with the operator's own quality bar stated in advance: the test of staging is not whether he agrees, but whether a ruling made from the staged option survives opening the source. And the failure mode is named in the same charter: an observer with no closer is wallpaper — the operation retired one watcher that had posted a stale-intake alert daily for 99 days into a channel where nobody acted, and recorded the lesson instead of tuning the alert.

9 · Findings for practitioners

Distilled from the record above; each is load-bearing somewhere in a production system today.

  1. Arrange independence before counting agreement. Same-model agents agreeing is one reader with extra steps. A different model family reduces error correlation; a different position buys vantage; know which one you're purchasing, measure the independence you think you bought, and don't let a new seat launder old measurements.
  2. Verify boundaries from inside the boundary. Environments inherit capabilities from sessions, launchers, and machine-level config that no workspace audit can see. The only instrument that settles what an agent can reach is a probe run in the agent's own session.
  3. Make the write path physics. A boundary that lives in a system prompt is a request. A boundary that lives in schema constraints, redacted views, and absent verbs is a fact — and it holds against a competitor's agent as well as your own.
  4. Deliver judgment selected-at-the-moment, not archived-in-bulk. A rule present in context is not a rule applied. Distillation attached to the firing moment outperformed a 30-times-larger corpus in our ablation — and the corpus arm fell into a trap its own text named.
  5. Give shared memory one writer per file, provenance per finding, and a human-gated law layer. And record what the finder was doing — it's the only thing that separates independent convergence from an echo.
  6. Probe capabilities before addressing work to them. "Declared" is not "available." Every failed reach is a free probe result; write it down.
  7. Test your instruments against their own defects. A test that builds payloads the same way the system parses them shares the system's bugs. A substring check cannot see a replacement. A sameness claim needs a diff. A control cloned from one arm inherits that arm's treatment.
  8. Pre-register, then let nulls bind. Two sealed experiments returned not-a-win and nothing shipped on them. Pre-commitment is only real if a negative result visibly stops a build.
  9. Route every disposition through staged rulings, and count the ruling cost honestly. The human bottleneck largely dissolves when the machine ships a recommended verb with reasons and alternatives — the cost doesn't vanish, it moves to preparation, which is the half that scales.
  10. Let the constitution outrank everyone — including the principal. The strongest trust signal in this record is the day the standing layer overruled the operator's own accept-tap, surfaced the collision, and was thanked for it.

10 · Limits

11 · Method note

Every dated claim in this document traces to a primary record maintained at write-time: an append-only changelog spanning the operation's life, hash-sealed experiment fixtures with pre-registered rubrics, a predictions register with resolution criteria, per-order outcome records in the shared memory layer, and live-derived database counts (the register figures above were queried, not recalled, on August 30, 2026). A companion evidence index publishes, per claim: the artifact set, full SHA-256 commitments, model and platform labels, dates, outcomes, and each artifact's confidentiality status — so a reader can see exactly what is inspectable, what is committed-but-private, and what a future inspection could verify. Corrections are preserved in place with the original text struck and dated rather than deleted — several passages quoted here exist only because the operation records what it got wrong in the same voice as what it got right.

Prepared by Python Visuals LLC · Apeiron OS · August 2026. Companions: the White Paper, the Technical Design Report, and the Evidence Index. Live client work is at python-visuals.com/work.

From reading to running

Curious how this applies to a real business — maybe yours? Two minutes, no email, an honest answer.

Run the AI Fit Check

or book 15 minutes with the operator →