Objective and Falsifiable Hypothesis
The central research question is whether a small operator can solve previously unsolved problems, or achieve independently verified outcomes using materially fewer resources than a credible reference approach, by coordinating the smallest effective team of autonomous agents.
Falsifiable Hypothesis: Complementary specialization, persistent shared evidence, selective model escalation, and deterministic review gates may improve verified outcomes relative to total compute expenditure. Conversely, uncoordinated scaling introduces duplicate tool calls, correlated model hallucinations, compounding errors, and runaway spend. The research methodology explicitly accommodates the null hypothesis: where a single strong reasoning model or a minimal pair outperforms an adaptive multi-worker fleet.
- Outcome 1: Externally Validated Novelty: A new, verified solution to a difficult problem evaluated against rigorous domain literature and independent human or mechanical checkers.
- Outcome 2: Measured Efficiency Reproduction: Reproduction of a known result achieving parity with fewer total tokens, lower wall-clock duration, or reduced financial expenditure.
- Outcome 3: Documented Failure & Bounds: Negative results where multi-agent scaling added coordination latency or cost without improving accuracy, establishing clear operational boundaries.
The role of echo.cc in research
echo.cc supplies messages, task leases, and advisory file reservations. A research harness would need to add experiment bookkeeping, complete cost accounting, independent verification, and retention of unsuccessful attempts. Those research capabilities are proposed designs, not shipped guarantees.
- Independent checks: Scientific validity depends on suitable checkers and domain experts. Agreement between agents is not proof.
- Retain failures: The proposed protocol would record failed branches, discarded approaches, and retries alongside successes.
- Storage boundaries: The local coordination interface uses directory queues and atomic writes. Process recovery and queue durability depend on the host platform and underlying filesystem; experiments must verify their records after interruptions.
Measurement & Resource Accounting Protocol
Rather than collapsing complex multi-agent behavior into a single opaque score, the proposed experiments would measure eight dimensions:
| Dimension | Required Measurement & Interpretation |
|---|---|
| Verified Quality | Independent checker pass rates, formal proof confirmations, and domain-expert review across repeated trials. |
| End-to-End Wall Time | Complete duration from campaign creation to final verification, including queueing, review cycles, and repairs. |
| Compute & Tokens | Prompt, cached, and generated token volumes; local GPU/CPU execution hours where measured. Unknown spend is never treated as free. |
| Comprehensive Cost | Total financial accounting including coordinators, reviewers, retries, discarded exploration branches, and tooling infrastructure. |
| Human Effort | Setup time, prompt adjustments, operational interventions, debugging, and post-run evaluation time. |
| Effective Team Size | Peak concurrent inference requests, active worker sessions, and unique participants reported separately. Roster presence is not concurrency. |
| Coordination Overhead | Total messages and bytes transferred, idle worker capacity, context reconstruction delay, and dispatch backpressure latency. |
| Reliability & Safety | Duplicate tool side effects, interruption recovery rates, lease contention frequency, and accepted result lineage. |
Empirical Status vs. Proposed Experiments
We maintain strict transparency between operational system demonstrations and future scientific research:
- 26-Worker Operational Demonstration (Observed 2026-09-26): A point-in-time process snapshot on host
haywirerecorded 26 owned live CLI runner processes (5 existing agy workers and 21 read-only dogfood workers) with 21/21 verified task acknowledgements and findings under sender rate limits (30 msg/hr burst 10). These are operational observations; it is not a claim of 26 simultaneous inference streams, multi-vendor model diversity, or scientific problem-solving. - Staged Research Experiments (Proposed & Deferred): Future research will test single-agent baselines against structured small teams on reproducible, held-out benchmark tasks before progressing to prospective open problems. Scaling to dozens or hundreds of workers is an optional future capacity evaluation, not an inherent marker of success.