Absorb Log Protocol

wiki/_absorb_log.json records which immutable raw sources have been compiled into which wiki pages.

Routing

Open this page when compiling anything from raw/, investigating duplicate ingestion, or deciding whether a source has already been absorbed. It routes raw-source bookkeeping only; chat captures and live web research should use Capture Ingest Protocol unless they are first saved under raw/.

The absorb log prevents duplicate compilation and gives future agents provenance from raw source to compiled page. It applies to material under raw/, not every chat capture. Source: scripts/lib/absorb-log.ts; AGENTS.md

Rules

  • Raw files in raw/ are immutable. Do not edit them during compile.
  • Compile raw sources into wiki pages by synthesis, not copy/paste.
  • Call markAbsorbed(rawPath, pageSlugs) after the source meaningfully contributes to pages.
  • Chat captures without a raw/ file skip absorb logging unless later stored under raw/.
  • npx tsx scripts/wiki-status.ts uses the log to report pending material.

Compile Flow

  1. Read the raw source.
  2. Search the wiki for relevant existing pages.
  3. Update 5-15 touched pages when the source is rich enough.
  4. Add citations to every new fact.
  5. Run index/qmd/log.
  6. Mark the source absorbed with the page slugs it contributed to.

What Counts as Absorbed

A source is absorbed when its durable knowledge has been integrated into the graph. A source is not absorbed merely because an agent skimmed it or summarized it in chat.

Closeout

After marking a source absorbed, rebuild the page index and qmd if any wiki page changed. Use Generated Surface Contract when the compile also updates packs, capsule source pages, skill registry output, redirects, or stateful review ledgers.

Mistakes

  • Marking a source absorbed after only creating an orphan stub.
  • Editing raw files to "clean them up."
  • Forgetting to include all page slugs touched by the source.
  • Using absorb log for ephemeral chat-only facts.

Timeline