Master

Measuring the defence over time

A security rule that is not measured is a rule that may already be broken. Telemetry makes the defence a number that moves, so a regression is a finding instead of a suspicion.

What you will see

Two on the eighth, one on the ninth. A rate that doubles is the number that opens a finding.

About 1 min of reading

Try It

Build the three numbers from a log

1

Stamp blocks with layer and case

printf '2026-10-08 detect repeat-above\n2026-10-08 shape role-switch\n2026-10-09 detect repeat-above\n' > /tmp/blocks.tsv; wc -l < /tmp/blocks.tsv

Before you run it, say out loud what it will print. Then open the answer.

What it prints
Three lines, each with a date, a layer, and a case.
2

Count blocks per layer

cut -f2 /tmp/blocks.tsv | sort | uniq -c

Before you run it, say out loud what it will print. Then open the answer.

What it prints
Two detect and one shape. That table is the layer histogram.
3

Count blocks per day

cut -f1 /tmp/blocks.tsv | sort | uniq -c

Before you run it, say out loud what it will print. Then open the answer.

What it prints
Two on the eighth, one on the ninth. A rate that doubles is the number that opens a finding.

Data Flow

Blocks to a moving number
1 Every block is stamped with layer and case
↓
2 Counts are grouped per day
↓
3 The suite score is stored per run
↓
4 A change in either number opens a finding
Why this works
Why the suite runs on a schedule

A suite that runs once a month is a suite that cannot see a regression. It runs on the same cycle as a deploy.

What the telemetry never records

It records layer, case, and time. It never records the secret or the full prompt, because the log is a leak vector.

Examples

The three numbers that matter

Blocks per day, wins per suite run, and layer per block. Everything else in this subject is a detail of those three.

Why a spike is a finding

A block rate that doubles is either a new attack or a broken layer. Both are worth a person, and the number is what says so.

The histogram of layers

If one layer blocks ninety percent of cases, the other layers are decoration. That is a fact worth knowing before it costs anything.

Words this lesson uses

Each one is defined here on this site. Open the entry for the full definition and the other words it points at.

← A channel the model cannot write into
Previous Lesson
A channel the model cannot write into
Next Lesson
Shipping a system that can be defended later
Shipping a system that can be defended later →