Methodology

This dashboard tracks aggregate community compliance with core/AGENTS.md across Drupal core issue queue artifacts. It exists to evaluate a 3-month harm-reduction experiment: does publishing operator rules change observable LLM-prose patterns?

What's measured

Two tracks, different denominators by design:

Forbidden words list (§2.3)

Stem-prefix matching against this list, after fenced and inline code stripping. Trailing silent e dropped so conjugations match (leverage → matches leveraged, leveraging). No carve-outs.

data/forbidden-words.txt

Formula phrasing patterns (§2.5)

K-anonymity

K=10 for per-component, per-topic-tag, and MR-burst slices (component maintainership is publicly identifiable on drupal.org). K=5 elsewhere. Suppressed cells display in the JSON as "value": null, "suppressed": true with the underlying numerator and denominator preserved in the database for operator audit but not exposed in the public artifact.

Pre-period and burn-in

AGENTS.md amendment policy

The dashboard pins the AGENTS.md ruleset to the version in effect at experiment T0. Mid-experiment amendments are visible to contributors but do not change what the dashboard measures — pre/post comparability requires a stable treatment definition.

Phrase-tells v3 source-aware disclosure

The phrase-tell list contains source-aware rules: markdown-format tells (**bold**, ## heading, [link](…)) fire only on source='comment' because Drupal.org strips Markdown rendering. GitLab notes (source='note') render Markdown natively, so MD usage is not a tell there. Comparing tell density across artifact types in the same chart reflects both LLM behavior and phrase-list scope; readers should compare each track to its own pre-period baseline rather than across tracks.

Live counts

M1 — comments rule-checked (latest day)
4
M2 — tier-1 cohort size (latest day)
470
M3 — suppressed cells (latest day)
11

Source code & data