Reloads every 5 min.

simplify — progress KPIs

progress through the corpus

At a glance

How much of the text is explained, what the rules claim is finished, and how quickly the run is moving.

Corpus coloured

82.7%

60,104 of 72,645 observed clauses have a rule.

Corpus closed

47.2%

34,307 of 72,645 observed clauses are claimed by a rule to need no more processing. This is a rule claim, not proof that the result is true.

Corpus words closed (recurse:leaf)

17.3%

100,716 of 581,061 emitted words are in final output segments explicitly marked recurse: leaf. This is a rule claim, not proof that the result is true.

Shapes with rules

60.5%

17,065 of 28,215 observed powerset shapes are fully covered by rules.

Surprise: sentences until a new pattern

8.8

Source-balanced across 22 corpus sources, capped at 229 recent sentences per source; 90% chance of finding one within 20 sentences. The current single-source stream tail is one per 32.0 sentences.

Corpus size

38,698

sentences in this run

Simplify warm words / second

34.5

Simplify alone on a fixed benchmark after spaCy and the model are loaded.

Simplify warm sentences / second

5.3

Input sentences parsed by Simplify alone on the same warm benchmark.

Full pipeline words / second

20.9

End to end: Simplify, coverage checks, hypertrie, persistence, and publication.

Full pipeline sentences / second

1.5

Completed corpus sentences per wall-clock second across the full diagnostic pipeline.

Corpus processed

100.0%

38,698 of 38,698 sentences processed.

Rules

1,351

rules registered in the measured Simplify engine

Open HITL decisions

53

human choices still waiting in Simplify's review queue

Time since last completed run

calculating…

Stable checkpoint created · engine 3af73dc1aa73.

Executive graph KPIs

Not measured yet. The producer must publish exact graph matches, weighted defects, and valid-graph coverage with one frozen corpus/parser/Tree++/grammar/engine identity.

Where graph results fail

Eight defect classes from Simplify’s validation contract. A class is counted only when the graph audit supplies its denominator; “Not measured” is not zero.

Boundary / envelopeNot measuredawaiting the graph audit
Clause recallNot measuredawaiting the graph audit
Relation recallNot measuredawaiting the graph audit
Relation precisionNot measuredawaiting the graph audit
ScopeNot measuredawaiting the graph audit
Slot bindingNot measuredawaiting the graph audit
ProvenanceNot measuredawaiting the graph audit
RegressionNot measuredawaiting the graph audit

No graph error audit published.

Coreference KPIs

Five fixed-corpus measures: how many references were resolved, how often checked decisions were correct, what remains unresolved, speed, and change since the previous stable release.

0.3%Resolved7 of 2230 references
100.0%Correct when checkedhuman-audited commitments
2223Still unresolved1018 ambiguous · 765 no plausible option
1,208,824.2References / hourpinned runner
Newly resolved— errors fixed · — new errors

Open buckets: 1,018 ambiguous · 765 no plausible option · 2,223 unresolved

stable-checkpoint · simplify · stable-checkpoint · stable-checkpoint · 7c9ba736e11439b34c3f303b13dfa4a4303fc9e8

Current run

37.5%14,500 of 38,698 sentences processed
1359rules in the current engine

These are live runner facts. The KPI cards above remain the last complete, stable run.

Is the project moving?

Rules are still being added, but corpus breadth has barely moved: this is depth, not broad coverage.

Last completed engines: 1,342 → 1,351 rules; corpus text explained 83.4% → 82.7%. The current run is 14,500 of 38,698 sentences (37.5%) and reports 1359 rules; its partial percentages are not compared with the completed-run baseline.

Board signal: rules and corpus coverage are outcomes; current-run completion, throughput, and new-pattern intervals are leading indicators.

How to read this: “Coloured” means a rule has explained observed corpus text; “Closed” means a rule claims every final action in the sentence needs no more processing; it is a claim, not a proof. Neither percentage is a claim that the grammar is complete.

How much work are the rules doing?

This is activity, not a completion score: it counts how many changes rules make and how many sentences each rule touches.

Changes per sentence
1,872 total changes · 3.752 average · 3 middle value
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
18
21
Each bar shows how many sentences received that many changes.
Sentences matched by each rule
RuleSentences matchedChanges made
annotation-adapter274274
OP-SEM-POSSESSIVE-OWNER-V2110110
OP-SEM-NEGATION-NOT-SCOPE-V14949
OP-SEM-CARDINAL-QUANTITY-V14545
QUOTATION-TYPED-DIRECT-FRAME-V12626
OP-SEM-COPULA-QUALIFIER-V22222
OP-STR-014-SHORT-V21919
OP-FINITE-POSTPOSED-DIRECT-QUOTE-V21313
OP-SEM-ORDINAL-NOMINAL-V11111
OP-STR-013-V21010
OP-SEM-EXISTENTIAL-V299
OP-STR-211-split-V299
OP-SAY-FINITE-REPORTED-CONTENT-V277
OP-SEM-ADJECTIVAL-PASSIVE-STATE-V277
OP-STR-017c-V277
OP-STR-072-V2a77
OP-SEM-PASSIVE-VOICE-V266
OP-SEM-POLAR-QUESTION-SCOPE-V166
OP-STR-043d-V266
OP-STR-045-V266
OP-NOMINAL-PARTICIPIAL-SINGLE-RESTRICTIVE-SINGULAR-V255
OP-RELCL-CONTACT-GAP-V255
OP-STR-014-V255
OP-STR-072-V2b55
OP-STR-214-V255
OP-STR-216c-V255
OP-WANT-SUBJECT-CONTROL-DESIDERATIVE-V255
OP-SEM-COPULA-INSTANCE-OF-V244
OP-STR-014f-V244
OP-STR-015-V244
OP-STR-016c-where-V244
OP-STR-213-V244
OP-STR-215-V244
OP-STR-EPISTEMIC-ATTITUDE-V244
OP-STR-PARTICIPIAL-MEDIAL-CONTROLLED-V244
OP-ACTIVE-INSTRUMENTAL-PURPOSE-V233
OP-COMP-RELATIVE-PASSIVE-SINGLE-V233
OP-FACTIVE-COGNITION-FINITE-CONTENT-V233
OP-HOPE-FINITE-CONTENT-V233
OP-NOMINAL-PARTICIPIAL-SINGLE-RESTRICTIVE-PLURAL-V233
OP-OPEN-COMPLEMENT-IMPLICATIVE-CONTROL-V233
OP-SEM-APPOSITIVE-IDENTITY-DEFINITE-TITLE-V233
OP-SEM-DITRANSITIVE-TRANSFER-DOUBLE-OBJECT-V233
OP-SEM-UNIVERSAL-PASSIVE-SUBJECT-SELECTOR-V233
OP-SEM-UNIVERSAL-SUBJECT-SELECTOR-V233
OP-STR-118-V2a33
OP-STR-216b-V233
OP-TRY-SUBJECT-CONTROL-ATTEMPT-V233
OP-ADJECTIVAL-DISPOSITION-CONTROL-V222
OP-ASSISTIVE-CLAUSAL-SUBJECT-BARE-XCOMP-V222
OP-COMP-CAPTURE-HOW-PASSIVE-COORD-V222
OP-HAVE-TO-NECESSARY-ACTION-V222
OP-HORTATIVE-LET-US-CONTENT-V222
OP-NEED-TO-NECESSARY-ACTION-V222
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-AGENT-SINGULAR-V222
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-SINGULAR-V222
OP-SEM-COPULA-LOCATED-IN-V222
OP-SEM-EXISTENTIAL-OBJECT-SELECTOR-V222
OP-SEM-NEGATIVE-SUBJECT-SELECTOR-V222
OP-SEM-PASSIVE-AGENT-V222
OP-SEM-PAST-PARTICIPLE-STATE-EVENT-AMBIGUITY-V222
OP-SEM-UNIVERSAL-OBJECT-SELECTOR-V222
OP-STR-043g-V222
OP-STR-043j-V222
OP-STR-045f-V222
OP-STR-070c-V222
OP-STR-216c-QUOTED-V222
OP-STR-219-V222
OP-ACL-NOMINAL-CONTROL-CONTENT-V211
OP-ADVCL-COPULAR-HERE-PURPOSE-V211
OP-APPEARANCE-PERFECT-RAISING-COORD-V211
OP-APPEARANCE-SEEMING-CCOMP-V211
OP-ARG-KEEP-OBJECT-PREDICATE-RESULT-STATE-V211
OP-ARG-PARALLEL-PREPOSITIONAL-OR-V211
OP-ASPECTUAL-ONSET-BEGIN-XCOMP-FINITE-CONJ-V211
OP-ASPECTUAL-ONSET-BEGIN-XCOMP-V211
OP-ASPECTUAL-ONSET-START-ING-XCOMP-V211
OP-ASPECTUAL-ONSET-START-TO-XCOMP-V211
OP-BE-TO-SCHEDULED-PASSIVE-ACTION-V211
OP-BECAUSE-OF-NOMINAL-CAUSE-V211
OP-CAPABILITY-ACTION-V211
OP-CCOMP-PERCEPTION-OBJECT-CONTROL-V211
OP-COMP-CAPTURE-OBJECT-WHO-QUESTION-V211
OP-COMP-CAPTURE-WHAT-FINITE-DISJUNCTION-V211
OP-COMP-COPULAR-WHO-KNOWS-IF-PURPOSE-V211
OP-COMP-FRONT-EVEN-IF-CONCESSIVE-V211
OP-COMP-IMPERATIVE-COORDINATED-PURPOSE-V211
OP-COMP-NO-COMMA-COUNTERFACTUAL-IF-V211
OP-COMP-SHOW-WHERE-WHAT-WHEN-DIRECTIVE-V211
OP-COMP-STABLE-COPULAR-PASSIVE-CONJUNCT-V211
OP-COMP-STABLE-COVER-HANDLING-XCOMP-V211
OP-COMP-STABLE-DROPS-ENABLING-XCOMP-V211
OP-COMP-STABLE-FRONTED-LOSING-FACING-V211
OP-COMP-STABLE-GO-SEE-PURPOSE-V211
OP-COMP-STABLE-STEP-UP-TO-JOIN-V211
OP-COMP-STABLE-STRANDED-FINITE-XCOMP-V211
OP-COMP-TRAILING-WHILE-GERUND-CONTROL-V211
OP-COPULAR-NOMINAL-EMBEDDED-QUESTION-V211
OP-COPULAR-NOT-BUT-CORRECTIVE-CONTRAST-V211
OP-DESPITE-NOMINAL-CONCESSION-V211
OP-EMBEDDED-HOW-TO-XCOMP-V211
OP-END-UP-RESULTATIVE-GERUND-V211
OP-EXPLAIN-HOW-TO-XCOMP-QUESTION-V211
OP-FACTIVE-CCOMP-TEMPORAL-WHEN-V211
OP-FIND-A-WAY-TO-CONTROL-V211
OP-GOAL-COPULAR-TO-TARGET-V211
OP-GOING-TO-PROSPECTIVE-ACTION-V211
OP-HAVE-FUN-GERUND-ACTIVITY-V211
OP-HAVE-TO-NECESSARY-ACTION-ROOT-COORD-CHAIN-V211
OP-HOPE-SUBJECT-CONTROL-ATTITUDE-V211
OP-IMPERATIVE-BARE-LET-PERMITTED-V211
OP-INSTRUMENTAL-MEANS-GERUND-V211
OP-LEARN-SUBJECT-CONTROL-ACTION-V211
OP-NOMINAL-REDUCED-PASSIVE-ACL-ELABORATIVE-SINGULAR-V211
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-AGENT-PLURAL-V211
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-PLURAL-V211
OP-OBJECT-CONTROL-DESIDERATIVE-V211
OP-OBJECT-CONTROL-TRUST-QUESTION-ATTITUDE-V211
OP-ONLY-IF-BUT-NECESSARY-CONDITION-V211
OP-OPTATIVE-WISH-FINITE-PAST-CONTENT-V211
OP-OUGHT-TO-NECESSARY-ACTION-V211
OP-PAST-HABITUAL-USED-TO-ASPECT-V211
OP-PREFERENCE-SUBJECT-CONTROL-V211
OP-RELCL-OVERT-OBJECT-GAP-V211
OP-SAY-EXISTENTIAL-REPORTED-CONTENT-V211
OP-SEM-APPOSITIVE-ELABORATION-INDEFINITE-V211
OP-SEM-APPOSITIVE-IDENTITY-DEFINITE-NAME-V211
OP-SEM-APPOSITIVE-IDENTITY-POSSESSIVE-PERSON-V211
OP-SEM-AT-TIMES-RECURRENCE-V211
OP-SEM-COPULA-DEICTIC-SETTING-V211
OP-SEM-COPULA-LOCATED-ON-V211
OP-SEM-DITRANSITIVE-TRANSFER-TO-DATIVE-PREP-V211
OP-SEM-IMPERATIVE-COPULA-PROPERTY-V211
OP-SEM-IS-BY-APPOSITIVE-PATIENT-V211
OP-SEM-IS-BY-V211
OP-SEM-MAJORITY-SUBJECT-SELECTOR-V211
OP-SEM-ORDINAL-OUTCOME-V111
OP-SEM-UNIVERSAL-PASSIVE-EVENT-CANDIDATE-V211
OP-SEM-UNIVERSAL-PRONOUN-SUBJECT-SELECTOR-V211
OP-SEMANTIC-RESULT-CONTAINER-V211
OP-SHARED-MODAL-NWAY-COORDINATION-V211
OP-SHOW-FINITE-EVIDENTIAL-CONTENT-V211
OP-STOP-GERUND-CESSATION-PERFECT-V211
OP-STOP-GERUND-CESSATION-V211
OP-STR-013-COMP-EXPLICIT-SUBJECT-CONJ-V211
OP-STR-013c-V211
OP-STR-014-ASYND-AUX-CCOMP-CHAIN-V211
OP-STR-014-DO-NEG-V211
OP-STR-014-MODAL-CCOMP-ROOT-COORD-V211
OP-STR-014c-V211
OP-STR-014h-V211
OP-STR-014k-V211
OP-STR-015-v2-V211
OP-STR-043-BARE-PARTICIPIAL-SHARED-SUBJECT-V211
OP-STR-043J-COMMALESS-ONCE-V211
OP-STR-216b-QUOTED-V211
OP-STR-CAUSAL-SO-ADVCL-V211
OP-STR-FRONTED-PARTICIPIAL-FINITE-CCOMP-V211
OP-STR-PARALLEL-FINITE-SVO-GAPPING-V211
OP-STR-PARATAXIS-V211
OP-STR-PASSIVE-CONJUNCT-OWNED-SUBJECT-V211
OP-STR-SERIAL-PARENTHETICAL-DASH-COORD-V211
OP-STR-SERIAL-SHARED-SUBJECT-ADVCL-V211
OP-STR-SERIAL-SHARED-SUBJECT-NESTED-3-V211
OP-STR-UNSPLIT-SPEECH-COMP-V211
OP-TEMP-CONTROLLED-AFTER-GERUND-V211
OP-TEMP-CONTROLLED-BEFORE-GERUND-V211
OP-UNSURE-HOW-TO-XCOMP-QUESTION-V211
By source file

Average and total changes in each source file.

FileAverage changes / sentenceMiddle valueTotal changes
avarisclari-ccby-2024:L9821.02121
formal-finally:L6718.01818
avarisclari-ccby-2024:L65816.01616
sivanea-ccby-2024:L3416.01616
pratham-storyweaver-en-ccby-2024:L387815.01515
tell-me-a-story-ccby-2024:L2531014.01414
formal-finally:L20113.01313
tell-me-a-story-ccby-2024:L81213.01313
ai-research:L1412.01212
avarisclari-ccby-2024:L61212.01212
dig-unsettling-ccby-2026:L1012.01212
internet:L512.01212
myths:L2612.01212
1001-stories-cc0-2026:L28011.01111
ai-research:L101211.01111
dig-unsettling-ccby-2026:L3511.01111
dig-unsettling-ccby-2026:L4311.01111
five-minute-mysteries-pd-2026:L287711.01111
formal-finally:L8611.01111
mot-editorials:L265811.01111
Depth proxy; exact internal transformation events are not exported yet.

Last complete run: 3h ago · full run

⚠ STALE — KPI full refresh just now · engine 2ca1c0abe8b29c6bf6bc96375e26014656801799 · Simplify has uncommitted source or grammar changes