Reloads every 5 min.

simplify — progress KPIs

progress through the corpus

At a glance

How much of the text is explained, what the rules claim is finished, and how quickly the run is moving.

Corpus coloured

83.4%

57,042 of 68,369 observed clauses have a rule.

Corpus closed

48.5%

33,128 of 68,369 observed clauses are claimed by a rule to need no more processing. This is a rule claim, not proof that the result is true.

Corpus words closed (recurse:leaf)

17.2%

95,419 of 553,966 emitted words are in final output segments explicitly marked recurse: leaf. This is a rule claim, not proof that the result is true.

Shapes with rules

60.3%

15,889 of 26,340 observed powerset shapes are fully covered by rules.

Surprise: sentences until a new pattern

8.8

Source-balanced across 22 corpus sources, capped at 229 recent sentences per source; 90% chance of finding one within 20 sentences. The current single-source stream tail is one per 32.0 sentences.

Corpus size

38,698

sentences in this run

Simplify warm words / second

37.3

Simplify alone on a fixed benchmark after spaCy and the model are loaded.

Simplify warm sentences / second

5.7

Input sentences parsed by Simplify alone on the same warm benchmark.

Full pipeline words / second

23.4

End to end: Simplify, coverage checks, hypertrie, persistence, and publication.

Full pipeline sentences / second

1.6

Completed corpus sentences per wall-clock second across the full diagnostic pipeline.

Corpus processed

100.0%

38,698 of 38,698 sentences processed.

Rules

1,342

rules registered in the measured Simplify engine

Open HITL decisions

53

human choices still waiting in Simplify's review queue

Time since last completed run

calculating…

Stable checkpoint created · engine 342f66d1f7f7.

Executive graph KPIs

Not measured yet. The producer must publish exact graph matches, weighted defects, and valid-graph coverage with one frozen corpus/parser/Tree++/grammar/engine identity.

Where graph results fail

Eight defect classes from Simplify’s validation contract. A class is counted only when the graph audit supplies its denominator; “Not measured” is not zero.

Boundary / envelopeNot measuredawaiting the graph audit
Clause recallNot measuredawaiting the graph audit
Relation recallNot measuredawaiting the graph audit
Relation precisionNot measuredawaiting the graph audit
ScopeNot measuredawaiting the graph audit
Slot bindingNot measuredawaiting the graph audit
ProvenanceNot measuredawaiting the graph audit
RegressionNot measuredawaiting the graph audit

No graph error audit published.

Coreference KPIs

Five fixed-corpus measures: how many references were resolved, how often checked decisions were correct, what remains unresolved, speed, and change since the previous stable release.

0.3%Resolved7 of 2230 references
100.0%Correct when checkedhuman-audited commitments
2223Still unresolved1018 ambiguous · 765 no plausible option
1,208,824.2References / hourpinned runner
Newly resolved— errors fixed · — new errors

Open buckets: 1,018 ambiguous · 765 no plausible option · 2,223 unresolved

stable-checkpoint · simplify · stable-checkpoint · stable-checkpoint · 7c9ba736e11439b34c3f303b13dfa4a4303fc9e8

Current run

28.4%11,000 of 38,698 sentences processed
1351rules in the current engine

These are live runner facts. The KPI cards above remain the last complete, stable run.

Is the project moving?

Rules are still being added, but corpus breadth has barely moved: this is depth, not broad coverage.

Last completed engines: 1,341 → 1,342 rules; corpus text explained 83.7% → 83.4%. The current run is 11,000 of 38,698 sentences (28.4%) and reports 1351 rules; its partial percentages are not compared with the completed-run baseline.

Board signal: rules and corpus coverage are outcomes; current-run completion, throughput, and new-pattern intervals are leading indicators.

How to read this: “Coloured” means a rule has explained observed corpus text; “Closed” means a rule claims every final action in the sentence needs no more processing; it is a claim, not a proof. Neither percentage is a claim that the grammar is complete.

How much work are the rules doing?

This is activity, not a completion score: it counts how many changes rules make and how many sentences each rule touches.

Changes per sentence
1,673 total changes · 3.637 average · 3.0 middle value
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
16
18
21
Each bar shows how many sentences received that many changes.
Sentences matched by each rule
RuleSentences matchedChanges made
annotation-adapter251251
OP-SEM-POSSESSIVE-OWNER-V2104104
OP-SEM-NEGATION-NOT-SCOPE-V14646
OP-SEM-CARDINAL-QUANTITY-V14343
QUOTATION-TYPED-DIRECT-FRAME-V12525
OP-SEM-COPULA-QUALIFIER-V22121
OP-STR-014-SHORT-V21818
OP-SEM-ORDINAL-NOMINAL-V11111
OP-FINITE-POSTPOSED-DIRECT-QUOTE-V21010
OP-SEM-EXISTENTIAL-V299
OP-STR-013-V288
OP-STR-211-split-V288
OP-STR-017c-V277
OP-STR-072-V2a77
OP-SAY-FINITE-REPORTED-CONTENT-V266
OP-SEM-POLAR-QUESTION-SCOPE-V166
OP-STR-043d-V266
OP-NOMINAL-PARTICIPIAL-SINGLE-RESTRICTIVE-SINGULAR-V255
OP-RELCL-CONTACT-GAP-V255
OP-SEM-ADJECTIVAL-PASSIVE-STATE-V255
OP-SEM-PASSIVE-VOICE-V255
OP-STR-014-V255
OP-STR-045-V255
OP-STR-072-V2b55
OP-STR-214-V255
OP-SEM-COPULA-INSTANCE-OF-V244
OP-STR-014f-V244
OP-STR-016c-where-V244
OP-STR-215-V244
OP-STR-PARTICIPIAL-MEDIAL-CONTROLLED-V244
OP-WANT-SUBJECT-CONTROL-DESIDERATIVE-V244
OP-FACTIVE-COGNITION-FINITE-CONTENT-V233
OP-HOPE-FINITE-CONTENT-V233
OP-NOMINAL-PARTICIPIAL-SINGLE-RESTRICTIVE-PLURAL-V233
OP-OPEN-COMPLEMENT-IMPLICATIVE-CONTROL-V233
OP-SEM-APPOSITIVE-IDENTITY-DEFINITE-TITLE-V233
OP-SEM-DITRANSITIVE-TRANSFER-DOUBLE-OBJECT-V233
OP-SEM-UNIVERSAL-PASSIVE-SUBJECT-SELECTOR-V233
OP-SEM-UNIVERSAL-SUBJECT-SELECTOR-V233
OP-STR-015-V233
OP-STR-118-V2a33
OP-STR-213-V233
OP-STR-EPISTEMIC-ATTITUDE-V233
OP-TRY-SUBJECT-CONTROL-ATTEMPT-V233
OP-ADJECTIVAL-DISPOSITION-CONTROL-V222
OP-ASSISTIVE-CLAUSAL-SUBJECT-BARE-XCOMP-V222
OP-COMP-CAPTURE-HOW-PASSIVE-COORD-V222
OP-COMP-RELATIVE-PASSIVE-SINGLE-V222
OP-HAVE-TO-NECESSARY-ACTION-V222
OP-NEED-TO-NECESSARY-ACTION-V222
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-AGENT-SINGULAR-V222
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-SINGULAR-V222
OP-SEM-COPULA-LOCATED-IN-V222
OP-SEM-EXISTENTIAL-OBJECT-SELECTOR-V222
OP-SEM-NEGATIVE-SUBJECT-SELECTOR-V222
OP-SEM-PASSIVE-AGENT-V222
OP-SEM-PAST-PARTICIPLE-STATE-EVENT-AMBIGUITY-V222
OP-SEM-UNIVERSAL-OBJECT-SELECTOR-V222
OP-STR-043g-V222
OP-STR-043j-V222
OP-STR-045f-V222
OP-STR-070c-V222
OP-STR-216b-V222
OP-STR-216c-QUOTED-V222
OP-STR-216c-V222
OP-STR-219-V222
OP-ACL-NOMINAL-CONTROL-CONTENT-V211
OP-ACTIVE-INSTRUMENTAL-PURPOSE-V211
OP-ADVCL-COPULAR-HERE-PURPOSE-V211
OP-APPEARANCE-PERFECT-RAISING-COORD-V211
OP-APPEARANCE-SEEMING-CCOMP-V211
OP-ARG-KEEP-OBJECT-PREDICATE-RESULT-STATE-V211
OP-ARG-PARALLEL-PREPOSITIONAL-OR-V211
OP-ASPECTUAL-ONSET-BEGIN-XCOMP-FINITE-CONJ-V211
OP-ASPECTUAL-ONSET-BEGIN-XCOMP-V211
OP-ASPECTUAL-ONSET-START-ING-XCOMP-V211
OP-ASPECTUAL-ONSET-START-TO-XCOMP-V211
OP-BE-TO-SCHEDULED-PASSIVE-ACTION-V211
OP-BECAUSE-OF-NOMINAL-CAUSE-V211
OP-CAPABILITY-ACTION-V211
OP-CCOMP-PERCEPTION-OBJECT-CONTROL-V211
OP-COMP-CAPTURE-OBJECT-WHO-QUESTION-V211
OP-COMP-CAPTURE-WHAT-FINITE-DISJUNCTION-V211
OP-COMP-COPULAR-WHO-KNOWS-IF-PURPOSE-V211
OP-COMP-NO-COMMA-COUNTERFACTUAL-IF-V211
OP-COMP-STABLE-COPULAR-PASSIVE-CONJUNCT-V211
OP-COMP-STABLE-COVER-HANDLING-XCOMP-V211
OP-COMP-STABLE-DROPS-ENABLING-XCOMP-V211
OP-COMP-STABLE-FRONTED-LOSING-FACING-V211
OP-COMP-STABLE-STEP-UP-TO-JOIN-V211
OP-COMP-STABLE-STRANDED-FINITE-XCOMP-V211
OP-COMP-TRAILING-WHILE-GERUND-CONTROL-V211
OP-COPULAR-NOMINAL-EMBEDDED-QUESTION-V211
OP-COPULAR-NOT-BUT-CORRECTIVE-CONTRAST-V211
OP-DESPITE-NOMINAL-CONCESSION-V211
OP-EMBEDDED-HOW-TO-XCOMP-V211
OP-EXPLAIN-HOW-TO-XCOMP-QUESTION-V211
OP-FACTIVE-CCOMP-TEMPORAL-WHEN-V211
OP-FIND-A-WAY-TO-CONTROL-V211
OP-GOAL-COPULAR-TO-TARGET-V211
OP-GOING-TO-PROSPECTIVE-ACTION-V211
OP-HAVE-FUN-GERUND-ACTIVITY-V211
OP-HAVE-TO-NECESSARY-ACTION-ROOT-COORD-CHAIN-V211
OP-HOPE-SUBJECT-CONTROL-ATTITUDE-V211
OP-HORTATIVE-LET-US-CONTENT-V211
OP-INSTRUMENTAL-MEANS-GERUND-V211
OP-LEARN-SUBJECT-CONTROL-ACTION-V211
OP-NOMINAL-REDUCED-PASSIVE-ACL-ELABORATIVE-SINGULAR-V211
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-AGENT-PLURAL-V211
OP-NOMINAL-REDUCED-PASSIVE-ACL-RESTRICTIVE-PLURAL-V211
OP-OBJECT-CONTROL-DESIDERATIVE-V211
OP-OBJECT-CONTROL-TRUST-QUESTION-ATTITUDE-V211
OP-ONLY-IF-BUT-NECESSARY-CONDITION-V211
OP-OPTATIVE-WISH-FINITE-PAST-CONTENT-V211
OP-PAST-HABITUAL-USED-TO-ASPECT-V211
OP-RELCL-OVERT-OBJECT-GAP-V211
OP-SAY-EXISTENTIAL-REPORTED-CONTENT-V211
OP-SEM-APPOSITIVE-ELABORATION-INDEFINITE-V211
OP-SEM-APPOSITIVE-IDENTITY-DEFINITE-NAME-V211
OP-SEM-APPOSITIVE-IDENTITY-POSSESSIVE-PERSON-V211
OP-SEM-COPULA-DEICTIC-SETTING-V211
OP-SEM-COPULA-LOCATED-ON-V211
OP-SEM-DITRANSITIVE-TRANSFER-TO-DATIVE-PREP-V211
OP-SEM-IMPERATIVE-COPULA-PROPERTY-V211
OP-SEM-IS-BY-APPOSITIVE-PATIENT-V211
OP-SEM-IS-BY-V211
OP-SEM-MAJORITY-SUBJECT-SELECTOR-V211
OP-SEM-ORDINAL-OUTCOME-V111
OP-SEM-UNIVERSAL-PASSIVE-EVENT-CANDIDATE-V211
OP-SEM-UNIVERSAL-PRONOUN-SUBJECT-SELECTOR-V211
OP-SEMANTIC-RESULT-CONTAINER-V211
OP-SHARED-MODAL-NWAY-COORDINATION-V211
OP-SHOW-FINITE-EVIDENTIAL-CONTENT-V211
OP-STOP-GERUND-CESSATION-PERFECT-V211
OP-STOP-GERUND-CESSATION-V211
OP-STR-013-COMP-EXPLICIT-SUBJECT-CONJ-V211
OP-STR-013c-V211
OP-STR-014-ASYND-AUX-CCOMP-CHAIN-V211
OP-STR-014-DO-NEG-V211
OP-STR-014-MODAL-CCOMP-ROOT-COORD-V211
OP-STR-014h-V211
OP-STR-014k-V211
OP-STR-015-v2-V211
OP-STR-043-BARE-PARTICIPIAL-SHARED-SUBJECT-V211
OP-STR-043J-COMMALESS-ONCE-V211
OP-STR-216b-QUOTED-V211
OP-STR-CAUSAL-SO-ADVCL-V211
OP-STR-FRONTED-PARTICIPIAL-FINITE-CCOMP-V211
OP-STR-PARALLEL-FINITE-SVO-GAPPING-V211
OP-STR-PARATAXIS-V211
OP-STR-PASSIVE-CONJUNCT-OWNED-SUBJECT-V211
OP-STR-SERIAL-PARENTHETICAL-DASH-COORD-V211
OP-STR-SERIAL-SHARED-SUBJECT-ADVCL-V211
OP-STR-SERIAL-SHARED-SUBJECT-NESTED-3-V211
OP-STR-UNSPLIT-SPEECH-COMP-V211
OP-TEMP-CONTROLLED-AFTER-GERUND-V211
OP-TEMP-CONTROLLED-BEFORE-GERUND-V211
OP-UNSURE-HOW-TO-XCOMP-QUESTION-V211
By source file

Average and total changes in each source file.

FileAverage changes / sentenceMiddle valueTotal changes
avarisclari-ccby-2024:L9821.02121
formal-finally:L6718.01818
avarisclari-ccby-2024:L65816.01616
pratham-storyweaver-en-ccby-2024:L387814.01414
tell-me-a-story-ccby-2024:L2531014.01414
formal-finally:L20113.01313
avarisclari-ccby-2024:L61212.01212
dig-unsettling-ccby-2026:L1012.01212
internet:L512.01212
myths:L2612.01212
tell-me-a-story-ccby-2024:L81212.01212
1001-stories-cc0-2026:L28011.01111
ai-research:L101211.01111
dig-unsettling-ccby-2026:L4311.01111
five-minute-mysteries-pd-2026:L287711.01111
formal-finally:L8611.01111
mot-editorials:L265811.01111
petr-hudecek-work-ccby-2015:L12711.01111
petr-hudecek-work-ccby-2015:L3311.01111
relational-together-apart:L27310.01010
Depth proxy; exact internal transformation events are not exported yet.

Last complete run: 9h ago · full run

⚠ STALE — KPI full refresh just now · engine 3af73dc1aa7384c45ba28f935a867a059335b49d · Simplify has uncommitted source or grammar changes