Packet timings

These timings describe this packet, not the whole run.

Pipeline timing breakdown · 86.88s end-to-end · 69.92s KPI computation
Level 0Packet work · 86.88sPacket work · 86.88s
Level 1Prepare packet · 0.19sPrepare packet · 0.19sKPI refresh · 83.77sKPI refresh · 83.77sMerge packet totals · 1.26sMerge packet totals · 1.26sWrite run report · 0.31sWrite run report · 0.31sPromote checkpoint · 0.82sPromote checkpoint · 0.82sPublish website · 0.01sPublish website · 0.01sOther packet work · 0.53sOther packet work · 0.53s
Level 2Resolve current engine · 0.00sResolve current engine · 0.00sCheck / refresh corpus index · 0.00sCheck / refresh corpus index · 0.00sRead corpus identity · 0.04sRead corpus identity · 0.04sResolve previous engine · 0.02sResolve previous engine · 0.02sFingerprint current grammar and parser · 0.00sFingerprint current grammar and parser · 0.00sFingerprint previous grammar and parser · 0.00sFingerprint previous grammar and parser · 0.00sFingerprint visualizer pipeline · 0.04sFingerprint visualizer pipeline · 0.04sCheck static-page renderer · 0.03sCheck static-page renderer · 0.03sChoose packet / resume position · 0.02sChoose packet / resume position · 0.02sOther preparation · 0.03sOther preparation · 0.03sPrepare pinned engine · 0.01sPrepare pinned engine · 0.01sPrepare worker · 0.12sPrepare worker · 0.12sCompute KPIs and artifacts · 83.36sCompute KPIs and artifacts · 83.36sPublish latest KPI and manifest · 0.24sPublish latest KPI and manifest · 0.24sOther refresh work · 0.04sOther refresh work · 0.04sRead packet and prior totals · 0.09sRead packet and prior totals · 0.09sUpdate new-pattern ledger · 0.08sUpdate new-pattern ledger · 0.08sCombine KPI totals · 0.44sCombine KPI totals · 0.44sWrite cumulative totals · 0.29sWrite cumulative totals · 0.29sPublish latest KPI · 0.28sPublish latest KPI · 0.28sPublish new-pattern summary · 0.00sPublish new-pattern summary · 0.00sUpdate run history · 0.03sUpdate run history · 0.03sOther merge work · 0.05sOther merge work · 0.05sCopy KPI and powerset files · 0.02sCopy KPI and powerset files · 0.02sCopy Hypertrie files · 0.00sCopy Hypertrie files · 0.00sCopy Hypertrie branches · 0.01sCopy Hypertrie branches · 0.01sBack up and verify novelty database · 0.06sBack up and verify novelty database · 0.06sLink and verify sentence index · 0.58sLink and verify sentence index · 0.58sFinalize checkpoint manifest · 0.00sFinalize checkpoint manifest · 0.00sSwitch stable checkpoint pointer · 0.00sSwitch stable checkpoint pointer · 0.00sRemove previous checkpoint · 0.00sRemove previous checkpoint · 0.00sStart Python and load checkpoint tool · 0.03sStart Python and load checkpoint tool · 0.03sFinish command and write timing report · 0.02sFinish command and write timing report · 0.02sOther checkpoint work inside the measured publish step · 0.11sOther checkpoint work inside the measured publish step · 0.11sOther website work · 0.01sOther website work · 0.01s
Level 3Check out required engine files · 0.00sCheck out required engine files · 0.00sLink runtime data · 0.00sLink runtime data · 0.00sOther snapshot preparation · 0.01sOther snapshot preparation · 0.01sIdentify engine and runtime · 0.07sIdentify engine and runtime · 0.07sRetire previous worker · 0.00sRetire previous worker · 0.00sRemove previous engine snapshot · 0.00sRemove previous engine snapshot · 0.00sWrite worker request · 0.02sWrite worker request · 0.02sModel initialization · 0.00sModel initialization · 0.00sOther worker preparation · 0.02sOther worker preparation · 0.02sSelect sentences · 0.07sSelect sentences · 0.07sMeasure new patterns · 1.80sMeasure new patterns · 1.80sColouring and hypertrie · 67.95sColouring and hypertrie · 67.95sMeasure rule activity · 0.08sMeasure rule activity · 0.08sUpdate shape ledger · 0.00sUpdate shape ledger · 0.00sMeasure rule-message context · 0.00sMeasure rule-message context · 0.00sInspect rule-work queues · 0.00sInspect rule-work queues · 0.00sCompare full-corpus progress · 0.01sCompare full-corpus progress · 0.01sCompare ready-to-test rules · 0.00sCompare ready-to-test rules · 0.00sOther KPI work · 13.44sOther KPI work · 13.44sCheck KPI output is complete · 0.03sCheck KPI output is complete · 0.03sValidate Hypertrie index · 0.04sValidate Hypertrie index · 0.04sAudit rule ownership · 0.00sAudit rule ownership · 0.00sConfirm engine stayed consistent · 0.01sConfirm engine stayed consistent · 0.01sWrite run manifest · 0.07sWrite run manifest · 0.07sPublish verified files · host I/O pressure during publish: some 0.000s, full 0.000s · 0.08sPublish verified files · host I/O pressure during publish: some 0.000s, full 0.000s · 0.08sOther validation and publish work · 0.01sOther validation and publish work · 0.01sOpen new-pattern database · 0.00sOpen new-pattern database · 0.00sRecord packet sentences and patterns · 0.02sRecord packet sentences and patterns · 0.02sRecalculate new-pattern rates · 0.06sRecalculate new-pattern rates · 0.06sOther new-pattern ledger work · 0.01sOther new-pattern ledger work · 0.01sRead and hash merged KPI · 0.01sRead and hash merged KPI · 0.01sRefresh run manifest and archive · 0.00sRefresh run manifest and archive · 0.00sRead and split history (1.8 MiB, 78 rows) · 0.00sRead and split history (1.8 MiB, 78 rows) · 0.00sUpdate latest history row · 0.00sUpdate latest history row · 0.00sNormalize earlier rows (77 scanned, 0 changed) · 0.01sNormalize earlier rows (77 scanned, 0 changed) · 0.01sWrite history file · 0.00sWrite history file · 0.00sKPI files · 0.01sKPI files · 0.01sPowerset files · 0.00sPowerset files · 0.00sHypertrie files · 0.00sHypertrie files · 0.00sBranch files · 0.01sBranch files · 0.01sCopy stable SQLite file · 0.04sCopy stable SQLite file · 0.04sCheck source files · 0.00sCheck source files · 0.00sIntegrity check · 0.02sIntegrity check · 0.02sConfirm source stayed unchanged · 0.00sConfirm source stayed unchanged · 0.00s
Level 4Check whether these sentences were already counted · 0.01sCheck whether these sentences were already counted · 0.01sParse uncached sentences · 1.41sParse uncached sentences · 1.41sPrepare corpus input · 0.00sPrepare corpus input · 0.00sLoad Simplify modules · 0.00sLoad Simplify modules · 0.00sSet up sentence replay · 0.00sSet up sentence replay · 0.00sReplay corpus sentences · 39.59sReplay corpus sentences · 39.59sPrepare replay output · 0.00sPrepare replay output · 0.00sWrite annotations · 0.10sWrite annotations · 0.10sPrepare Hypertrie input · 13.51sPrepare Hypertrie input · 13.51sHypertrie · 14.73sHypertrie · 14.73sValidate Hypertrie output · 0.00sValidate Hypertrie output · 0.00sPublish graph artifacts · 0.01sPublish graph artifacts · 0.01sCheck rule ownership · 0.00sCheck rule ownership · 0.00sUnattributed coverage time · 0.00sUnattributed coverage time · 0.00sPrepare destination folders · 0.00sPrepare destination folders · 0.00sCopy run-manifest archive · 0.00sCopy run-manifest archive · 0.00sMove Hypertrie branch files (1 files) · 0.00sMove Hypertrie branch files (1 files) · 0.00sMove report artifacts (10 files) · slowest move: latest.json (0.004s, 1719.3 KiB, same filesystem) · 0.05sMove report artifacts (10 files) · slowest move: latest.json (0.004s, 1719.3 KiB, same filesystem) · 0.05sMove coverage ledgers (1 files) · 0.00sMove coverage ledgers (1 files) · 0.00sPublish latest KPI and manifest · slowest move: kpi-latest.json (0.003s) · 0.01sPublish latest KPI and manifest · slowest move: kpi-latest.json (0.003s) · 0.01sOther publication work · 0.02sOther publication work · 0.02sCheck saved novelty summary (miss) · 0.00sCheck saved novelty summary (miss) · 0.00sSummarize all recorded sentences · 0.01sSummarize all recorded sentences · 0.01sRead recent sentences · 0.00sRead recent sentences · 0.00sGroup history by source · 0.01sGroup history by source · 0.01sSelect balanced sample · 0.03sSelect balanced sample · 0.03sCalculate rates and intervals · 0.00sCalculate rates and intervals · 0.00sPrepare destination directory · 12.5 MiB · 0.00sPrepare destination directory · 12.5 MiB · 0.00sOpen source file · 12.5 MiB · 0.00sOpen source file · 12.5 MiB · 0.00sCreate destination file · 12.5 MiB · 0.00sCreate destination file · 12.5 MiB · 0.00sRead source · 12.5 MiB · 0.00sRead source · 12.5 MiB · 0.00sWrite destination · 12.5 MiB · 0.01sWrite destination · 12.5 MiB · 0.01sCalculate checksum · 12.5 MiB · 0.01sCalculate checksum · 12.5 MiB · 0.01sFlush destination writes · 12.5 MiB · 0.00sFlush destination writes · 12.5 MiB · 0.00sClose files · 12.5 MiB · 0.00sClose files · 12.5 MiB · 0.00sCopy file metadata and record checksum · 12.5 MiB · 0.00sCopy file metadata and record checksum · 12.5 MiB · 0.00sPrepare destination directory · 20.7 KiB · 0.00sPrepare destination directory · 20.7 KiB · 0.00sOpen source file · 20.7 KiB · 0.00sOpen source file · 20.7 KiB · 0.00sCreate destination file · 20.7 KiB · 0.00sCreate destination file · 20.7 KiB · 0.00sRead source · 20.7 KiB · 0.00sRead source · 20.7 KiB · 0.00sWrite destination · 20.7 KiB · 0.00sWrite destination · 20.7 KiB · 0.00sCalculate checksum · 20.7 KiB · 0.00sCalculate checksum · 20.7 KiB · 0.00sFlush destination writes · 20.7 KiB · 0.00sFlush destination writes · 20.7 KiB · 0.00sClose files · 20.7 KiB · 0.00sClose files · 20.7 KiB · 0.00sCopy file metadata and record checksum · 20.7 KiB · 0.00sCopy file metadata and record checksum · 20.7 KiB · 0.00sPrepare destination directory · 3.7 MiB · 0.00sPrepare destination directory · 3.7 MiB · 0.00sOpen source file · 3.7 MiB · 0.00sOpen source file · 3.7 MiB · 0.00sCreate destination file · 3.7 MiB · 0.00sCreate destination file · 3.7 MiB · 0.00sRead source · 3.7 MiB · 0.00sRead source · 3.7 MiB · 0.00sWrite destination · 3.7 MiB · 0.00sWrite destination · 3.7 MiB · 0.00sCalculate checksum · 3.7 MiB · 0.00sCalculate checksum · 3.7 MiB · 0.00sFlush destination writes · 3.7 MiB · 0.00sFlush destination writes · 3.7 MiB · 0.00sClose files · 3.7 MiB · 0.00sClose files · 3.7 MiB · 0.00sCopy file metadata and record checksum · 3.7 MiB · 0.00sCopy file metadata and record checksum · 3.7 MiB · 0.00sPrepare destination directory · 1.0 MiB · 0.00sPrepare destination directory · 1.0 MiB · 0.00sOpen source file · 1.0 MiB · 0.00sOpen source file · 1.0 MiB · 0.00sCreate destination file · 1.0 MiB · 0.00sCreate destination file · 1.0 MiB · 0.00sRead source · 1.0 MiB · 0.00sRead source · 1.0 MiB · 0.00sWrite destination · 1.0 MiB · 0.00sWrite destination · 1.0 MiB · 0.00sCalculate checksum · 1.0 MiB · 0.00sCalculate checksum · 1.0 MiB · 0.00sFlush destination writes · 1.0 MiB · 0.00sFlush destination writes · 1.0 MiB · 0.00sClose files · 1.0 MiB · 0.00sClose files · 1.0 MiB · 0.00sCopy file metadata and record checksum · 1.0 MiB · 0.00sCopy file metadata and record checksum · 1.0 MiB · 0.00sPrepare destination directory · 22.8 MiB · 0.00sPrepare destination directory · 22.8 MiB · 0.00sOpen source file · 22.8 MiB · 0.00sOpen source file · 22.8 MiB · 0.00sCreate destination file · 22.8 MiB · 0.00sCreate destination file · 22.8 MiB · 0.00sRead source · 22.8 MiB (1,720.9 MiB/s) · 0.01sRead source · 22.8 MiB (1,720.9 MiB/s) · 0.01sWrite destination · 22.8 MiB (1,750.0 MiB/s) · 0.01sWrite destination · 22.8 MiB (1,750.0 MiB/s) · 0.01sCalculate checksum · 22.8 MiB (2,143.7 MiB/s) · 0.01sCalculate checksum · 22.8 MiB (2,143.7 MiB/s) · 0.01sFlush destination writes · 22.8 MiB · 0.00sFlush destination writes · 22.8 MiB · 0.00sClose files · 22.8 MiB · 0.00sClose files · 22.8 MiB · 0.00sCopy file metadata and record checksum · 22.8 MiB · 0.00sCopy file metadata and record checksum · 22.8 MiB · 0.00s
Level 5Check indexed sentence records · read 344,064 bytes · host I/O stall some 2 ms, full 2 ms · 0.01sCheck indexed sentence records · read 344,064 bytes · host I/O stall some 2 ms, full 2 ms · 0.01sOpen acquisition ledger · 0.00sOpen acquisition ledger · 0.00sRead ledger schema · 0.00sRead ledger schema · 0.00sClose acquisition ledger · 0.00sClose acquisition ledger · 0.00sSimplify · 39.27sSimplify · 39.27sConvert annotations to JSON · 0.25sConvert annotations to JSON · 0.25sVisualizer bookkeeping · 0.02sVisualizer bookkeeping · 0.02sOther sentence replay work · 0.05sOther sentence replay work · 0.05sParse output clauses · 0.47sParse output clauses · 0.47sBuild trees and slices · 0.39sBuild trees and slices · 0.39sFinish Rust aggregation · 0.19sFinish Rust aggregation · 0.19sCompact and write indexes · 0.23sCompact and write indexes · 0.23sWorker overhead outside measured trie work · 13.46sWorker overhead outside measured trie work · 13.46s
Level 6Coreference · 1.16sCoreference · 1.16sPreprocess and lineage · 0.03sPreprocess and lineage · 0.03sTree++ and rule processing · 7.60sTree++ and rule processing · 7.60sBuild and emit output · 23.84sBuild and emit output · 23.84sOther / not yet broken down · 6.65sOther / not yet broken down · 6.65sCount closed words · 0.01sCount closed words · 0.01sAttribute rule activity · 0.00sAttribute rule activity · 0.00sMerge clauses and relations · 0.00sMerge clauses and relations · 0.00sBuild output clauses · 0.00sBuild output clauses · 0.00sSetup before trie work · 0.03sSetup before trie work · 0.03sWorker dispatch / wrapper overhead · 13.42sWorker dispatch / wrapper overhead · 13.42s
Level 7Preprocess coreference · 1.16sPreprocess coreference · 1.16sPreprocess layout and lineage · 0.03sPreprocess layout and lineage · 0.03sPrime parser and build forests · 1.01sPrime parser and build forests · 1.01sA · Expand input · 0.00sA · Expand input · 0.00sA · Build document packets · 0.00sA · Build document packets · 0.00sB · Apply rules / normalize · 6.51sB · Apply rules / normalize · 6.51sC · Join output surfaces · 0.00sC · Join output surfaces · 0.00sD · Build annotation cache · 0.07sD · Build annotation cache · 0.07sRender simplified text · 0.00sRender simplified text · 0.00sBuild output annotations and Tree++ structure · after first: median 64–128 ms, p95 256–512 ms · slowest sentence #25: 726 ms (44 words, 203 characters) · tell-me-a-story-ccby-2024:L23863 · 23.83sBuild output annotations and Tree++ structure · after first: median 64–128 ms, p95 256–512 ms · slowest sentence #25: 726 ms (44 words, 203 characters) · tell-me-a-story-ccby-2024:L23863 · 23.83s
Level 8Produce semantic payload · after first: median 64–128 ms, p95 128–256 ms · slowest sentence #25: 666 ms (44 words, 203 characters) · tell-me-a-story-ccby-2024:L23863 · 20.25sProduce semantic payload · after first: median 64–128 ms, p95 128–256 ms · slowest sentence #25: 666 ms (44 words, 203 characters) · tell-me-a-story-ccby-2024:L23863 · 20.25sBuild typed document · 0.48sBuild typed document · 0.48sPost-assembly · 3.10sPost-assembly · 3.10sComplete annotation envelope · 0.00sComplete annotation envelope · 0.00s
Level 9Legacy annotation assembly · 4.02sLegacy annotation assembly · 4.02sOther semantic production · 16.24sOther semantic production · 16.24s
Level 10Build WordNet profile · 0.07sBuild WordNet profile · 0.07sApply authored-marker overlay · 0.02sApply authored-marker overlay · 0.02sBuild document units · 2.98sBuild document units · 2.98sRun final annotation passes · 0.93sRun final annotation passes · 0.93sOther legacy annotation work · 0.01sOther legacy annotation work · 0.01s

Each row expands the stages above it. Segment widths show their share of the parent time; colours distinguish branches and depth.

First parse call: 0.27s; included in the steady rate.

Simplify phases are summed across this packet. The listed top-level engine phases are additive; some diagnostic subtimers overlap them and are intentionally omitted. Tree++ relation-only time is not measured separately.