How evidence is reviewed
A number is published with its boundary, or not at all.
The rules below are the ones the documentation applies on every page. They decide what may be called a result, what stays labelled as a diagnostic, and what a figure can and cannot be compared with.
CONTEXTEvery figure names its campaign
A headline figure states its campaign date, host, workload, rate and transport. Published numbers describe the recorded environment, not a latency guarantee on different hardware or topology. How we benchmark a FIX engine.
PARITYComparable work before speed
An adapter must do the same work to enter a comparison. The qualified HP codec campaign of 18 October 2026 checks converted values and complete business-field sets through each public parser API, with 332 isolated text and numeric probes. Parity rules.
ADMISSIONDiagnostics stay diagnostics
Only an S5 pass on all four canonical flows is eligible for a report-grade full-engine comparison. A missed rate, an incomplete cell or a newer functional smoke test supplies no ranked latency, and failed targets stay visible in each language's engine comparison.
CLASSIFICATIONCoverage is classified, not flattened
Source-symbol coverage, conformance behavior, measured performance and scoped boundaries are kept apart. A generated codec is not a complete venue connector; a raw NIC measurement is not a FIX round trip; a local active/passive test is not cross-datacentre replication. LibHFT documentation.
RETENTIONEvidence files stay attached
Results are published with their source revision and SHA-256 hash, and superseded measurement profiles keep their correction notes instead of disappearing. Result catalogue.
SCOPENot certification
The public documentation summarizes committed, conformance-tracked evidence. It is not venue certification or a deployment-specific guarantee: benchmark the flavor, transport and hardware you will operate. Venue evidence boundary.