CHSPS Quantitative Criteria Methodology
The CHSPS-controlled methodology for distinguishing normative requirements, CHSPS service targets, technical interpretation ranges and empirical benchmarks.
Four classes of quantitative values
Every quantitative value published by CHSPS is assigned a defined class before it is used. This prevents a planning number, service target or technical interpretation range from being treated as a hidden accreditation requirement.
CHSPS Policy Requirement
A normative value only when a controlled CHSPS standard or policy expressly requires it. These values are enforceable within the stated scope, edition and effective date.
CHSPS Service Target
An internal performance target for CHSPS response times, publication timing, administrative processing or other Commission services. It measures CHSPS performance, not applicant conformity.
CHSPS Reference Criterion
A CHSPS-developed technical interpretation range used for monitoring, applicant orientation and risk-based review. A reference criterion is not automatically normative and cannot independently create a finding.
CHSPS Empirical Benchmark
A statistic derived from a defined, validation-eligible CHSPS dataset using a published measure specification, denominator rule, reporting period and controlled calculation method.
Preferred operating band
The range CHSPS currently considers consistent with strong operation for the defined measure and context. It is a review reference, not an automatic pass decision.
Watch band
A range that prompts CHSPS to examine context, denominator size, direction of travel, operational risk and the reason for the result before drawing conclusions.
Review trigger
A range that ordinarily warrants deeper evidence review, sampling, root-cause analysis or corrective-action discussion. It still does not substitute for a standards-based finding.
Rules for CHSPS empirical benchmarks
- Use only CHSPS data that have passed the applicable validation and eligibility controls.
- Match data to the exact measure edition, numerator, denominator, exclusions and reporting period.
- Publish the minimum denominator or sample rule required for a stable comparison.
- Suppress or withhold comparisons when volume, completeness or validation status is insufficient.
- Separate descriptive context measures from measures for which CHSPS has established a preferred direction.
- Recalculate distributions only on a controlled release cycle and preserve historical benchmark versions.
- Document changes to measure logic, eligibility rules or benchmark construction before a new edition is released.
- Never convert an empirical benchmark into an accreditation requirement without CHSPS standards governance and controlled publication.
How CHSPS develops and controls reference criteria
CHSPS develops its quantitative criteria under CHSPS-MEAS-100 as an internal controlled methodology. The values are authored, reviewed, approved, versioned and maintained by CHSPS. They are intended to make CHSPS interpretation more consistent and transparent without allowing an unpublished number to become a substitute for a published standard.
1. Define the decision purpose before selecting a number
CHSPS first identifies what the measure is intended to support: Commission service monitoring, applicant orientation, accreditation evidence review, ongoing accreditation maintenance, quality surveillance or future empirical comparison. The intended use determines the classification of the value and the degree of control required.
2. Lock the measure specification
Before a criterion is adopted, CHSPS defines the measure ID, scope, numerator, denominator, exclusions, direction of performance, reporting period, data source, minimum count where applicable and any conditions that make the result non-comparable. A criterion cannot be interpreted independently of that specification.
3. Set the initial interpretation range through CHSPS technical review
When sufficient empirical CHSPS data do not yet exist, the initial range is established as a CHSPS Reference Criterion through documented technical judgment. The review considers the underlying CHSPS requirement, operational risk, severity of potential failure, expected evidence quality, measurement stability, practical detectability and whether the value could create unintended incentives. The result is deliberately labeled as a CHSPS reference criterion rather than represented as a market benchmark.
4. Challenge the criterion against realistic cases
CHSPS tests proposed ranges against plausible operating scenarios and edge cases. Reviewers consider small denominators, one-time events, missing data, mixed populations, improvement trends, isolated critical failures and situations in which a favorable percentage could conceal a material control weakness. A range that produces misleading conclusions is revised before controlled release.
5. Approve, version and publish the criterion
Each released criterion carries a metric identifier, classification, edition, preferred band, watch band, review trigger, applicability statement, evidence basis and review date. Publication in the controlled CSV and JSON files provides a machine-readable record of the same CHSPS criteria used for interpretation. Changes are versioned rather than silently overwritten.
6. Reassess the range when CHSPS evidence matures
CHSPS periodically reassesses reference criteria using new internal review experience, measure-performance evidence and validation-eligible CHSPS datasets. A change may tighten, widen, retire or reclassify a range. Where an empirical distribution becomes sufficiently stable, CHSPS may publish a separate Empirical Benchmark while retaining the distinction between an observed benchmark and a normative requirement.
What is recorded for each released criterion
- Identity: page or program context, CHSPS metric ID, metric name and edition.
- Classification: CHSPS Policy Requirement, CHSPS Service Target, CHSPS Reference Criterion or CHSPS Empirical Benchmark.
- Interpretation: preferred operating band, watch band and review trigger where those fields apply.
- Evidence basis: the CHSPS rationale for the range and whether the value is technical judgment or an empirical result.
- Applicability: limits on scope, denominator, risk, data quality and circumstances in which comparison is inappropriate.
- Control record: edition and last-reviewed date so later changes can be distinguished from the prior release.
Change control and transparency
CHSPS maintains the criteria as controlled information. Proposed changes are documented, technically reviewed, checked for classification and scope, approved for release, assigned an edition or review date and published consistently across the human-readable methodology and machine-readable data files. Historical versions are retained so a later criterion is not retroactively applied to an earlier review period.
When a criterion is revised, CHSPS evaluates whether the change affects only interpretation guidance or whether a normative standards change is required. Only the latter can create or modify an accreditation requirement, and that change must occur through the controlled CHSPS standards process.
The CSV and JSON files are the machine-readable publication of the controlled CHSPS criteria described on this page.
