Educational reference
Use it to understand evidence relationships, reviewer focus and the order in which technical questions are usually easiest to answer.
Certification assessment reference
Psychometric evidence & technical review
A practical map of how assessment evidence is built, maintained and evaluated in CHSPS certification-program accreditation. The certification body owns assessment design. CHSPS reviewers and technical specialists evaluate submitted evidence against published requirements, while the accreditation decision remains separate.
Program evidenceDefine → Build → Analyze → Maintain
CHSPS reviewScope → Assign → Trace → Evaluate
Review outputClarification → Findings → Review record
DecisionIndependent accreditation process
Use this page correctly
A public technical map, not a hidden scoring rubric.
Psychometric evidence is reviewed within the published CHSPS standards, reviewer policy and accreditation process. This page explains that architecture in one place.
Not applicant-specific design
CHSPS does not select methods, write items, set an applicant’s cut score or prepare evidence for an accreditation file.
Controlled documents govern
If this explanatory page differs from CERT-200, CORE-100, AUD-400 or another applicable controlled document, the controlled document governs.
Formalization status
CHSPS does not currently publish a separate psychometric scoring rubric or stand-alone psychometric accreditation standard. The public requirements remain the applicable controlled standards and policies. Any future controlled psychometric review procedure would be adopted and published through normal CHSPS document-control governance; this page does not pre-adopt one.
Eight-stage evidence lifecycle
Build the validity argument as a maintained system.
Review is easier when each stage is traceable to the stage before it and the organization can show how the system is monitored after launch.
01Define
Practice analysis & intended use
Establish what competent practice requires, who the credential serves and what interpretation the assessment is intended to support.
CERT 3.102Blueprint
Content, weights & traceability
Translate practice evidence into domains, weights, cognitive expectations and a controlled specification for assessment coverage.
CERT 6.103Develop
Items, exercises & review
Create and maintain assessment content through qualified SME review, fairness review, version control and documented item-bank governance.
CERT 7.104Establish
Passing standard
Set the performance standard through a documented method appropriate to the assessment and record panel composition, judgments and rationale.
CERT 9.105Analyze
Scores & decision quality
Monitor scoring accuracy, reliability or other appropriate precision evidence, item performance and consistency of high-stakes decisions.
CERT 8.1 / 1306Validate
Validity & fairness evidence
Maintain a coherent evidence argument connecting practice, blueprint, content, scoring, standard setting, fairness and intended interpretation.
CERT 6–907Maintain
Forms, security & monitoring
Control form assembly, comparability, exposure, administration, identity, incidents and statistical monitoring using methods appropriate to the program.
CERT 10–1208Revalidate
Change, recertification & automation
Revisit assumptions when practice, blueprint, delivery, technology, AI use or continuing-competence design materially changes.
Applicable CERT clausesTraceability principle
A reviewer should be able to move from the intended credential decision back through score interpretation, passing standard, assessment content, blueprint and the evidence describing competent practice, then forward again without unexplained gaps.
CHSPS technical review sequence
How psychometric evidence moves through accreditation review.
This sequence explains the technical-review layer inside the published accreditation framework. It does not create separate pass/fail criteria.
- 01
Confirm scope
Identify the applicable accreditation pathway, assessment model and published clauses before technical evidence is evaluated.
- 02
Map evidence
Organize submitted artifacts so each material psychometric claim can be traced to objective evidence and the applicable requirement.
- 03
Assign qualified review
Use an authorized accreditation reviewer and, where needed, a Technical Specialist with relevant psychometric expertise, subject to conflict controls.
- 04
Walk traceability
Follow the chain from practice analysis through blueprint, assessment content, scoring, passing standard and intended credential decision.
- 05
Evaluate methods & data
Examine whether the methods, quantitative evidence, limitations, monitoring and change controls are appropriate to the program and the claims made.
- 06
Clarify & document findings
Request clarification where evidence is incomplete or unclear, then document findings against the published requirements rather than redesigning the applicant’s system.
- 07
Finalize the review record
Complete the technical review record with the evidence basis, unresolved issues and applicable findings available to the accreditation decision process.
- 08
Independent decision
The accreditation decision is made through the applicable CHSPS decision process, separate from applicant education and from the applicant’s psychometric consultant.
Technical reviewEvaluate evidence and document findings.
Assessment consultingDesign the applicant’s psychometric system.
Accreditation decisionDetermine accreditation status under the applicable decision process.
Role separation
Four roles, four different responsibilities.
Clear role boundaries protect both technical quality and accreditation impartiality.
Owns the credential system
- Defines scheme purpose and governance
- Approves practice-analysis and assessment policies
- Owns candidate decisions and records
- Remains accountable for vendors and automated systems
Designs and executes methods
- Advises on technically appropriate methods
- Conducts or supports analyses
- Documents assumptions and limitations
- Supports monitoring and revalidation
Evaluates submitted evidence
- Works against published requirements
- Tests traceability and evidence sufficiency
- Documents clarification needs and findings
- Does not redesign the applicant’s assessment
Makes the accreditation decision
- Receives the controlled review record
- Operates under applicable governance and conflict controls
- Determines accreditation status
- Is separate from applicant education and consulting
Reviewer roles, authorization, calibration, assignment and conflict challenge are controlled by CHSPS-AUD-400.
Evidence quality
What makes a psychometric claim reviewable?
A strong file connects a claim to the current method, operating records, results, limitations and the organization’s response when the evidence changes.
| Area | Reviewable evidence | Weak substitute |
|---|---|---|
| Practice basis | Current practice-analysis method, participants, results and traceability | Job description alone |
| Blueprint | Weighted controlled blueprint with linkage and version history | Unweighted topic list |
| Item governance | Procedures, SME qualifications, review records and item-bank controls | Item bank screenshot |
| Passing standard | Standard-setting study, panel evidence, judgments and rationale | Traditional percentage |
| Score quality | Appropriate precision/reliability evidence, scoring QC and monitoring | Pass rate alone |
| Comparability | Assembly, linking/equating or documented small-volume comparability approach | Same cut score without rationale |
| Security | Controls plus operating logs, incident review and monitoring evidence | Policy without records |
| Maintenance | Revalidation triggers, trend review, change records and response actions | Launch-year evidence only |
Small-volume programs
Technical rigor does not require fabricated precision.
Some programs do not have enough candidates for every large-sample statistic or equating design. The technical question becomes whether the organization uses an appropriate, documented approach and is transparent about what the available data can and cannot support.
- Use methods appropriate to the available data.Do not report unstable statistics as if they were definitive.
- Document limitations.State sample-size constraints, assumptions and the resulting limits on interpretation.
- Use alternative evidence deliberately.Structured SME evidence, controlled form assembly and cumulative monitoring may supplement analyses when justified.
- Define escalation triggers.Specify when increased volume, a material change or concerning performance requires additional analysis.
- Keep the rationale reviewable.A small-volume approach still needs a documented technical basis and ongoing monitoring.
Technical reference library
Eleven assessment topics mapped to CERT-200.
Open a topic for the evidence relationship and the common gap that can make a psychometric claim difficult to review.
1Job / practice analysisCERT 3.1
Evidence reviewers should be able to follow
Documented method, participant qualifications, results, domain weights, traceability and a defined revalidation approach.
Common evidence gap
A job description or retrospective narrative that does not show how practice evidence informed the assessment.
2Assessment blueprintCERT 6.1
Evidence reviewers should be able to follow
Controlled domain and subdomain weights, item or score-point targets, cognitive expectations where applicable, and version history.
Common evidence gap
A topic list without weights, traceability or change control.
3Item development & reviewCERT 7.1
Evidence reviewers should be able to follow
SME selection criteria, training, conflict controls, item-writing procedures, technical and fairness review, field data and bank access controls.
Common evidence gap
An item bank alone, without evidence of how content was created, reviewed, approved and retired.
4Standard settingCERT 9.1
Evidence reviewers should be able to follow
Method rationale, panel qualifications, conflict screening, ratings or judgments, resulting standard and documented re-evaluation triggers.
Common evidence gap
A historical percentage or pass rate used as the passing score without a defensible standard-setting basis.
5Reliability & scoring accuracyCERT 8.1
Evidence reviewers should be able to follow
Form- or administration-level precision evidence appropriate to the score model, scoring QC, decision-consistency evidence where applicable and monitoring records.
Common evidence gap
A single launch-year coefficient or pass rate presented as the complete quality argument.
6Validity evidenceCERT 6–9
Evidence reviewers should be able to follow
A written evidence argument that connects intended interpretation to practice analysis, blueprint, content, scoring, passing standard, fairness and observed performance.
Common evidence gap
A stand-alone “validity report” that cannot be traced to the current assessment design.
7Form comparability & equatingCERT 10.1
Evidence reviewers should be able to follow
Form-assembly rules, linking or equating where appropriate, or a documented small-volume comparability approach with limitations and monitoring.
Common evidence gap
Applying one cut score to materially different forms without a documented comparability rationale.
8Administration, security & irregularitiesCERT 11–12
Evidence reviewers should be able to follow
Standardized administration controls, content protection, exposure management, incident logs, response records and anomaly monitoring where volume supports it.
Common evidence gap
A security policy with no operating records showing that incidents and monitoring are actually managed.
9Identity verificationCERT 11.1
Evidence reviewers should be able to follow
Accepted-ID rules, exception handling, remote identity controls where used and impersonation-response procedures.
Common evidence gap
In-person identity rules reused for remote delivery without a documented remote workflow.
10Recertification & continuing competenceCERT 15.1
Evidence reviewers should be able to follow
Defined cycle, competence rationale, renewal requirements, verification or audit controls, lapse and reinstatement rules, and monitoring of the renewal system.
Common evidence gap
Renewal based only on accumulated hours without a documented continuing-competence rationale.
11AI & automated systemsCERT 15.3
Evidence reviewers should be able to follow
Inventory of consequential automated functions, intended use, validation evidence, human oversight, bias review, version/change control and auditability.
Common evidence gap
Relying only on a vendor statement without evidence that the organization validated and governs its own intended use.
Ready to scope the review?
Start with the certification program and the evidence chain.
Use the no-fee eligibility inquiry to confirm pathway fit and proposed scope. Formal psychometric evidence is evaluated later through the controlled accreditation review process.