OpenJobs Archive ยท Field Notes

A 24-point pilot gate

Use the AI recruiting evaluation scorecard on one real workflow.

Rate eight dimensions from 0 to 3 using evidence from a real workflow. Scripted demonstrations remain level-one evidence. The score organizes discussion and does not determine compliance or replace accountable human review.

0No evidence
1Claim or demo only
2Pilot evidence with gaps
3Repeatable, auditable evidence

Outcome definition

The team agrees what "qualified, interested, and worth interviewing" means before reviewing results.

Brief fidelity

Must-haves, preferences, trade-offs, geography, and evidence of seniority are explicit and approved.

Search provenance

Sources, coverage, refresh limits, exclusions, and likely blind spots are documented for the role.

Match evidence

Every recommendation can be traced to role-relevant evidence, and reviewers can inspect rejects and borderline cases.

External action control

Sender identity, channel, message, timing, follow-up, suppression, and approval boundaries are visible and enforceable.

Candidate experience and accessibility

People can understand the process, request an accommodation, correct relevant data, opt out, and reach a human.

Handoff quality

The hiring team receives evidence, current interest, unresolved questions, and a clear next step. A raw queue does not meet this standard.

Audit and fallback

Inputs, edits, approvals, actions, and outcomes remain distinguishable; automation can pause without losing the workflow.

0/24 Score every dimension to see a pilot recommendation.

Interpretation: 0 to 8 means stop; 9 to 16 supports only a narrow, reversible pilot; 17 to 24 means the system is ready to be validated on a real role. A high score is not proof of legal compliance, fairness, or business value.

Deep review

Use the guide that explains each weak score.

ProcurementVendor checklist PilotPilot design and metrics SourcingSourcing and ranking evaluation ScreeningScreening evaluation AgentsAgent reliability evaluation MethodEvidence and scoring methodology

Next step

Test each score against the actual workflow.

Ask the vendor to demonstrate every scored dimension using one role, including weak matches, corrections, approval points, and the final handoff.

Open the vendor checklist Build the pilot