How it could work
Separate setup and recurring costs; include staff review, training, outages, audits and exit costs. Compare the AI-assisted option against the organized human process before assigning AI any incremental value.
Where it can fail
An average unit cost can fall while total spending rises. A municipality may pay for integration while another institution benefits, and delay or burden can be counted twice if definitions overlap.
What to measure
Report total and incremental costs by payer and period, costs per completed case using stated denominators, and service, rights and safety outcomes in their own units.
Design a test
Use equal service targets and a declared budget. Compare three approaches, then vary staff review time, verification burden and confirmed delivery costs within declared ranges.
When to pause or retest
Do not scale from a single optimistic cost estimate. Require a named funding owner and record what happens if review load grows, partner support falls, or minimum safeguards cost more than expected.
What this evidence can support
A fictional budget demonstrates arithmetic and exposes assumptions. It does not establish financial return or justify monetizing rights or safety outcomes.
Trace the decision
From a faster AI step to a decision about value
Faster AI drafting only matters if audited total workload, service or cost improves under the same review requirements. Measure the burden shifted to downstream teams.
- Match eligibility and staffing across workflows
- Audit total time, mistakes and rework
- Compare incremental resources against a predeclared target
Hold capacity fixed and retain error records. Repeat across different case mixes and state which costs and harms were left out.
When this overlaps another topic
Time saved and cash saved are different outcomes
Lower manual time may free capacity without reducing spending, while training, tools, verification and incident follow-up may add costs.
Check: Log review and rework hours separately, state the valuation if comparing money, and test whether the option clears the proposed minimum improvement after costs.
Sources and scope
These references support particular methods or historical context. The research design above is a proposal.
- HM Treasury Magenta Book: Analytical methods · Methods guidance
Explains comparison designs, attribution, evidence synthesis and value for money methods.
- NIST AI Risk Management Framework: Measure · Methods guidance
Supports documenting tests, errors, human overrides and independent review.
Original hypotheses to examine
These source records remain untested.