How it could work
Agree on eligibility and denominators in advance. Compare outcomes across relevant groups using aggregate or protected records and include qualitative feedback about barriers that counts miss.
Where it can fail
Overall coverage can rise while a small group loses service. Disclosing granular cells can expose people, while suppressing small groups can also make their experience invisible in a public report.
What to measure
Report service received / eligible need for each applicable group, shortfall and uncertainty, suppression rules and whether groups overlap. State the number of people or service units behind each reportable rate.
Design a test
Use synthetic aggregates with unequal base rates and deliberately missing reports from one area. Compare a volume-first rule with a scenario that applies a minimum coverage floor.
When to pause or retest
Reassess a proposal if a group falls below its agreed floor or the team cannot assess plausible harms because reporting coverage is inadequate.
What this evidence can support
A group difference is descriptive. A causal explanation requires a separate design that addresses access, composition and reporting differences.
Trace the decision
From more cargo to wider food access
A corridor can increase shipments without improving access in underserved areas. Test whether usable deliveries also reach groups that were below the service floor.
- Record goods released for transport
- Confirm usable arrivals by receiving area
- Compare what each eligible group actually receives
Keep aggregate tonnage, destination receipts and local access in separate columns; mark where consumer outcomes are unavailable.
When this overlaps another topic
Average reach can hide a missed community
Track people eligible to receive and understand the warning, then report where accessibility or channel constraints changed that denominator or prevented action.
Check: Include a group with one unavailable channel and compare timely reach by group. Do not infer reach from successful dispatch alone.
Early warning and disaster preparedness
More food moved can coincide with wider gaps
Use destination-level receipts and group-level eligible need. One highly served district can dominate the average while a smaller district falls below its floor.
Check: Compare the same totals under two allocation rules and record which group loses coverage. Report overlaps and suppressed counts where applicable.
Food availability and delivery
Missing cases can change who appears to benefit
If unresolved outcomes are concentrated in an underserved group, a complete-case comparison can flatter overall service and obscure local harm.
Check: Calculate eligible-case bounds for each arm and report them by group where permitted. Design a follow-up that addresses the missing reporting, then reassess the group floor.
Sources and scope
These references support particular methods or historical context. The research design above is a proposal.
- HM Treasury Magenta Book: Analytical methods · Methods guidance
Explains comparison designs, attribution, evidence synthesis and value for money methods.
- NIST Privacy Framework: Using the framework · Risk guidance
Offers a framework for identifying and managing privacy risk across organizations.
Original hypotheses to examine
These source records remain untested.