Skip to content
KinPilot™Learn & Explore
Menu

Grades 9–12 · Computing

How can useful statistics reveal less about any one person?

A group's published total can reveal one person's response when someone already knows everyone else's answers. Subtracting the known responses exposes the remaining one, even if names were removed. Differential privacy addresses this disclosure problem by limiting how much one person's contribution can change the probabilities of a randomized release.

The comparison uses neighboring datasets, defined to differ in a specified individual contribution. A randomized mechanism must keep the probabilities of possible outputs sufficiently similar across those datasets, according to stated privacy parameters. It constrains the release process rather than declaring one particular published number harmless.

For a count in which each person contributes at most one, adding or removing one person can change the exact answer by at most one. A suitable mechanism adds random noise scaled to that sensitivity and to the desired privacy level. A released value can then be compatible with either neighboring dataset, making one person’s participation harder to distinguish from the output.

The datasets differ in one person, while their illustrative output distributions overlap after randomization. That overlap conveys uncertainty about the contribution, but the curves do not establish a numerical privacy guarantee.

K030 visual explanationCalibrated randomness limits distinguishability; dataset A; one person differs; overlapping output distributions; Illustrative curves; no numerical privacy guarantee.Calibrated randomness limits distinguishabilitydataset Aone person differsoverlapping output distributionsIllustrative curves; no numerical privacy guarantee.

In the diagramCalibrated randomness limits distinguishabilitydataset Aone person differsoverlapping output distributionsIllustrative curves; no numerical privacy guarantee.

Two datasets differing in one person lead to overlapping illustrative output distributions after calibrated randomization. The sketch explains reduced distinguishability, not a numerical privacy guarantee.

The protection is about bounded inference, not a promise that nobody can guess anything. Someone may already know facts from other sources, and the aggregate can still reveal real patterns about a population. More protective settings generally require more uncertainty for the same query. That uncertainty can be small compared with a large group count yet large relative to a tiny subgroup.

Repeated releases accumulate information, so their combined privacy cost needs accounting through a privacy budget. Contribution limits, the neighboring-dataset definition and correct software also matter. The overlapping curves illustrate reduced distinguishability without supplying a numerical guarantee: overlap alone cannot prove differential privacy, whose protection belongs to the specified release mechanism and its parameters.

About this explanation

Starting knowledge: Understand a dataset, an aggregate count, probability and that repeated releases can combine information.

Sources

  • National Institute of Standards and Technology — SP 800-226: Guidelines for Evaluating Differential Privacy Guarantees
  • National Institute of Standards and Technology — Counting Queries: Extracting Key Business Metrics from Datasets
← Grades 9–12 topics