Skip to content
KinPilot™Learn & Explore
Menu

Grades 9–12 · Everyday Life

Why can a spam flag be misleading?

A spam flag is evidence produced by a filter, not certainty that a message is spam. Its meaning depends both on the filter’s behavior and on how much spam was present to begin with. That starting proportion is the base rate, also called prevalence.

J04 visual explanationFictional population: 100 spam and 900 legitimate messages out of 1,000. Assumed detection rate is 90%; false-flag rate among legitimate messages is 10%. The branches show 90 flagged spam, 10 passed spam, 90 flagged legitimate and 810 passed legitimate messages. Combine both flagged branches to interpret a flag.A fictional spam filterSame assumed rates in both populations1,000 messages100 spam90% are flagged900 legitimate10% are flaggedFlagged90Passed10Flagged90Passed810Flags: 90 + 90; 50% are spam

In the diagramA fictional spam filterSame assumed rates in both populations1,000 messages100 spam90% are flagged900 legitimate10% are flaggedFlagged90Passed10810Flags: 90 + 90; 50% are spam

The first population produces 90 spam flags and 90 legitimate-message flags. Spam makes up half of the combined flagged pool, despite the 90% detection rate.

The fictional filter flags 90% of spam messages. This detection rate starts with all spam as its group. It also flags 10% of legitimate messages, a false-flag rate that starts with a different group: all legitimate messages. Neither percentage directly states the proportion of flagged messages that are spam.

In the first population of 1,000 messages, 100 are spam and 900 legitimate. The rates produce 90 flagged spam messages and 90 flagged legitimate messages. The flagged pool therefore contains 180 messages, half of them spam. Its denominator must include both flagged branches, not just the original spam group.

In a second population with 500 spam and 500 legitimate messages, the same assumed rates produce 450 spam flags and 50 legitimate flags. Now 450 of 500 flags, or 90%, are spam. The change comes from the starting population, not an improvement in the assumed rates. Detection and the composition of flags answer different conditional questions. These exact fictional counts explain the base-rate effect without measuring any real filter or guaranteeing that its rates stay fixed across populations.

About this explanation

Starting knowledge: Calculate percentages of groups and distinguish P(flag given spam) from P(spam given flag).

Sources

  • OpenStax — Probability Theory: Conditional Probability and Bayes’ Theorem
← Grades 9–12 topics