Lesson 2: Is the Difference Meaningful?

About 30 minutes — Discussion-based lesson

What You Will Learn

This lesson covers:

Small differences vs. large differences
Sample size matters: small groups show bigger random variation
Repeated measurements: does the difference hold up?
The question to ask: 'Could this difference be due to chance?'

Small differences vs. large differences

This section covers the key ideas about small differences vs. large differences. Discuss with your group or family and explore the concepts together.

Sample size matters: small groups show bigger random variation

This section covers the key ideas about sample size matters: small groups show bigger random variation. Discuss with your group or family and explore the concepts together.

Repeated measurements: does the difference hold up?

This section covers the key ideas about repeated measurements: does the difference hold up?. Discuss with your group or family and explore the concepts together.

The question to ask: 'Could this difference be due to chance?'

This section covers the key ideas about the question to ask: 'could this difference be due to chance?'. Discuss with your group or family and explore the concepts together.

Check Your Understanding

1. When is a difference between groups meaningful?

Answer: When it is large enough that it probably did not happen by chance. A 2-point difference between classes of 30 is less meaningful than a 15-point difference.

2. Why does sample size matter for comparisons?

Answer: Small groups show more random variation. Flipping a coin 5 times might give 4 heads, but flipping 100 times will be close to 50-50. Bigger samples give more reliable comparisons.

3. What does 'due to chance' mean?

Answer: Random variation can make groups look different even when there is no real difference. If you split a class randomly, the two groups might have slightly different averages just by luck.

4. How can you check if a difference is real?

Answer: Repeat the comparison, use larger samples, and check if the difference is consistent. A real difference should show up again and again, not just once.

Key Takeaways

Small differences vs. large differences
Sample size matters: small groups show bigger random variation
Repeated measurements: does the difference hold up?
The question to ask: 'Could this difference be due to chance?'

Ready for More?

Next Lesson

Continue to Lesson 3: Using Numbers to Compare

Start Lesson 3

Session Home

Review all lessons and materials.

Back to Session Home