Comparing Statistical Claims

Overview

Lesson 4 of 6 in Interpret Statistical Information. Students compare groups and time periods using appropriate frequencies, proportions, percentages, centre and spread, then evaluate whether statistical claims are supported. They build on earlier work interpreting tables, graphs and summary statistics by considering variability, data quality, context and ethical responsibilities.

Learning intentions

Students will:

• make fair, evidence-based comparisons between groups or time periods
• choose comparable measures, including frequencies, proportions, percentages, centre and spread
• evaluate claims by linking evidence to context
• identify limitations, uncertainty and ethical issues in statistical information

Success criteria

• I can identify the groups or time periods being compared and use comparable measures.
• I can describe similarities and differences using numerical or graphical evidence.
• I can comment on overlap, spread, sample size and variability.
• I can identify limitations that affect how confidently a claim can be made.

Curriculum links

• Interpret statistically based reports by evaluating population, variables, sampling, survey methods, sample size and possible sampling or non-sampling errors.
• Use statistical methods to make an inference by discussing sample distributions, sampling variability, estimates and conclusions in context.
• Develop the NZC competencies of thinking; using language, symbols and texts; managing self; and participating and contributing.
• Foster ethical statistical practice: respect privacy, avoid stereotyping communities, acknowledge data ownership or sources, and represent uncertainty respectfully.

Lesson structure (60 minutes)

1. 0–7 min · Hook: “Is the claim fair?” Teacher displays two headlines: “Twice as many young people use the bus” and “Bus use is twice as common among young people”, alongside a small table with unequal group sizes, using the opening comparison and headline slides. Students make an initial agree, disagree or cannot tell judgement, then explain what additional information they need.

2. 7–17 min · Direct teaching: comparing fairly. Teacher models how raw counts can mislead when group sizes differ, converting counts to proportions or percentages and comparing centre and spread; teacher also introduces overlap and variability. Students annotate the comparison scaffold and worked examples and answer short questions about which measure is appropriate.

Emphasise that comparisons require the same definition, unit and time frame. Briefly review limitations: sample size, representativeness, response bias, question wording, missing data, measurement definitions, confounding variables, scale manipulation, and association versus causation.

3. 17–22 min · Model the matrix. Teacher works through one example about youth wellbeing or public transport, completing a claim–evidence–limitations matrix on the teacher modelling and matrix slides. Model precise language such as “The claim is partly supported because…” and distinguish “cannot tell” from “not supported”. Students suggest one piece of evidence and one limitation before the class agrees on a response.

4. 22–43 min · Group evaluation task. Teacher places students in groups of four and distributes the claim cards, paired datasets and evaluation matrix. Each group evaluates two claims using supplied tables or graphs. Possible contexts include youth wellbeing, public transport, environmental monitoring and participation in local activities. Students identify the population, groups or periods, compare appropriate measures, record at least two pieces of evidence, and decide whether each claim is supported, partly supported or not supported. They must also identify a limitation and discuss whether the data should be represented differently.

Circulate and ask: “Are the denominators comparable?”, “What does the spread show?”, “Could another variable explain this pattern?”, and “What can we responsibly conclude?” Encourage students to acknowledge the source or data owner and avoid generalising about communities.

5. 43–53 min · Share and challenge. Teacher selects groups to present one claim and invites another group to challenge the conclusion respectfully using evidence or a limitation, using the discussion prompts and evaluation language slides. Students compare decisions, discuss how sample size and representativeness affect confidence, and consider whether association has been incorrectly described as causation. Extension within the discussion: students propose a better data collection method or explain why a different summary measure would be more suitable.

6. 53–60 min · Individual formative check and close. Teacher presents a new claim and paired dataset on the final claim and exit prompt slide. Students independently write “agree”, “disagree” or “cannot tell”, giving two pieces of evidence and one limitation. Students complete a final self-check against the success criteria and hand in their response.

Resources

• the Comparing Statistical Claims slide deck
• the comparison scaffold, paired datasets, claim cards and evaluation matrix
• Whiteboard and markers
• Calculators or spreadsheet access
• Current assessment guidance
• Projector or interactive display

Assessment

• Listen during modelling and group work for correct use of denominators, percentages, centre, spread, overlap and variability.
• Check each group matrix for a clear claim decision, two relevant pieces of evidence and a limitation connected to the data or context.
• Collect the individual final response. Look for a justified agree, disagree or cannot tell decision rather than an unsupported opinion.

Differentiation

• Provide pre-calculated percentages, highlighted denominators and comparison sentence stems such as “Group A has a higher typical value than Group B because…” and “The claim is limited by…”.
• Use a teacher-led support group to rehearse identifying groups, selecting comparable measures and distinguishing raw counts from proportions.
• Offer claim cards with varied difficulty and allow students to annotate tables or graphs before writing.
• Extend confident students by asking them to propose a better sampling or data collection method, explain a more appropriate summary, or identify a possible confounding variable.
• For EAL learners and students requiring additional support, use plain-language definitions, visual examples, structured roles and opportunities to explain ideas orally before writing. Ensure discussion protects privacy, avoids stereotyping and communicates uncertainty respectfully.