Education & Opportunity 1 week Formal Seminar Natural Experiment

Should Colleges Use Test Scores as Admissions Criteria?

Students are living inside this question rather than studying it, which makes it the most emotionally loaded week in the Education cluster and the one most likely to produce genuinely careful thinking. SAT scores track family income and parental education closely — an apparently decisive case against the test, until the next slide shows that high school GPA does the same thing. And COVID ran the experiment for us: when most colleges went test-optional, applications to selective schools rose while score reporting collapsed, especially among the students the change was meant to help.

Open the student page for this topic

Slide Deck

Open teacher deck

RISC teacher deck · ASU Prep seminar Drive

Digital Notebook

Make your own copy

Opens a copy in your own Google Drive

Discussion Prompts

NYT Learning Network

Extra questions the deck recommends

01 / Plan

One-Week Instructional Plan

The Year 1 rhythm. The deck's teaching note deserves reading before Monday: this discussion can stray into emotionally charged territory and some students may feel spotlighted. Students in the room have test scores, and they know what they are. Plan the week so nobody's own results become the evidence.

Monday
Data Analysis

How Admissions Got Here

Free write (5 min): should colleges require test scores? Ask for the reasoning, not just the answer — this is a topic where students have strong instincts and thin arguments.

The context first. College attendance has grown dramatically — steeply for men from the 1920s and for women from the 1940s — though enrolment dipped slightly in the past decade, and more women than men now attend, reversing the historical pattern. Elite admissions rates have fallen steadily as class sizes stayed flat. Worth noting though: while most institutions have grown more selective since 2002, about a third are actually admitting more students. Selectivity is not a universal trend.

Then the history of admissions criteria, which shows how recent and how contingent the current system is:

  • 17th–18th centuries — applicants screened on character, family background, and knowledge of Latin and Greek.
  • 19th century — requirements proliferate and vary wildly by school.
  • 1926 — the first SAT, created to standardise requirements amid a broader movement for mass intelligence testing. That origin is worth naming.
  • Mid-20th century — national standardisation around coursework, class rank, recommendations, and interviews.
  • Late 1950s — colleges lean hard into tests, treating them as at least as good a predictor as a student's educational background.
  • 1960s onward — personal characteristics enter the process; in 1978 the Supreme Court upholds race as a factor; in the early 2000s elite schools adopt "holistic" review.

Where things stood before COVID: the Common App is used by over 900 colleges; in 2019, 55% of them required test scores and 76% of applicants reported them.

Assign the readings, a deliberately balanced set, due before Tuesday:

Tuesday
Data Analysis · Part Two

The Gaps — and the Slide That Complicates Them

Mindful moment (5 min), then the heart of the topic, in this exact order. The sequence matters more here than in any other Education topic.

  • SAT scores by family income and parental education. Students from higher-earning, more-educated families score higher on average. There are also gaps by race and ethnicity.
  • A statistical detail worth catching: the top distributions show "fat tails" and appear cut off at 1600. That means those groups are skewed further toward high scores than a normal distribution would produce — practically, some of those students would score above 1600 if the scale allowed it.
  • Then high school GPA, across the same demographics. The same patterns appear. Higher-income and more-educated families, higher GPAs; the same racial and ethnic gaps. And GPAs have drifted upward over time — grade inflation, visible across all groups.
The move that makes the week work: ask whether the SAT gaps prove the test is biased — collect the answers — and only then show the GPA slide. If the alternative measure shows the same gaps, "the test is biased" is no longer sufficient on its own. The honest possibilities are that both measures are biased, that both are picking up real differences in preparation produced by unequal circumstances, or some mixture. That is a much harder and much better conversation.
Wednesday
Formal Seminar

The Natural Experiment COVID Ran

Mindful moment (5 min), then the material that makes this deck unusual: an actual large-scale test of the counterfactual.

  • Before the pandemic, 46% of US undergraduate institutions did not require test scores. For the 2021–22 cycle that rose to just under 80%, with roughly 60% confirming the policy would continue.
  • Score reporting collapsed — the share of Common App applicants reporting scores fell by more than 40% between 2019–20 and 2020–21. Two explanations, both plausible: students couldn't sit the exam, and students chose not to report scores they thought were too low.
  • The decline was steepest among under-represented minority and first-generation applicants — precisely the groups test-optional policies were meant to help. Again, two readings: less time and fewer resources to prepare and test, or lower scores and a decision not to report them.
  • Applications rose across the board, and most at the most selective institutions. Without a score to screen themselves out, more students took a shot.

The discussion: what should we conclude from the test-optional experiment? One reading is that it was a genuine opening for students with fewer resources. Another is that selective colleges are now admitting students without the information that predicts whether they'll cope with the coursework. Both are defensible from the same data.

Before students leave: themes, lingering questions, and one new resource for Thursday.

Thursday
Formal Seminar (cont'd)

Design the Admissions Process

Mindful moment (5 min), resources shared, then the deck's own framing — and note that it explicitly tells students their answer need not be a hard yes or no:

  • Should colleges use test scores? Does your answer depend on which college — MIT against a small liberal arts college? (MIT reinstated its requirement, and the assigned reading explains why.)
  • What are the short- and long-term effects of using or dropping tests — on students, colleges, employers, and society?
  • Design an ideal admissions process. How would you weigh applicants from very different backgrounds? Which factors are genuinely fair?
  • The deck's sharpest question: to what extent are people's opinions about standardised testing shaped by how well they personally did on it? Does that matter?
  • And underneath all of it: what is college admission for? Should institutions admit the most academically prepared, those with the greatest potential to benefit, or those with the greatest need for upward mobility? Those three answers point in different directions.
Friday
Reflection & Self-Evaluation

Score Your Participation

The four reflective questions, then the participation matrix. Students also use the participation rubric to score the week and explain the score.

02 / Facilitation

Notes for the Guide

Every student in the room is a participant in this system, not an observer of it. Some have scores they're proud of and some don't, and the deck warns directly that students may feel spotlighted. Set the norm on Monday: we're discussing the policy, and nobody is asked to disclose a score.

Order the Tuesday Slides Correctly

  • SAT gaps first, student conclusions second, GPA gaps third. Reversing that order loses the entire pedagogical effect.
  • The point is not that the test is fine. It is that the same demographic patterns show up in every measure of academic achievement, which means the gaps are telling us something about unequal circumstances upstream rather than about one instrument.
  • The grade inflation visible in the GPA data connects directly to the grade inflation topic, if you run them near each other.
  • The "fat tails cut off at 1600" observation is a genuine piece of statistical reasoning and rewards a strong class. If your group can't get there, skip it rather than labouring it.

The COVID Data Cuts Both Ways

  • Score reporting fell by over 40%, and further still among under-represented and first-generation applicants — the reverse of what advocates predicted, and it needs explaining rather than skipping.
  • Applications to highly selective institutions rose. More students tried. Whether more were admitted, and how they fared, is the question the data here doesn't answer — say so.
  • MIT reinstating its requirement is the strongest counterweight in the reading set, and it comes from an institution with an obvious interest in getting this right rather than in winning an argument.

Where Discussion Tends to Go

  • The self-interest question is worth asking out loud. Students who test well tend to defend testing; students who don't tend to attack it. The deck asks whether that matters — and the honest answer is that an argument isn't wrong because it happens to benefit you, but it does warrant extra scrutiny.
  • "Just use GPA instead" is the most common alternative, and Tuesday has already complicated it. Push for a third option — portfolios, interviews, essays — and then ask which of those favours students with resources.
  • The purpose question is the real one. Admitting the best-prepared, admitting those who'd benefit most, and admitting those who most need mobility are three different missions. Most disagreements in the room dissolve into this one.
  • Keep it about policy, not people. If a student volunteers their own experience, that's fine; nobody should be asked.

Adapting This Topic