In last week’s presidential debate, Mitt Romney took credit for Massachusetts’s position atop some education rankings. And, yes, it’s generally true that Massachusetts ranks at or near the top. More specifically, the state has frequently had the highest average score on the National Assessment of Educational Progress (NAEP).
But the more important question is why Massachusetts ranks so highly. Was it something that Romney did while governor, or are there other factors at play? It’s almost certainly something other than Romney’s actions, for two reasons.
First, children in Massachusetts earned really high test scores both before and after Romney was governor:
|
2002 |
2011 |
| (1) |
Vermont (272) |
Massachusetts (275) |
| (2) |
Massachusetts (271) |
New Jersey (275) |
| (3) |
Montana (270) |
Connecticut (275) |
| (4) |
Nebraska (270) |
Vermont (274) |
| (5) |
Maine (270) |
Montana (273) |
And, second, we know from decades of research that non-school factors influence achievement far more than in-school factors. So it’s exceedingly unlikely that a few state-level policy tweaks, implemented for a mere four years, could impact student performance dramatically enough to boost Massachusetts to the top of the nation.
We can also argue to what extent the high test scores mean the state’s schools are a success. We could certainly measure student and school performance in myriad other ways. And even if we look only at test scores, we can go beyond the averages. Massachusetts has one of the largest gaps in achievement between upper- and lower-income students, for example. Though, again, that likely has little to do with Romney—the state ranked fifth in 2002 and sixth in 2011 (measured as the average eighth grade reading score of those not eligible for free/reduced price lunch minus the average score of eligible students).
That said, I wanted to explore this a little more in-depth, so I went to the NAEP website and delved into the eighth grade reading scores. The first thing you’ll notice on the site is the map of state results (see the map here) which shows striking regional disparities in test scores. If we assume that governors are almost solely responsible for the average test scores in their states, we could only conclude that virtually all Northern governors are education geniuses and almost all Southern governors education dunces. Which, of course, is preposterous—there are clearly larger issues at play here (issues out of the hands of the various governors).
What are these issues? The socioeconomic status of the states’ residents would be at the top of the list (certainly, a governor would have some power to influence that over the course of one or more terms—but that change would be both slight and slow). To examine this, I downloaded the state NAEP scores from the NAEP data webpage and demographic data from census website so that I could compare the two.
Unsurprisingly, a fairly strong correlation exists between a state’s average eighth grade reading score and a state’s median household income (r = .43). When we plot all the states’ average test scores and median household incomes on the graph below, we see a few outliers—Montana, Kentucky, and Vermont score much higher than we’d expect, given their average incomes, while California, Hawaii, Nevada, and Alaska score much lower—but Massachusetts is right about where we’d expect it to be (note that the best fit line would run right through Massachusetts if we deleted the outliers). Massachusetts has relatively wealthy residents and high-scoring students. Not a surprise.
Why Romney Shouldn’t Take Credit for Massachusetts’s High Education Rankings
In last week’s presidential debate, Mitt Romney took credit for Massachusetts’s position atop some education rankings. And, yes, it’s generally true that Massachusetts ranks at or near the top. More specifically, the state has frequently had the highest average score on the National Assessment of Educational Progress (NAEP).
But the more important question is why Massachusetts ranks so highly. Was it something that Romney did while governor, or are there other factors at play? It’s almost certainly something other than Romney’s actions, for two reasons.
First, children in Massachusetts earned really high test scores both before and after Romney was governor:
And, second, we know from decades of research that non-school factors influence achievement far more than in-school factors. So it’s exceedingly unlikely that a few state-level policy tweaks, implemented for a mere four years, could impact student performance dramatically enough to boost Massachusetts to the top of the nation.
We can also argue to what extent the high test scores mean the state’s schools are a success. We could certainly measure student and school performance in myriad other ways. And even if we look only at test scores, we can go beyond the averages. Massachusetts has one of the largest gaps in achievement between upper- and lower-income students, for example. Though, again, that likely has little to do with Romney—the state ranked fifth in 2002 and sixth in 2011 (measured as the average eighth grade reading score of those not eligible for free/reduced price lunch minus the average score of eligible students).
That said, I wanted to explore this a little more in-depth, so I went to the NAEP website and delved into the eighth grade reading scores. The first thing you’ll notice on the site is the map of state results (see the map here) which shows striking regional disparities in test scores. If we assume that governors are almost solely responsible for the average test scores in their states, we could only conclude that virtually all Northern governors are education geniuses and almost all Southern governors education dunces. Which, of course, is preposterous—there are clearly larger issues at play here (issues out of the hands of the various governors).
What are these issues? The socioeconomic status of the states’ residents would be at the top of the list (certainly, a governor would have some power to influence that over the course of one or more terms—but that change would be both slight and slow). To examine this, I downloaded the state NAEP scores from the NAEP data webpage and demographic data from census website so that I could compare the two.
Unsurprisingly, a fairly strong correlation exists between a state’s average eighth grade reading score and a state’s median household income (r = .43). When we plot all the states’ average test scores and median household incomes on the graph below, we see a few outliers—Montana, Kentucky, and Vermont score much higher than we’d expect, given their average incomes, while California, Hawaii, Nevada, and Alaska score much lower—but Massachusetts is right about where we’d expect it to be (note that the best fit line would run right through Massachusetts if we deleted the outliers). Massachusetts has relatively wealthy residents and high-scoring students. Not a surprise.