MISSISSIPPI MUDDLE: What explains Mississippi's score gains?

THURSDAY, DECEMBER 19, 2019

Scribe's answer should break all our hearts:
In the immortal words of the New York Times, the "perpetual laggards" in Mississippi have recorded large score gains in recent years in Grade 4 reading and math.

The gains in question have been recorded on the National Assessment of Educational Progress (the Naep), the widely-praised "gold standard" of domestic educational testing.

On December 6, this information was reported—where else?—in a New York Times opinion column. In print editions, the column appeared beneath a snide headline which bore the immortal words we have quoted above. See yesterday's report.

Indelicate language to the side, how big have those score gains been? The column was written by Emily Hanford, an education reporter for American Public Media. She only discussed the gains in reading, although, as we noted yesterday, Mississippi's gains in math in recent years have been just as large:
HANFORD (12/6/19): New results on the National Assessment of Educational Progress, a standardized test given every two years to measure fourth- and eighth-grade achievement in reading and math, show that Mississippi made more progress [from 2017 to 2019] than any other state.

The state’s performance in reading was especially notable...Fourth graders in Mississippi are now on par with the national average, reading as well or better than pupils in California, Texas, Michigan and 18 other states.

[...]

For years, everyone assumed Mississippi was at the bottom in reading because it was the poorest state in the nation. Mississippi is still the poorest state, but fourth graders there now read at the national average. While every other state’s fourth graders made no significant progress in reading on this year’s test, or lost ground, Mississippi’s fourth-grade reading scores are up by 10 points since 2013...
In fact, Mississippi's Grade 4 reading score is up by 10.8 points over that six-year span, and that rounds off to eleven.

Judged by a conventional though very rough rule of thumb, this suggests that Mississippi's fourth graders are now performing one full academic year ahead of their fourth-grade counterparts from the year 2013.

If true, that's remarkable progress. And as we noted yesterday, Mississippi's performance is even more impressive if you disaggregate scores on the basis of income and race:

Black fourth-graders in Mississippi didn't just match the national average as compared to their peers nationwide. They outperformed their peers nationwide by almost six points on the 2019 Naep reading test.

Among Mississippi's low-income kids, the achievement is even more striking. The state's low-income black fourth-graders outscored their peers nationwide by more than nine points—roughly speaking, by almost a full academic year. Meanwhile, the state's low-income white kids outscored their counterparts nationwide by 8.6 points.

On their face, those scores are quite impressive. They lead us to an obvious question:

In a state populated by so many laggards, what explains the large score gains, and the impressive overall performance?

Why are kids in Mississippi outscoring their peers nationwide? In her recent New York Times column, Hanford sought to answer that question, though only with respect to the gain in the state's reading scores.

As noted, Mississippi's gains in Grade 4 math have been equally large. We'll restrict ourselves to reading today, in line with Hanford's focus.

Why have Mississippi fourth graders showed large score gains in reading? Why are the state's racial/economic groups substantially outperforming their counterparts nationwide?

Hanford offers a somewhat high-fallutin' explanation. It's previewed in the pair of headlines which adorn her column online:
There Is a Right Way to Teach Reading, and Mississippi Knows It
The state’s reliance on cognitive science explains why.
Mississippi's public schools have been relying on cognitive science? What type of "cognitive science" can Hanford possibly have in mind? And can that be the explanation for the score gains in question?

What explains Mississippi's performance? To the extent that Hanford's explanation may be true, it should break all our hearts.

Below, you see the start of her explanation. We'll simplify later on:
HANFORD: What’s up in Mississippi? There’s no way to know for sure what causes increases in test scores, but Mississippi has been doing something notable: making sure all of its teachers understand the science of reading.

Yes, there is a science to how people read. For the past several decades, in labs and classrooms all over the world, scientists have been studying how skilled reading works, what children need to learn to become skilled readers, and what’s going on when students struggle. Reading is probably the most studied aspect of human learning.

But a lot of teachers don’t know this science. In 2013, legislators in Mississippi provided funding to start training the state’s teachers in the science of reading.
In 2013, Mississippi began "training [its] teachers in the science of reading," Hanford says at the end of that passage. From there, she proceeds to a somewhat wordy explanation of what that "cognitive science" tells us—though we'll note that, just as she never used the word "laggards," she also never employed the somewhat pompous term, "cognitive science."

Leave that to the side! Hanford does refer to "the science of reading," and she does strongly suggest that Mississippi's recent reliance on this science explains the rise in its reading scores—a rise she actually understates in the several ways we've discussed.

For our money, Hanford's account of "the science of reading" is hugely underwhelming. You can read her lengthy account for yourself, but this column from October 2018 makes her basic meaning fairly clear:

Hanford seems to be saying that Mississippi began teaching phonics in its schools, "and that has made all the difference," at least to the extent that such things can be explained. We'll explore that earlier column tomorrow, but that's pretty much where it leads.

Mississippi began teaching phonics? On that basis, Mississippi's low-income kid are now strongly outperforming their low-income counterparts nationwide?

Once again, we'll note the fact that the state's math scores have risen just as much as its reading scores have. But to what extent could Hanford's explanation possibly be accurate? Mississippi began teaching phonics, and that explains its surprising reading scores?

If true, that explanation should break all our hearts. We complete our rumination tomorrow.

Tomorrow: "It’s not just ignorance. There’s active resistance to the science, too."

Fun with numbers: Kevin Drum has been doing a bit of debunking of late. We can't tell you why.

With regard to those Mississippi scores, he offers this analysis quoted below. He does so as part of a wider critique with which we would generally agree:
DRUM (12/18/19): Mississippi’s 4th grade reading scores have been going up steadily since 1992. They increased eight points between 2002 and 2009 and then ten points between 2013 and 2019.
Fun with cherry-picking? The 2009 score which Drum uses as a benchmark was a bit of an outlier. It was the highest score the state had ever recorded in fourth grade reading, and the highest score the state would record until 2015.

For that reason, while Drum's statement is perfectly accurate, this presentation would be perfectly accurate too:
Mississippi’s 4th grade reading scores have been going up steadily since 1992, but only slowly until recent years. They increased just 5.7 points between 2002 and 2013, but then increased by 10.8 points between 2013 and 2019.
Putting it yet another way, Mississippi gained just 9 points from 1992 to 2013, a period of 21 years. The state then gained almost 11 points over the next six years. For what it's worth, that 11-point gain was accomplished as the national average was dropping by one point.

We agree with Drum when he finds Hanford's overall presentation underwhelming. That said, Mississippi's surprising scores do seem to call for an explanation, especially after adjustment for income and race.

Concerning our response to Drum on the Grade 12 Naep, that is yet to come. For today, Chris Cuomo's weird meltdown concerning an alleged increase in crime has earned our afternoon space.

Gloom about schools never sleeps. So too with strange rants about crime.

15 comments:

  1. "In a state populated by so many laggards, what explains the large score gains, and the impressive overall performance?"

    Why, very few liberal zombies in the government, of course.

    ReplyDelete
  2. "she also never employed the somewhat pompous term, "cognitive science."

    There is nothing pompous about that term. It refers to a discipline of knowledge that studies how people think. It is a science because researchers in that discipline use the scientific method to perform experiments to test their ideas. It encompasses not only how people think but also artificial intelligence -- how machines think.

    Somerby may be unaware of the discipline and think this is a jumped up term for psychology. It arose in the 1950s after the creation of computer science, another term that Somerby should consider "pompous" because those who develop ideas about computers do not conduct experiments or use the scientific methods to test ideas and their work is more akin to engineering.

    But the sciences that concern humanity do not get as much respect as those that concern the physical world, apparently. Given the way that Somerby mocks anthropology, he seems to have no respect for human beings at all, much less children and their learning.

    ReplyDelete
  3. Here is a rundown on public education as a racial issue, provided by the SPLC:

    https://www.splcenter.org/20170523/mississippi%E2%80%99s-broken-education-promise-%E2%80%93-timeline

    They describe a lawsuit filed in 2017 over racial disparities in education that went to the MS Supreme Court.

    Here is another article about licensing problems that caused 200 teachers to lose their jobs just last June:

    https://www.nbcnews.com/news/us-news/mississippi-loses-hundreds-teachers-due-licensing-issue-underscoring-national-problem-n1020676

    It appears that the test score improvements may be due to changes in attitudes toward race, improvement in funding, and tightening of licensing standards, coupled with teacher training, not solely phonics (which can have little impact on those math scores).

    As the SPLC article points out, the underfunding and neglect of education affects largely black students, not the white ones, and there appears to be a revolt in MS that has spurred major changes in education, inspired by a renewed civil rights focus and refusal to tolerate continuing neglect. That may have produced the changes in scores as much as anything else.

    When schools are at rock bottom due to deliberate neglect, there is nowhere to go but up. It isn't that MS is leading the nation in its scores -- it is that they have come up to the national average after being deliberately suppressed for racial reasons that Somerby has no intention of mentioning, much less discussing. For him and Hanford, it is about phonics. Just as it is for David in Cal.

    ReplyDelete
  4. “Hanford seems to be saying that Mississippi began teaching phonics in its schools, "and that has made all the difference”

    This is NOT what Hanford says.

    She says “children should be taught how to decode words — in other words, phonics.”

    But, “reading comprehension is the product of two things. One is your ability to decode words:” (that would be “phonics” for those paying attention).

    The second necessary element is “language comprehension”:
    “reading comprehension is the product of decoding ability and language comprehension;”

    ReplyDelete
  5. “Hanford seems to be saying that Mississippi began teaching phonics in its schools, "and that has made all the difference,"

    In fact, Hanford is explicit:
    “focusing only on decoding (ie phonics) would be a mistake because that’s only half the equation.”

    ReplyDelete
    Replies
    1. It isn’t clear what Somerby thinks he gains by misrepresenting Hanford’s editorial. If he is skeptical of her theory, fine, but he should at least state it properly in order to make an honest, convincing case against it.

      Delete
  6. “The gains in question have been recorded on the National Assessment of Educational Progress (the Naep), the widely-praised "gold standard" of domestic educational testing.”

    Yesterday, he kept saying “if real”, etc, about the results.

    Perhaps he needs to explain why the Naep is a gold standard, including the near impossibility of any student or school cheating on it.

    ReplyDelete
  7. i want to testify about the great spell caster called Dr Azuka my husband and i have been married for 5 years now we don't have a child and the doctor told us i can't give birth because my womb have been damaged due to wrong drugs prescription this got me so worried and my husband was not happy so he decided to get married to another girl and divorce me i was so sad i told my friend about it she told me about a powerful spell caster she gave me his email address well i never believe in it that much though i just decided to give him a try and he told me it will take 24hrs to get my husband back to me and i will get pregnant i doubted him the 3rd day my husband came back to me and was crying he said he didn't want the divorce anymore 3 weeks after the doctor confirmed that i was pregnant he can also help you contact him via email: Dr.azukasolutionhome@gmail.com What’s app or call: +44 7520 636249‬



    ReplyDelete
  8. My Name is Dr sebi you can Contact Me via Email drsebicurecenter@gmail.com For Penis Enlargement Product to help you get as long as 8inches Long with good Erection. Contact Me Via Email : drsebicurecenter@gmail.com Via WhatsApp +2347010538590

    ReplyDelete
  9. I want the world to know a great man that is well known as DR Padman ,website: https://padmanspell.com/index-3.htmlhe has the perfect solution to relationship issues and marriage problems. The main reason why i went to DR Padman. was for solution on how i can get my husband back because in recent times i have read some testimonies on the internet which some people has written about DR Padman, and i was so pleased and i decided to seek for assistance, which he did a perfect job by casting a love spell on my husband which made him to come back to me and beg for forgiveness.I will no stop publishing his name on the net because of the good work he is doing. I will drop his contact for the usefulness of those that needs his help.His Email (padmanlovespell@yahoo.com) or his ebsite: https://padmanspell.com/index-3.html Whatsapp +19492293867 https://twitter.com/padman_dr. this great spell caster for your relationship or marriage problem, Once again i am very much grateful to Dr.PADMAN

    ReplyDelete
  10. I Want To Appreciate Dr.OYAGU for hs great deeds, I Was Diagnosed With type 2 Herpes Virus Last year,And Was Looking For Solution To Be Cured Luckily I Saw Testimonies On How Dr.OYAGU Cure Herpes Virus I Decided To Contact Dr.OYAGU I Contacted Him He Prepared A Herbal Medicine Portion And Sent It To Me,I Started The Herbal Medicine For My Health.He Gave Me Step By Step Instructions On How To Apply It, When I Applied It As Instructed, I Was Cured Of This Deadly Herpes Within 2 weeks, I Am Now Herpes Negative.My Brother And Sister I No That There Are So Many People That Have There Same Herpes Virus Please contact Dr OYAGU To Help You Too,And Help Me To Thank Dr.OYAGU For Cure Me, I’m Cured By Dr. OYAGU Herbal Medicine,His Contact Email:oyaguherbalhome@gmail.com

    Or Cell Whatsapp Number +2348101755322 thank you

    ReplyDelete
  11. Investing online has been a main source of income,that's why knowledge plays a very important role in humanity,you don't need to over work yourself for money.All you need is the right information,and you could build your own wealth from the comfort of your home!Binary trading is dependent on timely signals,assets or controlled strategies which when mastered increases chance of winning up to 90%-100% with trading. It’s possible to earn $10,000 to $20,000 trading weekly-monthly,just file a complaint with  Robert,I had almost given up on everything about binary trading and ever getting my lost funds back,till i met with him,with his help now i have my lost funds back to my bank account and I can now trade successfully with his profitable strategies and software!! Email: Robertseaman939@gmail.com or Fb.me/investandmakemoney1 or  whatsApp: +44 7466 770724

    ReplyDelete
  12. I have been suffering from (HERPES) disease for the last four years and had constant pain, especially in my knees. During the first year, I had faith in God that I would be healed someday.This disease started to circulate all over my body and I have been taking treatment from my doctor, a few weeks ago I came on search on the internet if I could get any information concerning the prevention of this disease, on my search I saw a testimony of someone who has been healed from (Hepatitis B and Cancer) by this Man Dr. agaba and she also gave the email address of this man and advise we should contact him for any sickness that he would be of help, so I wrote to Dr. agaba telling him about my (HERPES Virus) he told me not to worry that I was going to be cured!! hmm i never believed it,, well after all the procedures and remedy given to me by this man few weeks later I started experiencing changes all over me as the Dr. assured me that I have cured, after some time i went to my doctor to confirmed if I have been finally healed behold it was TRUE, So friends my advice is if you have such sickness or any other at all you can email Dr. agaba (dragabasolutionhome@gmail.com) sir I am indeed grateful for the help I will forever recommend you to my friends!!! with your lovely Email Address (dragabasolutionhome@gmail.com or whatsApp him +2349074536486

    ReplyDelete
  13. LOTTO, lottery,jackpot.
    Hello all my viewers, I am very happy for sharing this great testimonies,The best thing that has ever happened in my life is how I win the lottery euro million mega jackpot. I am a Woman who believe that one day I will win the lottery. finally my dreams came through when I email believelovespelltemple@gmail.com and tell him I need the lottery numbers. I have spend so much money on ticket just to make sure I win. But I never know that winning was so easy until the day I meant the spell caster online which so many people has talked about that he is very great in casting lottery spell, . so I decide to give it a try.I contacted this great Dr Believe and he did a spell and he gave me the winning lottery numbers. But believe me when the draws were out I was among winners. I win 30,000 million Dollar. Dr Believe truly you are the best, all thanks to you forever

    ReplyDelete