WHERE THE ACHIEVEMENT GAPS ARE: On to the PISA!

TUESDAY, OCTOBER 4, 2016

On to the PISA next week:
Are U.S. public schools an embarrassing mess as compared to schools in the rest of the world?

How about as compared to schools in the rest of the developed world? Are American schools an embarrassing mess as compared to them?

That impression is constantly given within the American discourse. It's done through comparisons to the miracle schools of miraculous Finland, a small, middle-class, unicultural nation whose kids tend to outscore their American peers on international tests.

It's also done through comparisons to the world's other nations in general. That said, it's hard to conclude that American schools are an embarrassing mess by looking at scores from the TIMSS and the PIRLS, which constitute one of the two international testing programs from which all our data flow.

On the TIMSS (math and science) and the PIRLS (reading), American students tend to score rather well, except when compared to a handful of Asian nations and city-states which tend to outscore everyone else in the world. If we look at results from the TIMSS and the PIRLS, American students and American schools don't seem to be a horrid, embarrassing mess.

Perhaps for that reason, we rarely hear about results from the TIMSS and the PIRLS. When American "opinion leaders" talk about the public schools, they tend to discuss the wonders of Finland—and they tend to discuss test scores from the PISA.

(Note: By all accounts, Finland is an admirable nation which functions extremely well. We would only criticize the misleading way its education ministry tends to promote itself.)

The PISA (the Program for International Student Assessment) is the other major international testing program. On the one hand, we have the TIMSS and the PIRLS. On the other hand, we have the PISA, which conducts tests in reading, math and science.

Compared to kids from other nations, American students haven't ranked as well on the PISA as they have on the TIMSS/PIRLS. Perhaps for that reason, advocates of certain types of education reform tend to discuss results from the PISA while completely ignoring results from the TIMSS and the PIRLS.

We'd planned to discuss "achievement gaps" on the PISA today, but we've decided it can't be done in a single report. We want to show the size of the gaps between the U.S. and other nations. But we also want to "disaggregate" those gaps. That is, we want to show what the gaps look like on the PISA (and on the TIMSS) when you report the divergent average scores of American students from our major population groups.

In Part 3 of our current report, we recorded the large achievement gaps of that type which obtain on our major domestic testing program, the NAEP. Despite large score gains by all major groups, large achievement gaps persist on the NAEP.

In our view, you can't fully understand American scores on international tests unless you see what scores look like for those different major groups. In our view, the data are painful, but instructive. That "disaggregation" makes our nation's educational challenges that much more stark and more clear.

It doesn't make sense to try to do all that in one post. Instead, we'll reshape our ongoing series, which was originally planned to last four weeks in all.

Next Monday, we'll start a new four-part series, Where the PISA Gaps Are. we'll look at the gaps between the world's nations, and between different groups of American kids.

We could try to cram it all in today. We could do it, but it would be wrong.

For today, you might want to look at Kevin Drum's capsule summary of these matters. In this new post, Drum offers an overview of some of the data we've been discussing.

That said, we do have a question about this highlighted point:
DRUM (10/3/16): [A]s Somerby points out, one of the striking things about these tests is that a small clutch of Asian countries do far better than us. In fact, they do far better than everyone, something they accomplish through a combination of cherry picking the students who take the test and a monomaniac culture of test prep. So let's take that as given, and just look at the rankings outside of the Asian tigers...
We'll have occasion to discuss that "monomaniac culture of test prep" again next week. That said, we don't think we've ever seen anyone claim that the high-scoring Asian nations "cherry-pick the students who take" the TIMSS and the PISA.

Drum may be referring to the limited case of Shanghai, which took the PISA as an independent entity in 2009, producing extremely high scores which set off paroxysms in the American press. It was almost like Shanghai's kids had put a new Sputnik in orbit.

As it turned out, Shanghai's student population, and its public schools, are highly unrepresentative of the Chinese system in general. It was a bit like testing kids from Groton and Choate and acting like you'd tested a representative sample of American students.

Once the gorilla dust had settled, the PISA was criticized for letting China participate in the program in such a misleading way. That may be the situation to which Drum referred. Aside from that, we're not aware of claims that South Korea, Japan or Taiwan arrange for an unrepresentative sample of students to be tested. Perhaps some such allegation exists, but we don't think we've ever heard about it.

Asian tigers to the side, American students score pretty well on the TIMSS and the PIRLS. They seem to stack up less well on the PISA.

Next week, we'll do a four-part report about American scores on the PISA. Along the way, we'll break American scores down by groups, and we'll look at how certain states performed on the PISA as independent entities.

In our view, these practices give us a clearer picture of the educational challenges we face. Aside from standard assertions of script and cant, these topics are very rarely discussed. We want to end up with a detailed report which makes lots of basic information available all in one place.

We're sorry for the delay. But we've come to believe that the PISA's gaps deserve a week of their own.

3 comments:

  1. Even if they score less well on the PISA, they do not score 25th in the world, as Trump claimed. These scare statistics are frequently used to justify attacks on public education in the guise of reform.

    Trump's education plan would cut 490,000 teaching jobs by eliminating the Department of Education, according to the Center for American Progress:

    http://thehill.com/regulation/294318-report-trumps-education-plan-would-cut-490k-teacher-jobs

    ReplyDelete
  2. https://www.youtube.com/watch?v=kjq4wYuwgxs

    ReplyDelete
  3. AM A LIVING WITNESS AND A BENEFICIARY OF DR OGUDU LOVE SPELL, PREGNACY SPELL AND MARRIAGE REUNITING, CONTACT HIM NOW FOR YOUR MARRIAGE AND RELATIONSHIP PROBLEMS SOLUTION WITHIN 48 HOURS OF CONTACTING HIM

    My name is CINDY SCOTT am from BELARUS, am a woman who loves and cherish my husband more than any other thing you can imagine on earth surface. My husband was so lovely and caring after 9 years of marriage he was seriously ill and the doctor confirm and said he has a kidney infection that he needed a kidney donor, that was how I started searching for a good Samaritan who can help,doctor has given me a periodic hour that he will live just 2 days left, that was how I ask the doctor if I can be of help to my husband that was how he carried out the test,the confirming was successful, I was now having this taught that since 9years now we got married I have not be able to get pregnant can I be able to get pregnant again after the surgery? That was the question I ask the doctor, he never answer his response was do you want to lost your husband? I immediately reply no I can't afford to loose him. After the operation i and my husband came back home and live happily as husband and wife should. After 7months my husband came home with another lady telling me, that is our new wife that will give us kids and take care of us, that was how I was confused and started crying all day, That was not enough soonest my husband ran away with the new find love and never keep in contact with me. Since then I was confuse don't no what to do that was how I went back to the doctor and tell him everything, he told me that, this is not just an ordinary thing that he have heard of us situation so many times but he knows a man who is a voodoo spell caster who can help me out of my present situation that he has directed more 6 woman to him and they all came back with positive stories and testimonials about him that I should tell him all my problem that he can help me out that was how i contacted him and i did as instructed. After 3days and I have done what he ask me to do, my husband started searching for me that was how we settle he also told me not to worry that I will get pregnant, this month making it the fifth Month I contacted him am now 3months pregnant. These great spell cater is a great man, if you are in any kind of problem you can contact him here on his email OGUDUSPELLTEMPLE@YAHOO.COM...WHATSAPP NUMBER +2348106058254...WEBSITE...http://oguduspelltemple.wixsite.com/drogudu

    ReplyDelete