WHERE THE ACHIEVEMENT GAPS ARE: American students against the world!

WEDNESDAY, SEPTEMBER 28, 2016

Part 1 in this series

Part 2—The international gaps: On major international tests, how well do American students perform, as compared to their peers from around the world?

How well do they do in reading and math? How well do they do as compared to their peers in the major developed nations?

If you read the American press, you're treated to a steady stream of gloomy accounts. In May 2011, you may have read the passage shown below in the Washington Post.

It appeared beneath a suitably gloomy headline: "Is the U.S. doing teacher reform all wrong?"

Originally, Dana Goldstein posted her gloomy piece at her own site under a fuller headline ("Is the U.S. Doing Teacher Reform All Wrong? Lessons from Finland and Shanghai"). At each location, readers were quickly handed this gloomy assessment:
GOLDSTEIN (5/31/11): [M]any American education reformers spent the past decade demanding that districts and states get tough with teachers and provide them with more prescriptive advice on how to improve their practice...

But what if the United States is doing teacher reform all wrong?

That’s the suggestion of a new report from the National Center on Education and the Economy, a think tank funded mostly by large corporations and their affiliated foundations. The report takes a close look at how the countries that are kicking our academic butts—Finland, China and Canada—recruit, prepare and evaluate teachers.
According to Goldstein, three countries—Finland, China and Canada—were "kicking our academic butts." It was the latest gloomy account in the Washington Post, an anti-Wobegon publication where our American kids are persistently below average.

Readers of our major news orgs are persistently handed such gloomy accounts. But that very same year, students in Canada and the U.S. participated in one of the world's two major international testing programs.

Students in the neighboring countries took part in the latest administration of the Trends in International Mathematics and Science Study (TIMSS), one of the two major testing programs in which the world's developed nations take part. Canada didn't participate on a national basis, but three of its provinces—including its two most populous provinces—participated as independent entities.

The United States, and miraculous Finland, did participate on a national basis. Nine states from the U.S. also participated as independent entities.

Did the brilliant Canadian kids "kick our academic butts?" How about the Finns? In truth, American butts did not get kicked. These were the average scores recorded in Grade 8 math:
Average scores, Grade 8 math, 2011 TIMSS
Massachusetts: 560.58
Minnesota: 544.73
North Carolina: 536.90
Quebec: 531.56
Indiana: 521.51
Colorado: 517.79
Connecticut: 517.62
Finland: 514.03
Florida: 513.30
Ontario: 511.63
United States: 509.48
Alberta: 505.14
California 492.62
Alabama 465.93
Did Finland "kick our academic butts?" Actually no, it didn't. On the TIMSS scale, a 4.5 point difference in average scores amounts to a minor blip.

Did Canada kick our butts? Ontario, Canada's largest province, barely outscored the United States; it did so by the tiniest sliver. The U.S. slightly outscored Alberta, Canada's fourth largest province.

Meanwhile, states like Massachusetts and Minnesota came close to kicking Finland's butts! The score differentials were rather large. Massachusetts came very close to kicking the butts of Quebec. (Five years later, you've never heard a word about these results.)

Final question: Was the country of China kicking our butts? Then as now, China had never taken part, on a national basis, in any international test. In lemming-like fashion, Goldstein was responding to the very strong scores recorded by kids in the city of Shanghai, which had participated as an independent entity in the 2009 Program for International Student Assessment (PISA), the world's other major international testing program.

Shanghai's scores went off the charts on the 2009 PISA. In response, American journalists staged their latest gloom-ridden nervous breakdowns. But it soon emerged that Shanghai's schools serve a highly selective student population. For that reason, Shanghai's scores provide no indication of what is actually happening "in China."

Actual experts eventually said that China's nationwide schooling falls far short of that provided in Shanghai. But not before our journalists had penned their latest mandated gloomy tales, in which our hapless kids are constantly getting their butts kicked by their peers from around the world.

Let's be clear. The 2011 TIMSS was just one international test. For the most part, such testing can only give large, imprecise indications of the academic achievements of students in the world's developed nations. But no one kicked our academic butts on that Grade 8 TIMSS math test—at least, no one in the three countries Goldstein hailed.

What general picture does emerge from international tests? Before we answer that general question, let's make sure we're clear about the two testing programs in question.

The TIMSS (the Trends in International Mathematics and Science Study) has been in operation since 1995. As such, it's the grand-daddy of them both. Systematic international testing is a fairly new critter.

The TIMSS tests students in Grade 4 and Grade 8 in both math and science. (An affiliated program, the PIRLS, tests fourth-graders in reading.) It operates on a four-year cycle. Results from the most recent testing, in 2015, haven't yet been released.

The PISA (the Program for International Student Assessment) was first administered in the year 2000. As such, it's the new kid on the international testing block.

The PISA tests 15-year-old students in reading, math and science. It operates on a three-year cycle. As with the TIMSS, so too with the PISA: Results from last year's testing haven't been released.

No nation is required to take part in these testing programs. That said, the United States has regularly participated in both. Other developed nations take part in one or the other or both.

Finland shot to international stardom as a result of its strong results on the inaugural 2000 PISA. In 2011, it took part in the TIMSS for the first time, with results which were less impressive.

What general picture emerges from the TIMSS and the PISA? Let's break our international tournament down into two heats:

Asian tigers versus the world: Without question, a set of Asian nations tend to outperform the world on the TIMSS and the PISA. We refer to three major nations—Japan, South Korea, Taiwan—and to a pair of smaller entities, Singapore and Hong Kong.

These Asian polities do tend to kick the academic butts of the rest of the world. At one point, Finland seemed to be in their class. All in all, that no longer seems to be true.

Students in those Asian states do "kick our academic butts" on these international tests. That said, they kick everyone's else's butts too.

It's worth noting the facts that a price may get paid for this kind of academic success. South Korea's education minister has begged the United States not to emulate his country's manic education culture, in which kids go to school all day, then spend all night in their evening academies. We'll have more on this next week.

United States versus everyone else: Students in those Asian states do "kick our academic butts" on international tests. That said, American kids actually don't get their butts kicked by the rest of the world's developed nations. That is especially true if the United States is compared to large, diverse developed nations, rather than to smaller middle-class boutique states.

At the start of the century, a journalistic tulip craze formed around miraculous Finland. Journalists flew off to enjoy their free week in the enjoyable middle-class nation, then returned to spout the nostrums they'd been successfully fed.

Finland is a small corner of Europe; especially on the PISA, it has tended to outscore its larger European neighbors. That said, Massachusetts is a larger corner of the U.S., and in the most recent test administrations, Massachusetts tended to outscore Finland on the TIMSS, match it on the PISA.

Our journalists have fed the nation a steady diet of propaganda about international tests. In next week's reports, "Where the Con Games Are," we'll consider the provenance of these ubiquitous story-lines.

The gloom and doom have been general over the past many years. Americans have been trained to think that our students' performance is embarrassing, as compared to the performance of their international peers.

We're supposed to think, in knee-jerk fashion, that something is horribly wrong with our schools. For ourselves, we often wonder what's wrong with other countries' schools when we examine the full range of scores on the TIMSS, the PIRLS and the PISA.

On the international scene, the achievement gaps can be large. But that's mainly true if we look at the gaps between those Asian nations and the rest of the world.

When we compare our kids to the rest of the world, the gaps just aren't that big. Often, there are no gaps at all. Often, the United States is on the winning side of the gaps, although you'll simply never hear that from our gloom-ridden, script-typing press corps.

Massachusetts kids kicked Finland's butts on that TIMSS math test! Minnesota kids pretty much kicked their butts too. We'll return to the international gaps in part 4 of this week's report. Tomorrow, though, we'll bring it on home in a sobering way:

We'll look at where the achievement gaps are on our domestic tests.

Tomorrow: Where the gaps are on the NAEP

18 comments:

  1. The article by Goldstein is a bit odd. It reports how Finland prepares teachers but then tries to say that the US does it differently, when it doesn't actually do anything that different.

    Finland requires teachers to study the subject they will teach as undergrads. Goldstein says the US uses the Teach for America model where undergrads are recruited without teaching credentials, with just degrees from elite colleges. They too, like Finland's teachers, are presumably studying the subjects they will teach, since they are not taking teacher education classes.

    The main difference seems to be that Finland requires additional master's level training. The US doesn't require that training but it increases pay for those who acquire it, those with master's degrees. Most US public schools require credentials, a year of post-graduate training in education, including supervised teaching and mentoring.

    I just don't see much of a difference between the two, as described. In the US, there are shortages of teachers that have resulted in emergency credentialing and recruitment of new teachers without education courses, like Teach for America, but that is economic necessity, not a policy-based preference for less educated teachers. Higher education is free in Finland whereas American students must pay, often large amounts, to acquire that additional coursework. We could change that and probably increase the depth of teacher preparation. That would be a step in the right direction, but it hardly constitutes anything relevant to teacher reform.

    I wonder how many people are aware that the judgment in California over teacher tenure was overturned on appeal and subsequent suits challenging the use of student test scores in teacher evaluation are winning, so that the use of test scores for job-related decisions is losing in the courts.

    My concern is that after the layoffs of teachers during the financial meltdown, as public systems applied austerity measures, districts will be unable to attract sufficient new teachers to properly staff their classrooms, especially if universal pre-K is enacted widely. Teaching has become a less attractive career due to job instability. We did that to ourselves by refusing to prioritize education. It will take a while to recover from that and I worry that our kids will suffer in the meantime. I would not be surprised if that showed up in these kinds of test scores.

    ReplyDelete
  2. Kudos to Bob for pointing out the falsity of the prevailing narrative of mediocre US education. In passing, he addresses the question of whether or not we should emulate South Korea's "manic education culture". One positive aspect of South Korean culture is that it has turned abject poverty into prosperity, as shown in this chart http://www.tradingeconomics.com/south-korea/gross-national-product

    ReplyDelete
    Replies
    1. Dave the Guitar PlayerSeptember 28, 2016 at 12:51 PM

      I am compelled to point out that positive gains in GNP is not the same thing as "prosperity", especially if the gains are diverted to a small percentage of the population, as has happened in the U.S. in recent decades. Prosperity is when the gains are shared.

      Delete
    2. Do you say we should emulate South Korean culture?

      Here's one negative aspect:

      http://anonhq.com/watch-academic-pressure-pushing-south-koreas-youth-commit-suicide-video/

      Delete
  3. PBS ran an interesting documentary last night on America's role as world umpire since the end of WWII. "Umpire" was the term used -- rather than Gore Vidal's preferred "Empire" -- so as to liken our postwar role to that of the federal government's constitutional function of mediating differences arising between and among the several states. I think.

    Narrated by a very old-sounding Jim Lehr (symbolically?), the doc pressed the notion that in picking up so much of NATO's military tab, the US has enabled its now-rich allies to devote that much more of their GDPs to things like -- ahem -- education.

    Be that as it may, in getting back to the top headlines of the day, it should be pointed out that, when compared to women of other developed countries, Alicia Machado really isn't all that fat.

    ReplyDelete
    Replies
    1. Nothing about Machado's physical appearance needs to be pointed out or compared today, since she is no longer Miss Universe.

      Many women find the whole idea of beauty contests degrading. That Trump bought one so he could harass the contestants will be sleazy, no matter what he said to Machado. Calling her Miss Piggy is icing on that cake. The 5 years she spent combatting an eating disorder is symbolic of the damage done to girls and women in cultures where unrealistic standards of beauty are imposed on women by men, and made the standard by which they are chosen for relationships, jobs, elections, and dignity and respect.

      Kudos for calling Lehrer old. That gives you a trolling twofer.

      Delete
  4. I wonder why Bob Somerby chose to disappear the test results used in the report about which Ms. Goldstein wrote five years ago.

    I wonder why, in his writing on education, Bob Somerby often presents his facts in a manner similar to Presidential candidate Trump.

    ReplyDelete
    Replies
    1. I wonder why journalists have such thin skin when someone turns the tables and critiques them?

      Delete
  5. I assume you are talking about the PISA results. Goldstein describes them and Somerby provides a link to her work. Goldstein does not provide TIMMS results, so Somerby provides them and discusses the more complete picture when both sets of results are considered.

    Do you seriously believe that Trump can read either sets of data and make sense of it? Without help? Trump is a prime example of the failure of our elite military schools.

    ReplyDelete
    Replies
    1. "Golstein does not provide TIMSS results, so Somerby provides them and discusses the more complete picture...."

      Goldstein did not provide any test results in the five year old article.

      Please explain how Somerby discusses "the more complete picture when both sets of results are considered" when he disappears the one set of results used in the report Goldstein wrote about and then uses another set of results never mentioned in the report.

      I never said I believed candidate Trump could even read. I said Somerby presents "facts" in ways similar to the way candidate Trump presents "facts."

      Delete
    2. "In lemming-like fashion, Goldstein was responding to the very strong scores recorded by kids in the city of Shanghai, which had participated as an independent entity in the 2009 Program for International Student Assessment (PISA), the world's other major international testing program."

      You can Google PISA as easily as I can.

      Trump has never discussed education in any detail whatsoever. He is a non sequitur here. You are a nuisance.

      Delete
    3. "Trump has never discussed education in any detail, whatsover."

      Once again, nobody ever said Trump discussed anything. But the quote you provide does provide a good example of the similarity between "facts" as presented by Somerby and Presidential Candidate Trump.

      "In lemming-like fashion, Goldstein was responding to the very strong scores recorded by kids in the city of Shanghai...."

      Goldstein was responding to a report about teacher recruitment, training and evaluation in other countries. She was not responding to nor did she report, in any fashion deserving a similie comparing her to an animal, test scores.

      Somerby, in Trump-like fashion, engages in "truthful hyperbole." In other words, he makes things up. Novelizes.

      Delete
    4. Once again, you focus on a confusing nit-pick involving an overly literal parsing of language (that no one else would make) in order to offer a specious and time-wasting criticism of Somerby. What a waste of time you are! Please crawl back into your hole.

      Delete
    5. You are now acting like a Trump supporter.

      Or perhaps you simply are not very intelligent.

      Somerby disappears inconvenient facts and reports ones which fit his narrative. And when he wants to insult someone he resorts to invention and insult. This reminds me of Candidate Trump.

      Delete
    6. 1. I don't believe Somerby "disappears inconvenient facts".
      2. I like the colorful language he uses for people he dislikes.
      3. All people tend to do this, not just Trump.

      We've had this discussion before. You don't understand selectivity and you focus on trivialities with the sole intention of trying to make Somerby look wrong. It is a waste of time refuting anything you say.

      The juxtaposition of your first two sentences implies Trump supporters are intelligent. I suspect you are wrong about that. (He has lost the educated white vote, for example.)

      Why don't you do us all a favor and go away?

      Delete
    7. Well! If you put it that way, I AM leaving!

      Delete
  6. My marriage of 3 years was sinking and i was devastated. My husband broke up with me and I got no explanations from him. for me to get him back, i have to find a solution, I went to 3 different spell casters they all failed to bring back my husband, I really wasn’t sure anymore if spells were real so as i was making a search one morning i saw some great reviews about happylovespell2@gmail.com, I was a bit skeptical at first but a friend asked me to try and see what happens, so I requested for a love spell from this spell caster, he said he will take his time to do a love spell that will bring my man back to me, after some days my husband reconciled with me, It felt good to have my husband back, when he returned he said he would never leave me again. I saw him transform, all thanks to Dr happy he was like a father to me when i loose hope. now my lover is more open, with happy Spell I know love spell is real, Thanks to Dr happy Spell for getting me my man back. I appreciate all his time, effort, and energy he puts during the spell cast. contact him on via mail happylovespell2@gmail.com he is the best of all spell casters Add him on Whats-pp +2348133873774??????.

    ReplyDelete
  7. AM A LIVING WITNESS AND A BENEFICIARY OF DR OGUDU LOVE SPELL, PREGNACY SPELL AND MARRIAGE REUNITING, CONTACT HIM NOW FOR YOUR MARRIAGE AND RELATIONSHIP PROBLEMS SOLUTION WITHIN 48 HOURS OF CONTACTING HIM

    My name is CINDY SCOTT am from BELARUS, am a woman who loves and cherish my husband more than any other thing you can imagine on earth surface. My husband was so lovely and caring after 9 years of marriage he was seriously ill and the doctor confirm and said he has a kidney infection that he needed a kidney donor, that was how I started searching for a good Samaritan who can help,doctor has given me a periodic hour that he will live just 2 days left, that was how I ask the doctor if I can be of help to my husband that was how he carried out the test,the confirming was successful, I was now having this taught that since 9years now we got married I have not be able to get pregnant can I be able to get pregnant again after the surgery? That was the question I ask the doctor, he never answer his response was do you want to lost your husband? I immediately reply no I can't afford to loose him. After the operation i and my husband came back home and live happily as husband and wife should. After 7months my husband came home with another lady telling me, that is our new wife that will give us kids and take care of us, that was how I was confused and started crying all day, That was not enough soonest my husband ran away with the new find love and never keep in contact with me. Since then I was confuse don't no what to do that was how I went back to the doctor and tell him everything, he told me that, this is not just an ordinary thing that he have heard of us situation so many times but he knows a man who is a voodoo spell caster who can help me out of my present situation that he has directed more 6 woman to him and they all came back with positive stories and testimonials about him that I should tell him all my problem that he can help me out that was how i contacted him and i did as instructed. After 3days and I have done what he ask me to do, my husband started searching for me that was how we settle he also told me not to worry that I will get pregnant, this month making it the fifth Month I contacted him am now 3months pregnant. These great spell cater is a great man, if you are in any kind of problem you can contact him here on his email OGUDUSPELLTEMPLE@YAHOO.COM...WHATSAPP NUMBER +2348106058254...WEBSITE...http://oguduspelltemple.wixsite.com/drogudu

    ReplyDelete