Where do unfortunate howlers come from?

TUESDAY, DECEMBER 22, 2020

Step One looked like this: Where do unfortunate howlers come from? Let's consider this unfortunate race-involved groaner recently put in print by the Washington Post's Michele Norris:

NORRIS (12/10/20): We are not just tussling with historical wrongs. A recent study of White medical students found that half believed that Black patients had a higher tolerance for pain [than white patients] and were more likely to prescribe inadequate medical treatment as a result.

These White People Today! In fact, the recent study to which Norris linked includes no such finding. It  includes no finding anything like the one which Norris described. 

Almost none of the (white) medical students involved in the study said that black patients had a higher tolerance for pain. By our reckoning, it isn't entirely clear that any of the (white) medical students did.

What was the source of Norris' howler? Let's start with two aspects of the original study.

In the study in question, medical students—all of them "white"—were shown a list of 15 statements. They were asked if the various statements were true or false. 

Well—that isn't exactly what they were asked. In fact, they were asked to rank each statement based on "a six-point scale:" Here were the six assessments from which they were asked to choose:

1) The statement is definitely true.
2) The statement is probably true.
3) The statement is possibly true. 
4) The statement is possibly false.
5) The statement is probably false.
6) The statement is definitely false.

Is this a normal way to conduct a survey of this type? We ask for an obvious reason—it's hard to say what the difference is between assessments 3 and 4.

If a statement is "possibly true," it follows that the statement is also "possibly false!" Would it possibly make more sense to ask respondents to choose from these five assessments?

1) The statement is definitely true.
2) The statement is probably true.
3) I don't know whether the statement is true or false.
4) The statement is probably false.
5) The statement is definitely false.

There's a problem with survey design of that type. When respondents are given the chance to say that they don't know (or have no opinion), respondents often take it. In the design of this study, respondents were required to state an assessment, with possible answers 3 and 4 in a curious state of overlap / equivalence.

As noted, respondents were asked to assess 15 different statements. The statement in question in Norris' howler is the following statement:

"Black people’s nerve-endings are less sensitive than White people’s nerve-endings."

In the study to which Norris refers, 87 third- and fourth-year medical students were asked to evaluate that particular statement. In fact, only one (1) of the 87 was recorded calling it "true."

As you know, one out of 87 is well less than half! And in that one case, the  medical student may have said only that the statement was "possibly true!" 

That's the way responses were scored in this particular study. To us, this seems like a slightly peculiar way to run a survey like this.

A somewhat larger number of first- and second-year medical students were asked to assess that same statement. In that group, 15 out of 135 students (11 percent) were recorded as rating the statement true.

Overall, that means that 16 out of 222 students were recorded as rating the statement true. That's 7.2% of all the students, and there's no way to know how many of those  hapless white people merely said that the statement was "possibly" true.

At any rate, seven percent of the medical students were recorded as having rated the statement true. The percentage drops to roughly one percent (one out of 87)  if we restrict ourselves to the various white boys and Karens who had completed two years of medical training.

Somehow, Norris ended up saying that half of These White Medical Students Today held the noxious racial belief in question. Tomorrow, we'll continue with our study of where her howler came from.

For today, one final note about the structure of this study. We note that zero (0) black medical students were asked to evaluate the 15 statements. 

How many black medical students, especially those in their first year of study, might have offered the wrong assessments of the fifteen statements? There's no way to know; the lofty folk who conducted the study were careful not to ask any such students.

On occasion, we come away from studies like this with a certain suspicion. Because our suspicion is less than charitable, we won't state it here.

Tomorrow: How did Norris (and her editor)  get fooled?


29 comments:

  1. "...the noxious racial belief in question"

    Hmm. And what's so noxious about it, dear Bob? Skin color is a genetic trait, and it seems quite possible that it could statistically correlate with other characteristics.

    Bone density, for example. So, why not the sensitivity of nerve-endings? Could be false, could be true, and we don't see anything noxious about it at all.

    ReplyDelete
    Replies
    1. Racial differences tend not to transcend individual differences. That's what makes the belief in racial differences "noxious."

      Delete
    2. So then, does it make your belief that "racial differences tend not to transcend individual differences" noxious?

      Delete
    3. Mao is the common denominator...he is probably making everything noxious.

      Delete
    4. I want to share this wonderful testimony to the Good people all over the world on how I was able to Enlarge my Penis by Dr. Aziba. I was living a shameful life from my young age, just last month as I was browsing on the internet about Penis size  and Enlargement Products, I saw a testimony of a Man called Tim James testifying of how he was able to get his penis Enlarged by Dr. Aziba and I decided to also Email Dr. Aziba for my small penis size and he quickly respond to me and gave me the normal instructions which i did and then he shipped the product to me here in the united state which i received in just 3 working days and today i am very happy because i started seeing positive changes in my penis size in just 7 days of use.  Dr Aziba herbal product is the best recommended for you and to whom ever suffering from this shame or having any other diseases as well should Contact this great herbal doctor via his Email : Priestazibasolutioncenter@gmail.com and WhatsApp Him on +2348100368288








      I want to share this wonderful testimony to the Good people all over the world on how I was able to Enlarge my Penis by Dr. Aziba. I was living a shameful life from my young age, just last month as I was browsing on the internet about Penis size  and Enlargement Products, I saw a testimony of a Man called Tim James testifying of how he was able to get his penis Enlarged by Dr. Aziba and I decided to also Email Dr. Aziba for my small penis size and he quickly respond to me and gave me the normal instructions which i did and then he shipped the product to me here in the united state which i received in just 3 working days and today i am very happy because i started seeing positive changes in my penis size in just 7 days of use.  Dr Aziba herbal product is the best recommended for you and to whom ever suffering from this shame or having any other diseases as well should Contact this great herbal doctor via his Email : Priestazibasolutioncenter@gmail.com and WhatsApp Him on +2348100368288

      Delete

    5. LOTTO, lottery,jackpot.
      Hello all my viewers, I am very happy for sharing this great testimonies,The best thing that has ever happened in my life is how I win the lottery euro million mega jackpot. I am a Woman who believe that one day I will win the lottery. finally my dreams came through when I email believelovespelltemple@gmail.com and tell him I need the lottery numbers. I have spend so much money on ticket just to make sure I win. But I never know that winning was so easy until the day I meant the spell caster online which so many people has talked about that he is very great in casting lottery spell, . so I decide to give it a try.I contacted this great Dr Believe and he did a spell and he gave me the winning lottery numbers. But believe me when the draws were out I was among winners. I win 30,000 million Dollar. Dr Believe truly you are the best, all thanks to you forever








      LOTTO, lottery,jackpot.
      Hello all my viewers, I am very happy for sharing this great testimonies,The best thing that has ever happened in my life is how I win the lottery euro million mega jackpot. I am a Woman who believe that one day I will win the lottery. finally my dreams came through when I email believelovespelltemple@gmail.com and tell him I need the lottery numbers. I have spend so much money on ticket just to make sure I win. But I never know that winning was so easy until the day I meant the spell caster online which so many people has talked about that he is very great in casting lottery spell, . so I decide to give it a try.I contacted this great Dr Believe and he did a spell and he gave me the winning lottery numbers. But believe me when the draws were out I was among winners. I win 30,000 million Dollar. Dr Believe truly you are the best, all thanks to you forever

      Delete
  2. "Is this a normal way to conduct a survey of this type?"

    Yes, and Somerby should read Fechner to understand the mathematical foundation for use of rating scales to measure subjective experience in psychology. S.S. Stevens is a good follow-on to that. And yes, there is a difference between 3 and 4 in a person's mind. Kahneman & Tversky nailed down the details of how people make judgments using rating scales. Just from the standpoint of common sense, there is a clear difference between something being possibly true as opposed to possibly false. Somerby is talking out of his ass about something he knows nothing about.

    ReplyDelete
    Replies
    1. anon 3:29, yes, just like there is a major difference between a glass being half full or half empty. It seems undeniable logic that if something is "possibly true" it is also "possibly false." Maybe you know better that answering "possibly true" somehow is more indicative that the responder believes the proposition's potential truth to some degree greater than an answer that it is "possibly false," using a standard other than simple logic. I don't think the difference is as clear as you suggest, especially when the result here is to demonstrate that white medical students at Brown of all people harbor racist stereotypes.

      Delete
    2. AC/MA, human psychology does not conform to formal logic. Think of true and false as the ends of a continuum. 3 and 4 along such a continuum are not in the same position. One is closer to the true end and the other is closer to the false end. That is how people think about rating scales, not your half-full half-empty analogy, nor Somerby's logic.

      This is an empirical matter. You use such a scale with a bunch of people and you see what they do. You don't reason it out using logic. There are many ideas in philosophy about mind and behavior that are unsupported by the empirical data collected by psychologists. What people actually do, is reality, not Somerby's suppositions.

      Delete
    3. Philosophy is not a science because it does not rely on observations, empirical evidence, or manipulations of hypothesized causal variables. Psychology does these things and that makes it a science. Science is a method for knowing more about reality, especially those aspects of reality that are not readily observable by other means. Science identifies patterns and relationships among measurable aspects of reality. Philosophy doesn't do any of that. Somerby's education in philosophy has handicapped him from participating in discussions about what is true for African Americans and pain treatment. He has done Michele Norris a wrong and he owes her an apology.

      Delete
    4. Philosophy means never having to say you're sorry...I think Ryan O'Neal said that.

      That's the dumbest thing I've ever heard...Barbra Streisand said that.

      Delete
    5. @AC, the study merely shows that the students held erroneous beliefs that led them to underprescribe pain medication to black patients. It doesn’t say anything about “racism” or “noxious racial beliefs.” Somerby has introduced that idea into the conversation, just to get you triggered. He is falsely characterizing the study in order to attack it. It is a form of propaganda.

      Delete
    6. mh & anons -The thrust of TDH's post is that Norris asserted that 50% of the students surveyed said the statement was 'true" while in fact only 1 out of 87 said it was true, and then it wasn't clear what category (definitely, probably or possibly) that 1 person chose. No one seems to be taking issue with that point, though I'm not clear that is what actually was the case. If TDH is accurate on that, this is an example of abuse of objectivity engendered by the woke movement, that everyone here wants to defend. MH - it's not clear, especially if what I just said is the case, that these medical students actually underprescribed anybody anything. The survey tested their beliefs, not what they were prescribing, and since they are students, not doctors, I don't know that they have prescribed anything at all, especially opiates. As to the science of psychology, I don't dispute that it is a "science" though it isn't like physics. It is applied by advertisers, including political advertisers and political campaigns to influence, or manipulate peoples' choices, and it must work, but obviously not on everybody each time. There are 2 ways of looking at the possibly true / possibly false issue. Someone who is able to think critically, not a good target for manipulators, would consider each alternative to be equivalent. But choosing one or the other might indicate some rough type of stereotypic thinking on the part of the responders, but this seems a subtle difference. Skepticism about surveys like this is, and the conclusions that are drawn from them, I think, warranted.

      Delete
    7. Here is what the study reported:

      "Study 1 documented these beliefs among white laypersons and revealed that participants who more strongly endorsed false beliefs about biological differences reported lower pain ratings for a black (vs. white) target. Study 2 extended these findings to the medical context and found that half of a sample of white medical students and residents endorsed these beliefs. Moreover, participants who endorsed these beliefs rated the black (vs. white) patient’s pain as lower and made less accurate treatment recommendations. "

      Study 1 consisted of laypersons and Study 2 consisted of medical students and residents.

      Table 1 breaks down the data question-by-question for laypersons and med students by year (1, 2, 3) and residents:

      Blacks’ nerve endings are less sensitive than whites’ 20 8 14 0 4

      These are percentages, so you multiply the percent (converted to a proportion) by the n size (number of subjects in each group) and round to the nearest whole person:

      18 5 10 0 1

      So, the number 1 is only among the residents (who have had considerable medical training) and it is one person among 28 total residents (the smallest of the samples recruited for this study). Note that this is NOT one person in the whole study as Somerby claimed.

      First, there are no 4th year med students. Somerby is dishonestly collapsing data to include the 1 person among the medical residents with the 0 3rd year med students (who will have had recent practical medical experience under instruction by then) to arrive at the total of 87. He makes that seem like it is the entire sample, when it is half of the cohort, as Nicole Wallace stated.

      Somerby worked very hard to produce this "damning" figure, entirely ignoring the results of the remainder of the study, the results of the composite scale, and the mitigating effect that advanced training has on these fallacious beliefs.

      You should be suspicious when someone works this hard to discredit a study they don't want to acknowledge, using data in inadmissible ways and ignoring every result in the study that contradicts Somerby's preferred belief.

      Somerby selective focus on one number for one item in a questionnaire that includes 9 measures and four samples, is your clue that Somerby is not trustworthy when it comes to this kind of analysis. He is deliberately misleading you and your skepticism should be directed at Somerby (who has no qualifications in this area of study), not the researchers who published these two studies after peer review in a recognized medical journal.

      You are making yourself sound foolish by defending Somerby on this.

      As for the possibly true matter, if a researcher wants to assess the degree of certainty of a subject who has been forced to make a judgment using a rating scale, the way to do it is to ask them to make a separate "confidence judgment." For each question with a 1-6 rating, you present a second scale asking them how confident (sure) they are about the rating they just gave. There is a large literature about how to administer and interpret such confidence judgments, just as there are books about how to create composite scales (such as a likert scale) and how to validate surveys, and how to use the resulting numbers.

      One problem with Somerby's suggesting about including that midpoint on a 5-point scale is that it would make that question no longer comparable to the others, which would mean the resulting choices could not be averaged together with the rest of the items on the scale.

      Scaling is a specialization within mathematical psychology. Somerby knows nothing about it. That doesn't prevent him from calling reporters such as Michele Norris names they don't deserve. He owes her an apology.

      Delete
    8. Thank you anon 11:07. My comment allowed for the possibility that TDH was putting his fingers on the scale. Whether that means that the study proves anything significant is another matter. I also don't understand what you mean by the numbers "20 8 14 0 4" or "18 5 10 0 1" - you don't explain it. I'm a trial lawyer, and am familiar with what it takes to prove something in court. I'm not a social scientist. I assume that in the case of any two respondents, one who answered "possibly true" and the other who answered "possibly false", from a legal standard you couldn't conclude that person A had more anti-Black stereotypical views that person B - there could be myriad reasons why the divergent responses were given. Persons with expertise, such as social scientists or psychologists are often called as expert witnesses at trials. Usually, each side has its own expert, each of whom gives contrary views. I very much doubt that the survey in question provides a legitimate basis for advancing the 'systemic racism' narrative that is going on now, as Norris seemed to be doing. If TDH was putting his finger on the scale - could it be the case that she was doing the same?

      Delete
  3. Was Norris correct? Did a recent study of white medical students find that half believed that black patients had a higher tolerance for pain and were more likely to prescribe inadequate medical treatment as a result??

    Is that a true statement by Norris? Is her logic solid?

    ReplyDelete
  4. "Would it possibly make more sense to ask respondents to choose from these five assessments?

    1) The statement is definitely true.
    2) The statement is probably true.
    3) I don't know whether the statement is true or false.
    4) The statement is probably false.
    5) The statement is definitely false."

    If you use this scale, you have introduced a zero point (item 3) and that point is not on the same scale as all of the other choices. For one thing, item 3 applies to all of the other choices as well because a person may feel that they don't know the truth of any of the choices. So you are now talking about uncertainty with item 3 but truth with the other 4 items (which are also uncertain to one degree or another). So this is not as good a scale as the one with 6 values that Somerby is trying to improve upon.

    The problem of respondents taking the choice of saying I don't know, is exactly why you would not give them that option. All scales are forced choice and there are books written about how people guess under uncertainty. The biases involved in making forced choices are part of Signal Detection Theory. I would bet Somerby has never encountered that. Somerby assumes 3 and 4 "overlap" but has no data supporting his assertion. He is making shit up with that one.

    Somerby claims that only 1 person said the statement about nerve endings was true, but items 1-3 all assert the possibility of truth to a greater or lesser degree. Is Somerby claiming that only 1 person answered on that end of the scale (1-3) as opposed to choosing 4-6? Saying that only 1 person considered it true makes no sense given the data, which apparently consists of choices 1-3.

    But there is a bigger problem here. Somerby links to the study and it does not report data for individual items (questions). It reports a composite measure that consists of a subset of the 15 questions (9 of them) averaged across subjects in the groups compared. The point of the questions was to give a consistent measure that would show change resulting from their manipulation of the attitudes of the two groups. It is a measure of the extent to which the subjects consider black and white people different in their biology. Somerby clearly has no idea what a composite measure is or how a scale is created and validated or what it's use was in the two studies reported.

    Hubris, thy name is Somerby. His ignorance doesn't prevent him from saying a bunch of ridiculous stuff.

    ReplyDelete
  5. "For today, one final note about the structure of this study. We note that zero (0) black medical students were asked to evaluate the 15 statements."

    My daughter was a med student in a highly prestigious medical school. There were 0 black medical students in her class, and none in any of the classes at her school. Hard to create a comparative sample of med students when there aren't enough African Americans enrolled. That's a difficulty Somerby should appreciate, given that he uses it to excuse the lack of integrated schools all the time.

    ReplyDelete
    Replies
    1. How many African American med students would you need? If you add race as another IV, you will need to double your sample size. So, the researchers would need to have as many African American med students as there were white students included in the original two studies.

      I can imagine that if these researchers were to reduce the white sample size in order to have roughly equal numbers in each of their conditions, Somerby would complain that the samples are too small (utterly ignoring the effect size and significance of the results). Because that's how he rolls.

      Delete
  6. Getting your lover or your ex back has been made more easy by this powerful spell caster called Dr Odion. I am Rose by name and i am from canada, the only reason why i am on this site is to thank this powerful spell caster called DR. Odion and you can improve your relationship success by contacting him through these details (wisdomspiritualtemple@gmail.com Or call +2348136482342) This powerful spell caster did me a huge favor by helping me get my lover back to me within the speed of light and since then my relationship has been perfect.

    any problem of yours. He is specialized in the following:

    (1)Spell for protection from danger
    (2)Spell for magic
    (3)Spell for same sex love
    (4)Spell for healing
    (5)Spell for invisibility
    (6)Spell for riches and fame
    (7)Spell to get a good job
    (8)Spell for strong love and relationship
    (9)Spell to bring your ex back
    (10)speII for Lottery
    This man has great powers and is incredibly generous. You can contact him on
    (wisdomspiritualtemple@gmail.com)

    ReplyDelete
  7. My husband and I have been married for about 8 yrs now. We were happily married with two kids, a boy and a girl. 3 months ago, I started to noticing some strange behavior from him and a few weeks later I found out that my husband is seeing someone. He started coming home late from work on like before, he hardly care about me or the kids anymore, Sometimes he goes out and doesn't even come back home for about days. I did all I could to rectify this problem but all to no avail. I became very worried and needed help to make him come back to normal. As I was browsing through the Internet one day, I came across a website that suggested that Dr Ogala can help solve marital problems, restore broken relationships and so on. So, I felt I should give him a try. I contacted him about my broblem and he did a spell for me. Two days later, my husband change him will alay tell me ho much i and the kids main to him that he loves us so much he apologized for the wrongs he did and promise never to do it again. Ever since then, everything has returned back to normal. I and my family are living together happily again.. All thanks to Dr Ogala . If you need a spell caster that can cast a spell that truly works, I suggest you contact him. He will not disappoint you. This is his E-mail: email: drogalad02@gmail.com and also WhatsApp +2347049668119....

    ReplyDelete
  8. “Norris ended up saying that half of These White Medical Students Today held the noxious racial belief in question”

    Somerby: what a card!

    He makes you think that the researchers concluded (and indeed he insinuates that they deliberately rigged the study to show it) that those white medical students were essentially racist, or that they “held noxious racial beliefs.”

    But that isn’t what the researchers said. They simply said that the white medical students held false beliefs which led to underprescribing pain medication to black patients. They do not charge the medical students with racism. The beliefs are being examined in order to correct them, with the ultimate goal being to improve the quality of medical care for black patients, hardly a bad thing.

    It is revealing that Somerby reacts by caterwauling about those Liberal Researchers and insinuating that they rigged the test to show that whites are a bunch of racists. My, what a hysterical and very conservative-like reaction.

    ReplyDelete
    Replies
    1. This comment has been removed by the author.

      Delete
    2. And Norris is simply re-iterating what the researchers are saying.

      Delete
  9. I want to share this wonderful testimony to the Good people all over the world on how I was able to Enlarge my Penis by Dr. Aziba. I was living a shameful life from my young age, just last month as I was browsing on the internet about Penis size  and Enlargement Products, I saw a testimony of a Man called Tim James testifying of how he was able to get his penis Enlarged by Dr. Aziba and I decided to also Email Dr. Aziba for my small penis size and he quickly respond to me and gave me the normal instructions which i did and then he shipped the product to me here in the united state which i received in just 3 working days and today i am very happy because i started seeing positive changes in my penis size in just 7 days of use.  Dr Aziba herbal product is the best recommended for you and to whom ever suffering from this shame or having any other diseases as well should Contact this great herbal doctor via his Email : Priestazibasolutioncenter@gmail.com and WhatsApp Him on +2348100368288








    I want to share this wonderful testimony to the Good people all over the world on how I was able to Enlarge my Penis by Dr. Aziba. I was living a shameful life from my young age, just last month as I was browsing on the internet about Penis size  and Enlargement Products, I saw a testimony of a Man called Tim James testifying of how he was able to get his penis Enlarged by Dr. Aziba and I decided to also Email Dr. Aziba for my small penis size and he quickly respond to me and gave me the normal instructions which i did and then he shipped the product to me here in the united state which i received in just 3 working days and today i am very happy because i started seeing positive changes in my penis size in just 7 days of use.  Dr Aziba herbal product is the best recommended for you and to whom ever suffering from this shame or having any other diseases as well should Contact this great herbal doctor via his Email : Priestazibasolutioncenter@gmail.com and WhatsApp Him on +2348100368288

    ReplyDelete
  10. Hello everyone. I want to share my amazing experience with the great spell caster Dr.Ogudugu my husband was cheating on me and when I found out we had a fight which lead him filling for a divorce I cried and fell sick when I was searching about love quotes online I saw people talking about Dr.Ogudugu and his great work whose case was similar to mine they left his contact info I contacted Dr.Ogudugu and he told me not to worry that after 24 hours he will cancel the divorce and my husband will be back to me after I did everything he asked me to do to my greatest surprise the next day evening it was my husband he knelt down begging me to accept him back, thank you once again Dr.Ogudugu you are indeed a blessing to me he can also help you. Contact Dr.Ogudugu through his email address on: greatogudugu@gmail.com

    ReplyDelete
  11. Getting your lover or your ex back has been made more easy by this powerful spell caster called Dr Odion. I am Rose by name and i am from canada, the only reason why i am on this site is to thank this powerful spell caster called DR. Odion and you can improve your relationship success by contacting him through these details (wisdomspiritualtemple@gmail.com Or call +2348136482342) This powerful spell caster did me a huge favor by helping me get my lover back to me within the speed of light and since then my relationship has been perfect.

    any problem of yours.He is specialized in the following:

    (1)Spell for protection from danger
    (2)Spell for magic
    (3)Spell for same sex love
    (4)Spell for healing
    (5)Spell for invisibility
    (6)Spell for riches and fame
    (7)Spell to get a good job
    (8)Spell for strong love and relationship
    (9)Spell to bring your ex back
    (10)speII for Lottery
    This man has great powers and is incredibly generous.You can contact him on
    (wisdomspiritualtemple@gmail.com)

    ReplyDelete
  12. BEST WAYS TO GET YOUR EX LOVER BACK AND RESTORED YOUR BROKEN MARRIAGE OR RELATIONSHIP FROM SORROW TO HAPPINESS.

    Help me thank Dr Osita
    for helping me get my ex husband back to me and my family. This great powerful spiritual man restored my sorrow to happiness. My husband left me some years ago for another woman and they both planned to get married. I am so surprised he just came back to me one cool afternoon on Saturday June, begging and crying for me to take him back and to forgive him for breaking up our marriage home and forsaking me and the children. Dr Osita is a true spiritualist savior . He brought my husband back”
    if you have any worries or you have any problem in your marriages or relationships you can reach him +4915217824272 or on his email.(Ositabello8@gmail.com

    ReplyDelete