the NYT Rings the Bell Again
5th December 2011
The Times colors darkly the future of two beloved New York Jets football players, Al Toon and Wayne Chrebet, in their battles with NFL concussions. The players themselves take pains to say they are doing fine.
“I do have some residual but nothing significant,” Toon, 48, said in a phone interview from his office. “Nothing I care to talk about in public. I’m able to live a happy life.” Chrebet, 38, was also reluctant to get into specifics about the lingering effects of his concussions except to say they exist. In an e-mail he wrote: “While I have never spoken about what I’m going through today because of this, I can say that I am proud of the way I played, and new rules or old ones there was a good chance that the same thing would have happened to me. I stuck my nose where it didn’t belong sometimes and I paid for it. And boy it felt great. I wouldn’t have had it any other way.”
So. The players testify they’re okay, but the Times isn’t having it.
Since Toon and Chrebet retired, the N.F.L., shamed into taking action after disclosures about the devastating effects of concussions, has put in place practices designed to lessen their ravaging impact.
“Shamed.” “Ravaging impact.” And, of course:
According to a 2007 study by the Center for the Study of Retired Athletes at the University of North Carolina, retired N.F.L. players who had sustained three or more on-field concussions were three times as likely to experience depression in retirement than other players.
Three Times. That’s 300 percent, baby. Except we know how to count at the Persuasion Blog. Instead of that deliberately inflated Risk Ratio, if you compute the effect size from that study it is less than a Small Windowpane at about a 48/52. And given that the analysis is based on a biased and convenience sample and only on the self report of either an athlete or someone else we should maintain a scientific dubiousity about claims of a conclusive, powerful, and unambiguous relationship between NFL concussion and any future cognitive dysfunction.
But, apparently the NYT is smarter than all that. They got the meme on this one. Gridiron warriors cut down in their prime by greedy, heartless owners trading players’ bodies and health for profit. The bastards.
Of course, based on the best available evidence we’ve got, the future risk is at best, Small, indeed barely detectable above random variation. Given the poor methodological quality of the data, we can remain open to an alternative conclusion that really, there’s no effect at all. Of course the null hypothesis doesn’t sell papers.
All Bad Science Is Persuasive.




