Lots of Inumerate Ink: Penguins suffer when tagged. Do the math. Most journos didn’t.
Thursday, January 13th, 2011
Seth Borenstein at the AP has done a sly compilation of how well his colleagues (ie competitors) think through simple math that’s staring them right in the face. It’s sly because Borenstein wanted to see how many spotted an error that he himself thought he’d noticed in a paper – on penguins and the biologists who band them for study – and that the paper’s authors conceded to him was, yes, if not abject error quite distinctly misleading.
Well surprise! Most reporters do not question even very basic math that they are handed by researchers who probably did a lot better in arithmetic than did the average journalist or the average follower of most professions. Here’s the score he shared with ksjtracker: “Getting the math wrong: 14. Getting it right: 2. Our batting average as science writers, a tepid .125.” That is well under the Mendoza line and if you’re a baseball fan you know what that means and especially if it’s the team average: back to the minor leagues for you.
The news is significant, and not dependent for its impact on the exact translation of the raw stats. It is that, in a Nature cover story, a team of biologists from France and Norway reported that the longterm survival of king penguins that had been tagged with metal bands on their wings was dramatically lower, and their chances of leaving progeny also lower, than non-banded ones.
However…ahem. The paper and Nature‘s summary for reporters both say that flipper-banded penguins had a 16 percent lower ten-year survival rate. By
contrast, the accompanying data results table says that chances of surviving for ten years fell from 0.36 to 0.20. Well, subtract those two and one does get 0.16 or 16 points difference, but as our alert AP man saw, what’s important is not that the rate fell 16 points but that 0.20 is about a 44 percent drop from 0.36.
A similar error occurred with breeding success. Borenstein reports that one of the authors told him, on being contacted, those are mistakes (and he tells us that some other authors said they’re sticking with the paper as is because they think it makes sense in French. I’m not sure, even with a dollop of Gallic ancestry, how that works).
Gadzooks. I’d like to think I’d have seen the error in going from numbers to plain English. Why reviewers did not is a mystery. And I fear I might well have been one of the science writers slapping his head about now were I to have covered this story myself. Plus, for all I know Borenstein and Petit are both thinking alike but wrong, and somehow that data box DOES translate to a 16 percent reduction in survival over ten years. But I doubt it.
None of this alters the underlying message: researchers need to rethink banding of king penguins, maybe all penguins, maybe all birds (although a banded leg must be different than a banded flipper).
Now, to name names;
Stories that got the figures right or darned close to it:
- AP – Seth Borenstein: Study: Penguin tracking bands hurt seabirds ;
- BBC – Richard Black: ‘Unethical’ flipper tags are damaging to penguins ; He uses 40 percent reduction in survival, close enough if he just rounded things off, and also runs the absolute numbers: 18 out of 50 of the non flipper-tagged (but they did have subdermal transponders) survived, vs. 10 of the banded birds).
Stories that did not catch the flub:
- NatureNews – Daniel Cressey: Researchers’ flipper bands can seriously dent penguin survival, and also skew the results of research; Does have a good summary of earlier concerns along the same lines.
- AAAS ScienceNow – Cassandra Willyard: Flipper Bands Harm Penguins ; Boy, did Science miss a chance to tweak Nature on this one!
- Guardian (UK) Nidhi Prakash: Tagging penguins limits survival chances, study shows / survival rates for king penguins with flipper bands dropped by 16%.. ;
- USA Today – Dan Vergano: Banded study penguins die sooner ;
- USA Today – Elisabeth Weise: Study: Banded penguins die sooner, skewing climate data ; Two shots at it at USA Today, this one longer. More important than the data math oversight, it does a good job explaining this as ongoing controversy with other penguin researchers saying their bands aren’t nearly this bad.
- ArsTechnica – Yun Xie: Data from banded penguins suffer from fatal flaw ; Another one with good history of the debate. But it too takes .20 to be 16 percent smaller than .36.
- LiveScience – Janelle Weaver: Tracking bands can harm penguins ;
- NPR – Christopher Joyce: Flipper Bands Can Harm King Penguin Population ; Nice job explaining why these bands might be worse than they look: coefficient of drag.
- AFP : Tagged penguins could skew climate studies – scientists ;
- Toronto Sun – QMI : Tagging bad for penguins: Study ;
- Globe and Mail – John Allemang: Tracking bands put penguins’ live at risk, study finds ;
- ABC (Australia) Carl Holm: Penguins harmed by banding ;
- Irish Times – Dick Ahlstrom: Problems for Penguins ;
- Telegraph (UK) Tags created to help penguins could be killing them ;
Plus a few more just to show I can still do some of my own tracking:
- The Australian – Hannah Devlin: Penguins with tracking tags have lot survival rate ; Yep, she goes with 16%. But the hed is off: these wing bands are not the tracking tags used on controls (which are under the skin and send radio signals). The story is solid on the study’s importance and intended ethical judgment.
- Science News via Discovery News – Susan Millius : Penguins Harmed by Research Bands ; One more in the 16% column. Batting average falling again.
- Hey Wow get this : Carrentals.co.uk – Lisa Davidson: Tagging penguins’ flippers shorten their lives ; 40 percent she says! I usually ignore this outlet in searches because, well, it’s called Carrentals.com. I opened it thinking what’re the odds this outfit got it right? Son of a gun. Maybe Lisa D. happened to rewrite the Beeb or something, but it’s got the right math. Maybe I’ll pay more attention Carrentals.com.
By the way, wing banding of king penguins has been reported before:
- Discovery News – Jennifer Viegas (June 8, 2004, via ABC Australia): Banding kills birds it’s supposed to tag ;
- Charlie Petit