A PolitiFact (PF) New Jersey fact-check on Loretta Weinberg, the state senate majority leader, done on June 7, seems to have slipped through my conservative counterpart’s bias-searching fingers, because I’m sure if he had read it he would be quoting it (besides having a major cow!) liberally throughout both his anti-PolitiFact blogs. For Bill Adair, the head of PolitiFact, came right out and directly addressed his biggest complaint of why he despises the Truth-o-Meter concept and what he believes is the reason for its alleged “bias.”
Weinberg said that Scott Walker of Wisconsin topped a list of the five “Lie - en Governors" according to PolitiFact, and New Jersey Governor Chris Christie was also part of the “top five.” PolitiFact rated this statement “False” and included an interview with PolitiFact Manager Bill Adair, who made this very interesting comment:
"It's fine if people want to use our report cards to compare the records of people we fact-check. But it's important to be accurate about what those report cards say and what they don't," Adair said. "The report cards provide a tally of the claims we chose to check. But it's not accurate to say the report cards indicate who ‘told the most lies.’ We are journalists who choose our fact-checks based on what is newsworthy. We are not social scientists and are not using any kind of random sample to select statements to check."
But did Uppity Wisconsin, the source of Weinberg’s information, have it right? Here’s how PolitiFact explains what they did:
So what is Weinberg talking about?
The state senator’s statement was based on a list posted on the liberal blog Uppity Wisconsin.
The list ranked governors fact-checked at least five times by PolitiFact by the percentage of True and Mostly True ratings they received.
Walker had the lowest combined percentage of those two rulings, according to the June 1 blog post. The post concluded that "Walker is the #1 most dishonest governor in America."
Christie took fourth place among the "top five most dishonest governors in America" with 38 percent of his PolitiFact rulings earning True or Mostly True.
Uppity Wisconsin simply added the percentages of Trues and Mostly Trues, and came up with Scott Walker of Wisconsin at Number One with a combined percentage of 22 percent, followed by Rick Perry of Texas and Lincoln Chafee of Rhode Island both at 25%, Chris Christie of New Jersey at 38%, and lastly Bob McDonnell of Virginia at 44%. Uppity Wisconsin ignored a lot of things in coming up with these numbers. Adair has a point that this does not accurately show “who told the most lies.” For example, in 2012, Rhode Island governor Lincoln Chaffee had only two rulings from PolitiFact. He’s only had eight fact-checks ever from PolitiFact. This is not a good measure of “truthiness” for someone with this few fact-checks.
The more fact-checks on someone, the more it should bolster the claim of measuring honesty. But it’s even hard to say what that “more” number is. I put together a list of those sitting governors with 20 or more fact-checks, and decided "the top five" should be those with 40 or more: governors Chris Christie (NJ), Rick Scott (FL), Rick Perry (TX), John Kasich (OH) and Scott Walker (WI). I threw out Governor Nathan Deal of Georgia (with 22) and Bob McDonnell of Virginia (with 23), simply because I wanted to measure those with the highest number of fact-checks who had been rated recently. Not a lot of politicians meet the “40” criteria, but it’s a better measure than basing it on fewer than 10 fact-checks.
The other problem with Uppity Wisconsin’s measure is it does not take into account the Half Trues, Mostly Falses, Falses and Pants on Fire categories in making its "honesty" measure. The Truth Index as calculated by PolitiFact places heavier weight on the Falses and Pants on Fire categories: the Pants on Fire is weighted 50% higher than a True, because (I’m guessing) it was felt emphasis should be put on the false statements.