Coalition Of Scientists Takes Novel Approach To Grading Accuracy Of Climate Change Coverage

A group of scientists from around the world is using new web-based technology to assess the accuracy of media coverage of climate change, and the organization spearheading these efforts is looking for support to take its work to the next level.

The organization, known as Climate Feedback, uses what’s known as web annotation technology to layer scientists’ comments directly onto articles and opinion pieces, so that readers can easily understand whether -- and to what degree -- the pieces are consistent with scientific understanding of climate change. Climate Feedback then assigns a credibility score known as “feedback” to each media piece, which serves as an overall guide to its accuracy -- or lack thereof.

The result looks like this:

At Media Matters, we’ve given scientists a forum to set the record straight when media distort their climate studies. Now Climate Feedback is further improving the media conversation by giving scientists the opportunity to respond to a wide variety of climate change coverage, as founder Dr. Emmanuel Vincent explained in an email to Media Matters.

“We think scientists need to have a voice of their own in the media,” Vincent said. “Not as a replacement of journalism, but as a way to ensure that scientific results are not misunderstood or distorted.”

The approach Climate Feedback employs is unique in several respects. It borrows from the peer review process used to evaluate scientific research papers, ensuring that media coverage of climate science receives a similar level of scrutiny. “After an article is selected for review, scientists with relevant expertise are invited to provide their feedback directly” using the web annotation platform, Vincent said. “Reviewers then fill [out] a short questionnaire with their rating and appreciation of the overall credibility of the piece that are all revealed at the same time to guarantee the independence of scientists’ reviews.”

Vincent noted that Climate Feedback usually solicits comments from five to 10 scientists for each media evaluation, which is substantially higher than the two to three reviewers typically involved in a classic peer review of scientific literature. “This distributes the workload among scientists who can focus on discussing what they know best,” and helps “convey a more robust sense of the consensus when there is one.”

Climate Feedback also ensures that only highly qualified experts weigh in on the accuracy of the media reports it analyzes. According to Vincent, contributors must have been the lead author of an article published in a top-tier peer-reviewed scientific journal within the last three years, and they must have a doctorate in a relevant discipline. Depending on the nature of the claims made in the article, Climate Feedback may seek comments from experts in a variety of subjects including biogeochemistry, oceanography, climate variability, paleoclimatology, climate impacts on ecosystems, human health and beyond.

Once an evaluation is published, Climate Feedback shares it with the reporter or columnist via email or social media. As an example of his group’s success, Vincent pointed to an article in London’s Telegraph newspaper, which “appended a correction and made major modifications” to its original article, “withdrawing 5 sentences, in such a way that the title of the article announcing an imminent ice age is not supported anymore.” Additionally, one Climate Feedback evaluation formed the basis of an open letter from a group of scientists to The Wall Street Journal, criticizing an opinion piece for “attempt[ing] to throw clouds of uncertainty around the hard facts about climate change.” And just last week, members of the British House of Lords referenced another Climate Feedback evaluation while calling on The Times of London to more accurately cover climate science.

Since Climate Feedback launched in late 2014, Vincent has observed several common media failings, including using flawed reasoning, making logical fallacies, cherry-picking data, and offering misleading or imprecise statements. One example he highlighted was a May 2015 Forbes column by “merchant of doubt” James Taylor, of the Exxon- and Koch-funded Heartland Institute, which misleadingly denied the impact of global warming on polar ice. Vincent noted in his email that Taylor’s column received “almost a million views and is by far Forbes’ most influential climate article in 2015 – which gives an idea of the scale of the problem we’re tackling.”

Indeed, because the challenge is so great, Climate Feedback is ramping up its efforts via a crowdfunding campaign this week. The aim is to raise enough funds to hire a scientific editor and build a “Scientific Trust Tracker,” which will aggregate the group’s ratings to assess the overall credibility of various news sources. According to Vincent, the new tool “should provide a healthy incentive for more accurate science reporting,” because “building trust is essential for news sources and scientists’ endorsements can help journalists with integrity to get ahead.”

Climate Feedback is doing this work at an important time. Major U.S. media outlets continue to give undue attention to those who deny the scientific consensus that fossil fuel pollution and other human activities are causing global warming, while scientists remain vastly underrepresented in some of the most high-profile media discussions of climate change, such as those taking place on the broadcast networks’ Sunday shows. And revelations of Exxon’s climate change deception exemplify the ability of the fossil fuel industry to inject misinformation into the media to undermine climate policies. As the fossil fuel industry continues to wage war on the Clean Power Plan, the Paris climate agreement, and other major climate initiatives, too many Americans remain confused about the causes of climate change (although the trend is positive), and not enough recognize the urgent need for action.

As Vincent explained, “We now have growing evidence that corporate interests have been using the same playbook as Tobacco companies a few decades earlier: using the media to sow doubt about the science of the smoking-cancer connection then and of climate change now in order to confuse the public and undermine democratic support for dealing with the issue.”

Climate Feedback is a valuable resource to counteract the fossil fuel industry’s harmful influence and encourage media consumers to “stand with science” to achieve more accurate climate change coverage.