A Blog by Jonathan Low

 

Mar 3, 2024

AI-Written Articles Cause CNET Reliability Downgrade, Reputational Damage

CNET's use of AI to write articles has been so riddled with errors and inaccuracies that it has caused Wikipedia, among others, to downgrade its reliability rating. 

While some media outlets may believe the use of AI marks them as forward-thinking - and may save some costs - AI's continuing problems with accuracy may end up costing more in terms of lost attention due to reputational damage. JL 

Benj Edwards reports in ars technica:

Wikipedia has downgraded tech website CNET's reliability rating following extensive discussions among its editors regarding the impact of AI-generated content on the site's trustworthiness. The decision reflects concerns over the reliability of articles found on the tech news outlet after it began publishing AI-generated stories in 2022. The articles were full of plagiarism and mistakes. Between November 2022 and present, Wikipedia currently considers CNET "generally unreliable" after the site began using an AI tool "to rapidly generate articles riddled with factual inaccuracies and affiliate links."

Wikipedia has downgraded tech website CNET's reliability rating following extensive discussions among its editors regarding the impact of AI-generated content on the site's trustworthiness, as noted in a detailed report from Futurism. The decision reflects concerns over the reliability of articles found on the tech news outlet after it began publishing AI-generated stories in 2022.

Around November 2022, CNET began publishing articles written by an AI model under the byline "CNET Money Staff." In January 2023, Futurism brought widespread attention to the issue and discovered that the articles were full of plagiarism and mistakes. (Around that time, we covered plans to do similar automated publishing at BuzzFeed.) After the revelation, CNET management paused the experiment, but the reputational damage had already been done.

Wikipedia maintains a page called "Reliable sources/Perennial sources" that includes a chart featuring news publications and their reliability ratings as viewed from Wikipedia's perspective. Shortly after the CNET news broke in January 2023, Wikipedia editors began a discussion thread on the Reliable Sources project page about the publication.

"CNET, usually regarded as an ordinary tech RS [reliable source], has started experimentally running AI-generated articles, which are riddled with errors," wrote a Wikipedia editor named David Gerard. "So far the experiment is not going down well, as it shouldn't. I haven't found any yet, but any of these articles that make it into a Wikipedia article need to be removed."

 

After other editors agreed in the discussion, they began the process of downgrading CNET's reliability rating.

As of this writing, Wikipedia's Perennial Sources list currently features three entries for CNET broken into three time periods: (1) before October 2020, when Wikipedia considered CNET a "generally reliable" source; (2) between October 2020 and October 2022, where Wikipedia notes that the site was acquired by Red Ventures in October 2020, "leading to a deterioration in editorial standards" and saying there is no consensus about reliability; and (3) between November 2022 and present, where Wikipedia currently considers CNET "generally unreliable" after the site began using an AI tool "to rapidly generate articles riddled with factual inaccuracies and affiliate links."

A screenshot of a chart featuring CNET's reliability ratings, as found on Wikipedia's "Perennial Sources" page.
Enlarge / A screenshot of a chart featuring CNET's reliability ratings, as found on Wikipedia's "Perennial Sources" page.

Futurism reports that the issue with CNET's AI-generated content also sparked a broader debate within the Wikipedia community about the reliability of sources owned by Red Ventures, such as Bankrate and CreditCards.com. Those sites published AI-generated content around the same time period as CNET. The editors also criticized Red Ventures for not being forthcoming about where and how AI was being implemented, further eroding trust in the company's publications. This lack of transparency was a key factor in the decision to downgrade CNET's reliability rating.

In response to the downgrade and the controversies surrounding AI-generated content, CNET issued a statement that claims that the site maintains high editorial standards.

"CNET is the world's largest provider of unbiased tech-focused news and advice," a CNET spokesperson said in a statement to Futurism. "We have been trusted for nearly 30 years because of our rigorous editorial and product review standards. It is important to clarify that CNET is not actively using AI to create new content. While we have no specific plans to restart, any future initiatives would follow our public AI policy."

0 comments:

Post a Comment