team to develop ways to assess whether the people who were flagging posts as false were themselves trustworthy.
“One of the signals we use is how people interact with articles,” Lyons said in a follow-up email. “For example, if someone previously gave us feedback that an article was false and the article was confirmed false by a fact-checker, then we might weight that person’s future false-news feedback more than someone who indiscriminately provides false-news feedback on lots of articles, including ones that end up being rated as true.”
The score is one signal among many that the company feeds into more algorithms to help it decide which stories should be reviewed.
“I like to make the joke that, if people only reported things that were false, this job would be so easy!” Lyons said in the interview. “People often report things that they just disagree with.”
She declined to say what other signals the company used to determine trustworthiness, citing concerns about tipping off bad actors.