Exclusive-Facebook to target fake coordination by real accounts using the playbook against harmful networks Reuters - Facebook is taking a more aggressive approach to shut down coordinated groups of real-user accounts engaging in certain harmful activities on its platform, using the same strategy its security teams take against campaigns using real accounts .
The new approach, reported here for the first time, uses the tactics usually taken by Facebook security teams for wholesale shutouts of networks engaged in influence operations that use false accounts to manipulate public debate, such as Russian troll farms.
It could have major implications for how the social media giant handles civil movement movements breaking its rules, at a time when Facebook's approach to abuses on its platforms is under heavy scrutiny from global lawmakers and civil society groups.
Facebook said it now plans to take this same network-level approach with groups of coordinated real accounts that systemically break its rules, through mass reporting where many users falsely report a target's content or account to get it shut down, or brigading, a type of online harassment where users would coordinate to target an individual via mass posts or comments.
The expansion, which a spokeswoman said was in its early stages, means Facebook's security teams could identify core movements driving such behavior and take more sweeping actions than the company removing posts or individual accounts as it otherwise might.
In April, BuzzFeed News leaked a real-time internal report by the company about the role in the Jan. 6 riot on Capitol Hill and its challenges in curbing the fast growing 'Stop the Steal' movement where one of the findings was that Facebook had little policy around coordinated authentic harm. https: bit.ly 2 XmbHZN Facebook's security experts, who are separate from the company's content moderators and handle threats from adversaries trying to evade its rules, started cracking down on influence operations using fake accounts in 2017, following the 2016 U.S. election in which U.S. intelligence officials concluded Russia used social media platforms as part of a cyber-influence campaign - a claim Moscow has denied.
Facebook dubbed this banned activity by the groups of fake accounts coordinated inauthentic behavior CIB and its security teams started announcing sweeping takedowns in monthly reports. The security teams also handle some specific threats that may not use overt account, such as fraud or cyber-espionage networks or fake influence operations, like some state media campaigns.
Sources said teams at the company had long debated how it should intervene at a network level for large movements of real user accounts systemically breaking its rules.
In July, Reuters reported on the Vietnam Army's online information warfare unit who engaged in actions including mass reporting of accounts to Facebook but also often used their real names.
Facebook is under increasing pressure from global regulators, lawmakers and employees to combat wide-ranging abuses on its services. Others have criticized the company over allegations of censorship, anti-conservative bias or inconsistent enforcement.
A recent expansion of Facebook's network disruption models to affect authentic accounts raises further questions about how changes might impact types of public debate, online movements and campaign tactics across the political spectrum.
High-profile cases of coordinated activity around last year's U.S. election, from high-profile K-pop fans who claimed they used TikTok to sabotage a rally for former President Donald Trump in Tulsa, Oklahoma, to online campaigns paid by meme-makers, have also sparked debates on how platforms should define and approach coordinated campaigns.