A leaked Facebook document shows that the social network had to deal with nearly 54 000 cases of ‘sextortion’ and revenge porn in just one month, pointing to a major issue on the site.
The documents, part of what have since been dubbed the “Facebook Files” by The Guardian, conclusively show that around 14 000 accounts were suspended as a result.
The publication is currently in the process of releasing the leaks, giving the public a glimpse into how Facebook manages sensitive material.
As the Guardian notes, Facebook depends on user reports, meaning that the revenge porn problem could be a whole lot bigger.
Revenge porn involves threatening ex-lovers with the release of previously-recorded explicit content without their consent, as a form of ‘revenge’ for the separation or some other reason.
‘Sextortion’, meanwhile, is effectively ransoming said content in return for some type of gain.
Together, they constitute some of the worst and most widespread sexual abuse on the internet today. It’s no wonder Facebook moderators have their hands full.
The Guardian says the leaked documents explain part of Facebook’s ‘escalation’ procedure. Two ‘hotkeys’ for moderators help them quickly mark cases of the abuse, and they rank as highly as terrorism and child exploitation at the company’s headquarters.
The full 65-page manual details the imagery, wording and behaviour that Facebook considers acceptable.
Facebook says that it is constantly updating policies, meaning that the guidelines are not set in stone. Let’s hope that its use of artificial intelligence eases the strain on moderators.