"[W]e do not have proactive detection and enforcement running for NCII or sextortion in IGDM"

"[Bad actor number 2] had a total of 900 message threads within a few months With 338 reactive reports against both the account and message threads. Many of these reports contained signals of sextortion. However, you'll see none of them were actioned for sextortion or NCIT leading to disabling. We will call out the user was striked for bullying and harassment and banked NCII, but these strikes did not enforce on that bad actor in any way." "The first proximate for this problem is that we, as in Meta, did not proactively detect these bad actors or their violating content and conversations in IGDM. And that is because we do not have proactive detection and enforcement running for NCII or sextortion in IGDM" "We also do not have any classifiers running for sextortion specifically." "The third root cause for this proximate is that the users did not hit the IICIICInappropriate Interactions with ChildrenA classifier threshold and content category for interactions between adults and children indicative of grooming or exploitation, referred to internally as "a.k.a. 'grooming'". The source document puts the scale at "~500k victims per DAY in English markets only", three times Messenger's prevalence, while calling it "a preliminary metric" and adding "we expect the true situation is worse".Full entry ↗, or inappropriate interactions with children, behavioral classifier threshold." "0% of these IGDM reports against these bad actors were given human review. We did this because our ranking system did not rank these jobs high enough for human review." "Also, 83% of these jobs were routed to the sub-Sahara Africa queue that has low human review capacity This is because our jobs are routed to a queue based on the location of the responsible party, in this case Nigeria. And we also only have enough human review in this market to review 1-2% of reported jobs." "And finally, we deprecated the blackmail contact form that formerly allowed users to specifically report sextortion And we did that because of a lack of reviewer bandwidth."