Child sexual exploitation

"[O]ur age models are totally blind to this extraordinarily obvious exploit for the very abusive type we're trying to solve for"

████: "[D]id Core Dims confirm that their age models are optimized to catch age-lying minors and not age-lying adults? …

Names withheld in filing

Profits over SafetyKnowledge

Certain protections for minors applied only to People You May Know and did not extend to other parts of Facebook

One method we're using is to remove minors in inbox search for unconnected adults… You can typically search for people you are not connected w/ in Inbox search (i.e. start a new …

Unnamed employee

Profits over Safety

"It is concerning that our systems almost classify [CSAM] as an interest category, and will serve a ton of it if we think a user likes it. can lead to pretty bad rabbit holes"

Praveen ████: "shared: Instagram_Instagram_s_Algorithm_Delivers_Toxic_Video_Mix_to_Adults_Who_Follow_Children_-_WSJ.pdf" …

Tomas Kabbabe and names withheld in filing

Knowledge

"Of all the known violating content reviewed by reps as part of this golden set [of known-violating CSAM profiles and content], they would have taken down only ~1 in 5 profiles and ~2 in 5 pieces of content."

Some user reports have not been accurately handled by Meta… The key concern had to do with reports of potential child safety issues not being addressed by Meta… we anticipate that …

Unnamed employee

Profits over Safety

"Some really yucky content. We're sexualizing underage girls, promoting some very iffy accounts, and serving this content to people who didn't ask for it"

Melissa ████: "hey yall, was chatting with Tomas about how many people are complaining about sexualized content getting recommended to them in Reels" …

Thomas Kabbabe and names withheld in filing

Profits over SafetyKnowledge

Tomas Kabbabe: "Holy shit the WSJ article on Instagram and pedo recommendations is brutal"

Holy shit the WSJ article on Instagram and pedo recommendations is brutal

Unnamed employee

"IG DIOps proactively reviewed IG surfaces by assessing the search results of 16 Queries, Tags and Emojis (e.g. tweenxstars, #cutegirls and Little # &) 50+ suspicious accounts were found, and we observed patterns indicating the existence of a much larger network of similar accounts."

Unnamed employee

Knowledge

"Thousands of minors have been reporting IIC T1 abuse and even though we knew that there is IIC T1 going on (more than 50% of which is sextortion which can lead to suicide) we haven't done anything."

Pouya ████: "BTW this SEV is particularly painful. …

Names withheld in filing

Profits over Safety

The Instagram recommendation algorithm was surfacing accounts using obfuscated keywords for CSAM

Andy ████: "Flagging this new video Horwitz just sent of the AYSF recommendations for one of the Instagram accounts he's used to do this child safety research. …

Names withheld in filing

Knowledge

"The daily number of minor victims having sex talk conversations in IGDM with adults is 38x compared to FB (~200k victims/day)."

Pavni Diwanji: "[T]here was decision made to encrypt all private messages for u13. This has severe impact on safety as we know. …

Pavni Diwanji · Vaishnavi Jayakumar and names withheld in filing

Knowledge

"Out of ~2.5M IIC potential violators who viewed the follow list surface, 37% ( 924K) were shown at least one unconnected teen account."

Results Summary: Significant Improvements Needed" …

Unnamed employee

Knowledge

13 to 27 percent of 13-15 year-olds had received unwanted sexual advances on Instagram

Have you ever received unwanted sexual advances on Instagram? 13-15 year olds: 13%/27%

Unnamed employee

Knowledge

"We do nothing on complex objects (notably clearly violating groups & pages)"

Antigone Davis: "Hey did you ask for more child safety specific HC? If you have 5 minutes for a call, I can provide some context for the question." …

Antigone Davis and names withheld in filing

Profits over Safety

"50% of message requests to predicted teen dau are from predicted non-teens"

User impact: Teens receiving DM requests from unconnected adults, breaking public commitment that we made. 2 specific potential issues being investigated: …

Unnamed employee

Knowledge

"In August 2020, we found out that there are ~38x as many IIC victims on IGDM as on FB Messenger (Aug 2020). Despite this, CEI deletes on IG are ~21x lower and IIC auto-enforcing on IG is 90x lower compared to on FB."

Context: In August 2020, we found out that there are ~38x as many IIC victims on IGDM as on FB Messenger (Aug 2020). …

Name withheld in filing

KnowledgeProfits over Safety

"PYMK was responsible for 80% of violating adult/minor connections."

These restrictions on messaging and recommendations/search are what we have on FB today. We need to have some equivalency on Instagram." …

Unnamed employee

Profits over Safety

Adam Mosseri: "FYI I don't think we can stop recommending teens to adults through AYSF on Instagram."

FYI I don't think we can stop recommending teens to adults through AYSF on Instagram. …

Adam Mosseri

Profits over Safety

"We will have to explain why we currently allow 20 year olds to message 13 year olds."

Gail ████: "Hi both, I see you are both on the call for 18-20 talking to unconnected minors." …

Ravi Sinha and names withheld in filing

Profits over Safety

Internal policies prohibiting certain recommendations between minors and adults were never implemented due to "technical feasibility."

Following the first Wall Street Journal article, the Child Safety Task Force has been working to tighten our existing child safety protections. …

Unnamed employee

Profits over Safety

Prior to the Child Safety Task Force, Meta was recommending minors and "potentially suspicious adults" to one another

Gabriel ████: "(l) Yes on PYMK, but with the specifics of a/ MaCSA>0.3 to Minor: Filtered b/ Minor to MaCSA >0.3: Filtered except where 2 year age gap …

Names withheld in filing

Profits over Safety

"We believe that we'll likely have to confirm that 20yo have been able to message 13yo for a number of years following the launch of this protection."

Context: following a recent child safety incident (detail) an XFN team across Policy, Product, Legal and Public Affairs came together to re-evaluate an exception that allows …

Unnamed employee

Profits over Safety