Meta & Children's Online Safety

Documents / Chat: there are ~38x as many IIC victims on IGDM as on FB Messenger

Chat: there are ~38x as many IIC victims on IGDM as on FB Messenger

Internal document15 messages1 named participant, plus redacted or unnamed

Narratives:KnowledgeProfits over Safety

Open source PDF (4 pages)

A readable view of the chat, built from the transcribed text. Each row is one timestamped message in the record. Times are Pacific, as recorded. Check the Source PDF for the original layout.

████ name redacted. Different bars may be the same person or different people.

quoted in an excerpt in the archive.

Monday 12 October 2020

12:38Dr. Diego Emiliano Castaneda] IG research will feature your safety work in the upcoming HPM. This was a question from who is organizing. "trying to pull out 1 insights or interesting stat from the "keeping youth safe" work is there one you recommend?"
12:49Dr. Diego Emiliano Castanedamore context: "comms suggested including a data point that would make people want to click and learn more"
13:03████Ohhhhh when you would need this by?
13:04Dr. Diego Emiliano Castanedaoh...anytime today. no rush.
13:04Dr. Diego Emiliano CastanedaI already submitted a blurb. wanted a stat to call ou.
13:06████ok cool. is digging into more data and I want to make sure we find the best one.
13:06Dr. Diego Emiliano Castanedacool. it should be in your Note though. since we will link to that.
13:07████0oo0oo00 ok got it.
13:14Dr. Diego Emiliano Castanedasorry, wasnt super clear! thanks!
13:19████Context: In August 2020, we found out that there are ~38x as many IIC victims on IGDM as on FB Messenger (Aug 2020). Despite this, CEI deletes on IG are ~21x lower and IIC auto-enforcing on IG is 90x lower compared to on FB. (Source: https://fb.workplace.com/groups/135709743752034/permalink/624917758164561/) < Actors take advantage of our tools on Instagram to find and inappropriately engage with children. while we have made strides in tackling the worst of the worst, from CEI to IIC, Instagram has a long journey ahead in understanding how these interaction play out on Instagram and how bad actors use our systems and products to do harm, especially on newer and unique surfaces to IG.
13:22████Context: In August 2020, we found out that there are ~38x as many IIC victims on IGDM as on FB Messenger (Aug 2020). Despite this, CEI deletes on IG are ~21x lower and IIC auto-enforcing on IG is 90x lower compared to on FB. (Source: https://fb.workplace.com/groups/135709743752034/permalink/624917758164561/) Actors take advantage of our tools on Instagram to find and inappropriately engage with children. while we have made strides in tackling the worst of the worst, from CEI to IIC, Instagram has a long journey ahead in understanding how these interaction play out on Instagram and how bad actors continue to use our systems and products to do harm, especially on newer and unique surfaces to Instagram. This note summarizes how these interactions look like on Instagram and opportunities we have to continue ensuring the safety of younger users.
14:41Dr. Diego Emiliano CastanedaI would add this sentence to the top of your note (with link to this work and if it's cool with comms) "In August 2020, a new metric (IG IIC) estimating prevalence of minor/adult sex talk conversations found that there were ~38x as many victims on IG Direct as on FB Messenger."
15:23████Since this data was shared to other open groups on workplace, I think that it is safe to include in the note. I'll include that.
15:29Dr. Diego Emiliano Castanedabtw.. here is the blurb I wrote for to summarize your research in the upcoming HPM. It had to be super short so I wasn't able to be as inclusive like in our own Well-being HPM. but do let me know if you want to change anything by commenting here. https://fb.quip.com/jRKpAeeW3rrR#bcLACAWX18M
15:32████This is great! Thanks Diego!