"It struck me that the bottom line is that IG is violating our policies — not users! IG is choosing to display images in a violating way for any policy area where the caption matters. We have to build a system of labeling images as 'caption-dependent' for topics like hate, violence, bullying, SSI so that we can avoid search results."

Internal document
Monika Bickert: "Yes, the policies are that we allow cries for help (often called admission or ideation) but don't allow celebration or encouragement of self-harm. It's a tough but very important line to maintain so people can get help. As you likely know, we've seen lives saved when they've been able to post cries for help on our services, and experts say that removing such posts could be the final straw that could cause someone to harm herself or himself." Monika Bickert: "Just want you guys to see email I sent. PLEASE DO NOT FORWARD. It struck me that the bottom line is that IG is violating our policies — not users! IG is choosing to display images in a violating way for any policy area where the caption matters. We have to build a system of labeling images as 'caption-dependent' for topics like hate, violence, bullying, SSI so that we can avoid search results." ████: "On that point, recommendation IG is looking into asap is leveraging content CO has identified as either admission or promotion, and using it as a signal to identify the related hashtags – then restricting those hashtags in one of two ways: • For high confidence that hashtags are being used for this SSI content, the hashtag will be blocked (content will not appear when hashtag is searched). • For lower confidence matching, show SSI resources to folks searching for that. Longer term we may be able to further refine this one to also only show some of the media."