Meta & Children's Online SafetySuicide & Self-Injury on Instagram: Proactive Risk Investigation
Raw text
Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 1 of 44 AMENDED Exhibit 182 PLAINTIFFS' OMNIBUS OPPOSITION TO DEFENDANTS' MOTIONS FOR SUMMARY JUDGMENT Case No.: 4:22-md-03047-YGR MDL No. 3047 In Re: Social Media Adolescent Addiction/Personal Injury Products Liability Litigation Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 2 of 44 Suicide & Self-Injury on Instagram Proactive Risk Investigation April 26, 2019 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068863 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 3 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068864 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 4 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068865 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 5 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068866 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 6 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068867 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 7 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068868 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 8 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068869 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 9 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068870 Document 2757-8 Filed 02/20/26 Page 10 of 44 Case 4:22-md-03047-YGR IG User Reporting Flow vodafone IE 1:57 PM 764% vodafone IE 1:57 PM 764% Report Cancel < Report Cancel Choose a reason for reporting this post: I just don't like it > Nudity or pornography > Hate speech or symbols > Racist, homophobic or sexist slurs It's Spam Violence or threat of violence It's Inappropriate Graphic injury, unlawful activity, dangerous or criminal organizations > Report as self injury? We remove posts encouraging or promoting self injury, which includes suicide, cutting and eating disorders. We may also remove posts identifying victims of self injury if the post attacks or makes fun of them. If you report someone's post, Instagram doesn't tell them who reported it. Report Block mismimy_official if you don't want them to see your photos or videos or find you on Instagram. Thanks for reporting this post Your feedback is important in helping us keep the Instagram community safe. Cancel Sale or promotion of firearms > Block Sale or promotion of drugs > Harassment or bullying > If someone is in immediate danger, call local emergency services. Don't wait. Intellectual property violation Copyright or trademark infringement > HIGHLY CONFIDENTIAL (COMPETITOR) Self injury > Eating disorders, cutting or promoting suicide Show Post 9 X META3047MDL-003-00068871 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 11 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068872 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 12 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068873 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 13 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068874 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 14 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068875 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 15 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068876 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 16 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068877 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 17 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068878 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 18 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068879 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 19 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068880 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 20 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068881 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 21 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068882 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 22 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068883 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 23 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068884 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 24 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068885 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 25 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068886 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 26 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068887 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 27 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068888 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 28 of 44 Exposure to Self Injury (SSI) by Surface & Product Most views occur on Home Feed and Explore grid, followed by Profile and Hashtags. Select a Surface explore Suicide & Self-Injury surface Violation DAP Exposed (28d avg) Impressions (28d avg) DAP Exposed (7d delay) Products within selected surface Current DAP Exposed As of 2019-04-07 product surface DAP Exposed (28d avg) Impressions (28d avg) 405.76K home Suicide & Self-Injury 339,300.00 348,278.00 grid 1 M explore Suicide & Self-Injury 315,629.00 357,723.00 +192.34% d/d +218.80% w/w +590.11% m/m 206,052.00 immersive_viewer explore 63,157.00 explore 217,867.00 64,986.00 feed explore 54,594.00 55,137.00 500 K video_chaining explore 16,786.00 17,041.00 profile Suicide & Self-Injury 22,390.00 20,713.00 peek explore 2,662.00 2,675.00 stories explore 5.00 5.00 hashtags Suicide & Self-Injury 7,146.00 8,712.00 0 Jan '19 Mar '19 unknown explore 1.00 1.00 unknown Suicide & Self-Injury 6,501.00 6,711.00 other Suicide & Self-Injury 5,269.00 5,793.00 saved Suicide & Self-Injury 1,164.00 1,174.00 igtv Suicide & Self-Injury 666.00 667.00 activity Suicide & Self-Injury 475.00 478.00 direct Suicide & Self-Injury 336.00 353.00 HIGHLY CONFIDENTIAL (COMPETITOR) 27 META3047MDL-003-00068889 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 29 of 44 Problem Summary Problem Leading users to distressing content Resulting Risk Encountering similar incidents like Molly Russell Work in Progress Automated Hashtag Tiering to expand to SSI Seeking external opinion of sad content HIGHLY CONFIDENTIAL (COMPETITOR) 28 META3047MDL-003-00068890 Risk Areas Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 30 of 44 Are we preventing harmful suicide and self Injury related content from reaching the users? Are we removing harmful suicide and self Injury related content that can lead others to engage in similar behavior? Are we providing resources to those admitting to engage in suicide/self-injury? SSI Personas Test HIGHLY CONFIDENTIAL (COMPETITOR) Detection Test Graphic Admission 29 META3047MDL-003-00068891 HIGHLY CONFIDENTIAL (COMPETITOR) Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 31 of 44 Detection Test 30 META3047MDL-003-00068892 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 32 of 44 Detection Test HIGHLY CONFIDENTIAL (COMPETITOR) • • • We sourced suicide and self-injury admission content from an external partner We observed reporting systems - user reports and the interaction of our suicide and self-injury admission classifier on the content Hypothesis: We would not provide resources to any users or delete violating content as we expected neither user nor proactive reports on them 31 META3047MDL-003-00068893 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 33 of 44 Suicide & Self-Injury Admission Classifier Content Upload (EN_US only) Classifier score = .945 and higher HIGHLY CONFIDENTIAL (COMPETITOR) Enqueued for rep review Actioned or Ignored by Rep 32 META3047MDL-003-00068894 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 34 of 44 Problem #1 - Detection Test Problem Proximate We did not provide resources to users who posted suicide or self-injury admission content or resources were provided late Content was neither user reported nor proactively enqueued We had to rely on user reports as content was not proactively enqueued HIGHLY CONFIDENTIAL (COMPETITOR) Intermediate Root Cause Content was neither user reported nor proactively enqueued Pending scores on suicide classifier Violating content scored significantly lower than the established threshold Enforcement 4.b.ii (Unintended issue) Currently, we are keeping thresholds high to keep volumes low due to the resource constraints on the number of reviewers we have to review proactively reported content Enforcement 4.b.i (tradeoff) 35 META3047MDL-003-00068895 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 35 of 44 Problem #3 & #4 - Detection Test SUICIDE Classifier Goals (Rolling 7 days Avg) IG Enqueue Volume Content Enqueued 3.75K Goal: 3.00 K IG Action Rate K As of 2019-04-24 As of 2019-04-24 89.55% Goal: 70.00% -0.20% d/d 50% +0.52% d/d 2.5 K -3.59% w/w -3.15% w/w +5.56% m/m -11.63% m/m +19.55 goal A +745.29 goal A 0 +27.92% goal A(%) 0% +24.84% goal A(%) 25. Feb 11. Mar 25. Mar 8. Apr 22. Apr 25. Feb 11. Mar 25. Mar 8. Apr 22. Apr IG Enqueue Volume Content Enqueued 4 K 3.73K SELF INJURY Classifier Goals (Rolling 7 days Avg) As of 2019-04-24 IG Action Rate 86.90% As of 2019-04-24 Goal: 70.00% Goal: 885.00 +0.37% d/d 50% +0.46% d/d 2 K +3.65% w/w +122.83% m/m +2.84 K goal A +321.28% goal A(%) +1.19% w/w +57.52% m/m +16.90 goal A 0 +24.15% goal A(%) 0% 25. Feb 11. Mar 25. Mar 8. Apr 22. Apr 25. Feb 11. Mar 25. Mar 8. Apr 22. Apr HIGHLY CONFIDENTIAL (COMPETITOR) 36 META3047MDL-003-00068896 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 36 of 44 Problem Summary Problem Not providing resources to users at all or on time Resulting Risk Increased risk of imminent harm Work in Progress Classifier work expanding to cover markets in Q2 Resource expansion for NA being discussed HIGHLY CONFIDENTIAL (COMPETITOR) 37 META3047MDL-003-00068897 Risk Areas Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 37 of 44 Are we preventing harmful suicide and self Injury related content from reaching the users? Are we removing harmful suicide and self Injury related content that can lead others to engage in similar behavior? Are we providing resources to those admitting to engage in suicide/self-injury? SSI Personas Test HIGHLY CONFIDENTIAL (COMPETITOR) Detection Test Graphic Admission 38 META3047MDL-003-00068898 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 38 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068899 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 39 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068900 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 40 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068901 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 41 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068902 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 42 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068903 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 43 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068904 Case 4:22-md-03047-YGR Document 2757-8 Filed 02/20/26 Page 44 of 44 HIGHLY CONFIDENTIAL (COMPETITOR) META3047MDL-003-00068905