Meta & Children's Online SafetyNegative Experiences Survey - Oct 2019 Edition
Raw text
Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 1 of 22 AMENDED Exhibit 101 PLAINTIFFS' OMNIBUS OPPOSITION TO DEFENDANTS' MOTIONS FOR SUMMARY JUDGMENT Case No.: 4:22-md-03047-YGR MDL No. 3047 In Re: Social Media Adolescent Addiction/Personal Injury Products Liability Litigation Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 2 of 22 3.14.25 NEGATIVE EXPERIENCES SURVEY - OCT 2019 EDITION Shilpa Mody PENGAD 800-631-6989 EXHIBIT 3 Meta-mody Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 3 of 22 GOALS Get a current snapshot of peoples' perception of negative experiences on Instagram, and identify top problem areas. In particular, which negative experiences are perceived most commonly, and which are most intense? WHO WE ASKED . Between 10/24-10/30, we surveyed 30k Instagram users with an in-app survey. From the top 8 Instagram countries by DAP, except Russia (US, BR, IN, ID, TR, JP, GB, MX). Using a stratified sample by country (i.e. we surveyed more people from countries with higher DAP). WHAT'S A NEGATIVE EXPERIENCE? We asked people about seeing or experiencing 18 different "negative experiences", which covered many of the areas that the Well-Being team is working on (e.g. bullying and harassment, nudity and sexual content, inauthentic engagement, misinformation). The language we used in the questions *did not* map onto our classifiers or policies - we were aiming to measure subjectively bad experiences, whether or not they were policy-violating. For example, if someone feels that they were bullied, even if we wouldn't take down the content, we want to count that experience. 2 WHAT WE DID Sentiment (before asking about negative experiences) Satisfaction: Overall, how satisfied or dissatisfied are you with your Instagram experience? Safety: How safe do you feel on Instagram? Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 4 of 22 Reach (each person asked about 6 out of 18 issues) Follow-up (for one issue they had experienced) Reach: In the past 7 days, have you... We'd like to hear more. Please think about your most recent experience seeing... Intensity: How upsetting was it when this happened? Surface: Where did you see... Support: How much did you feel supported by Instagram when this happened? Reporting: Did you report this problem to Instagram? 3 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 5 of 22 WHAT WE DID Sentiment (before asking about negative experiences) Reach (each person asked about 6 out of 18 issues) Follow-up (for one issue they had experienced) Satisfaction: Overall, how satisfied or dissatisfied are you with your Instagram experience? Safety: How safe do you feel on Instagram? Reach: In the past 7 days, have you... We'd like to hear more. Please think about your most recent experience seeing... Intensity: How upsetting was it when this happened? Surface: Where did you see... Support: How much did you feel supported by Instagram when this happened? Reporting: Did you report this problem to Instagram? bullying_seeing bullying_experiencing child_safety compromise_experiencing drugs eating_disorder firearms hate ie_experiencing misinformation ncii nudity spam_commercial solicitation suspicious_account ssi terrorism violence 4 PERCEIVED REACH Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 6 of 22 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 7 of 22 PERCEIVED REACH Overall, the perceived reach of negative experiences on Instagram is quite high. Almost half of respondents reported seeing a suspicious account or commercial spam in the last week. Other problems with high perceived reach are seeing misinformation and experiencing inauthentic engagement. suspicious_account spam_commercial misinformation ie_experiencing bullying_seeing hate In the past 7 days, have you... Percent saying "yes" for SEEING (darker bars) or EXPERIENCING (lighter bars) ...seen any Instagram accounts that seemed fake, hacked, or suspicious? 44% 44% ...seen any advertising or sales on Instagram that seemed fake or suspicious, or that looked like spam? 33% ...seen anything on Instagram that you feel was intended to spread false information? 32% ...received any comments, likes, follows, or messages on Instagram that seemed fake or suspicious? seen someone else being harassed or bullied on Instagram? 28% 25% seen any hate speech or threats that you feel don't belong on Instagram? 23% seen any nudity or sexual content that you feel doesn't belong on Instagram? - 21% 19% nudity violence child_safety eating_disorder solicitation ncii ssi drugs bullying_experiencing terrorism compromise_experiencing firearms seen any violent content that you feel doesn't belong on Instagram? seen anything on Instagram that made you worried that a child was unsafe? 18% seen anyone on Instagram who was promoting eating disorders or unhealthy weight loss? 17%...seen anyone on Instagram trying to buy or sell sexual activity or services? 14% ...seen any nudity or sexual content on Instagram that you were worried was shared without the person's permission? 12%...seen anyone on Instagram who you were worried might hurt themselves or commit suicide? 9%...seen anyone on Instagram offering to sell drugs, or promoting drug use? 8%...been bullied or harassed on Instagram? 7% ...seen anything on Instagram that promoted terrorist organizations or terrorism? 6% ...has anyone accessed your Instagram account without your permission? 3% ...have you seen anyone on Instagram offering to sell guns? Note that we couldn't survey people who aren't on Instagram anymore, e.g. if their account was compromised and not recovered 6 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 8 of 22 PERCEIVED REACH: TEENS & ADULTS Overall, teens have significantly more negative experiences than adults. Perceived reach was higher among teens than adults for 11 out of the 18 problem areas that we asked about. Teens vs. Adults 49% *** suspicious_account Statistically significant difference: (z-tests with Bonferroni correction for multiple comparisons) * = p < .05 ** = p < .01 *** = p < .001 42% 45% spam_commercial 43% 35% misinformation 32% 33% ie_experiencing 32% 30% bullying_seeing 27% 27% hate 24% 26% *** nudity 21% 24% *** violence 19% 22% *** child_safety 17% 18% eating_disorder 18% 21% *** solicitation 16% 17% *** ncii 13% 17% *** ssi 10% 13% drugs 8% 9% *** ** bullying_experiencing 7% 8% terrorism 6% 8% *** compromise_experiencing 5% 4% *** firearms 3% 7 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 9 of 22 PERCEIVED REACH BY COUNTRY Suspicious accounts and commercial spam have high perceived reach in each of the countries we surveyed. The Top 3 problems are rounded out by inauthentic engagement in GB, JP, MX, & US; misinformation in ID & IN; nudity in TR, and seeing bullying in BR. Highlighted = Top 3 issues by perceived reach BR GB ID IN JP MX TR US suspicious_account 39% 43% 46% 46% 22% 43% -48% 50% spam_commercial 42% -42% -50% - 37% 39% 37% 50% 47% misinformation - 38% -28% 45% -30% 19% -22% -40% 32% ie_experiencing -23% +34% -30% -26% -25% 39% -35% 42% bullying_seeing 41% -21% -43% -20% 9% -18% -32% 23% hate -33% -24% -38% -22% -4% 16% -31% 21% nudity 16% -20% -26% -26% - 13% -16% -41% 22% violence 19% 16% -35% 20% -7% 12% -41% 15% child_safety - 22% 11% -35% -20% -10% 14% -27% 11% eating_disorder 13% -20% -23% - 22% - 8% -17% -33% 15% solicitation 9% -20% 16% - 22% 10% 15% - 26% 19% ncii 7% 11% 24% 18% 7% 10% -22% 12% ssi 18% 11% 13% 10% -4% 10% -13% 10% drugs 8% 11% 9% 7% +2% 9% +5% 14% bullying_experiencing 8% 8% 12% 8% + 3% -4% 11% 7% terrorism 3% + 3% 8% 7% 1% - 5% -28% 4% compromise_experiencing 4% - 3% 10% 9% + 2% - 2% 10% 3% firearms 2% + 2% + 3% + 4% 0% +1% 6% 3% 08 INTENSITY Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 10 of 22 Case 4:22-md-03047-YGR INTENSITY Seeing someone get bullied or harassed, seeing terrorist content, and seeing SSI content top the list in terms of intensity: more than half of people who've encountered these problems rate them as Very Bad Experiences. How bad did this experience make you feel? Percent rating as a Very Bad Experience (in top 2 intensity buckets: "Very bad" or "Pretty bad") For SEEING (darker bars) or EXPERIENCING (lighter bars) bullying_seeing terrorism ssi compromise_experiencing child_safety hate bullying_experiencing violence ncii nudity solicitation firearms eating_disorder misinformation suspicious_account drugs spam_commercial ie_experiencing 60% 56% 50% 45% 45% 44% 43% 40% 39% 39% 35% 34% 34% 31% 30% 27% 26% 22% Document 2872-4 Filed 03/25/26 Page 11 of 22 10 INTENSITY: TEENS & ADULTS We didn't detect any significant differences in how intense teens and adults rated each issue. bullying_seeing Teens vs. Adults Statistically significant difference: (z-tests with Bonferroni correction for multiple comparisons) terrorism ssi compromise_experiencing child_safety hate bullying_experiencing violence ncii nudity solicitation firearms eating_disorder misinformation suspicious_account drugs spam_commercial ie_experiencing 55% 62% 43% 62% 46% 53% 44% 45% 53% 41% 41% 45% 46% 42% 38% 41% 39% 39% 35% 41% 33% 35% 30% 37% 30% 35% 26% 34% 26% 32% 19% 32% 23% 28% 18% 23% * = p < .05 ** = p < .01 *** = p < .001 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 12 of 22 11 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 13 of 22 INTENSITY BY COUNTRY When we split out the results by country, there's significant variability in which issues people rate as most intense. However, seeing someone being bullied or harassed is in the Top 3 for every country. Empty cells had < 10 responses Highlighted = Top 3 issues by intensity BR GB bullying_seeing -77% 47% ID -47% IN 45% JP 61% terrorism 62% 38% 46% ssi -59% 44% -50% -55% 33% MX 60% 30% 22% TR US 68% -52% -69% 50% 59% 45% compromise_experiencing -58% 38% -45% 46% 35% child_safety -55% 46% -21% -42% 18% 29% -61% -61% hate -52% 42% -34% -34% 55% 47% -51% -42% bullying_experiencing -62% -37% -41% -42% 8% -50% -34% violence 42% 37% -35% -35% 32% 27% -55% -38% ncii 44% 39% -36% -39% 31% 44% -46% -35% nudity -35% -35% -40% -37% -38% 44% -53% -33% solicitation -25% -27% -34% -44% -25% 35% -51% -29% firearms 20% 17% 40% 77% 15% eating_disorder misinformation suspicious_account drugs spam_commercial ie_experiencing -43% 40% -24% -33% 35% 29% -35% -34% -39% 33% -31% -31% -30% -19% -33% -34% -27% -36% 16% -44% -25% -29% -52% -22% 31% 18% 48% -34% 29% 36% -19% -20% 23% -31% -31% 33% 21% -46% -20% 17% -10% -27% -25% 33% -22% -42% -16% 12 REACH X INTENSITY Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 14 of 22 PERCEIVED REACH X INTENSITY When we plot intensity and perceived reach together, most negative experiences fall roughly along a line – more intense experiences have lower reach, while less intense experiences have higher reach. However, there are a few outliers: SSI, terrorism, and seeing someone being bullied or harassed are particularly problematic, with high reach for how intense they are. Seeing drug or firearm sales and receiving inauthentic engagement are less problematic than other experiences. 60 terrorism 55 50 ssi bullying_seeing 45 compromise_experiencing child_safety bullying_experiencing violence intensity 40 ncii 35 solicitation firearms 30 25 drugs hate nudity eating_disorder misinformation suspicious_account spam_commercial. 20 ie_experiencing 0 10 20 30 40 50 60 perceived_reach Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 15 of 22 14 Case 4:22-md-03047-YGR PERCEIVED REACH X INTENSITY We can also combine reach and intensity into a single score by multiplying the percent of people who've had the problem and the percent of people who rate it as a Very Bad Experience. Seeing bullying generates the largest number of Very Bad Experiences. Document 2872-4 Filed 03/25/26 Page 16 of 22 15 Perceived reach of Very Bad Experiences (Percent experiencing each problem) x (Percent rating it in top 2 intensity buckets) For SEEING (darker bars) or EXPERIENCING (lighter bars) bullying_seeing suspicious_account spam_commercial hate misinformation nudity child_safety violence ie_experiencing eating_disorder -17% -13% -12% -11% -10% 9% 8% 8% 7% 6% solicitation ssi ncii terrorism 6% 6% 5% 4% bullying_experiencing compromise_experiencing 3% 3% drugs 3% Note that we couldn't survey people who aren't on Instagram anymore, e.g. if their account was compromised and not recovered firearms 1% SURFACE Case 4:22-md-03047-YGR Document 2872.4 Filed 02/25/26 Page 17 of 22 J PERCEIVED REACH: SURFACE BREAKDOWN Explore and Profile are each the most common surface for 5 out of 16 negative experiences. In addition, Direct is the most common surface to encounter suspicious accounts, and to experience bullying and solicitation. People most commonly see drug sales and SSI in Stories, and see spam in Feed. Where did you see... Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 18 of 22 eating_disorder 29% 17% 7% 14% 18% 12% terrorism 29% 13% 13% 5% 13% 22% misinformation 28% 15% 9% 11% 14% 5% 16% child_safety 26% 16% 8% 7% 21% 16% violence 26% 21% 11% 10% 14% 12% In Explore hate 21% 27% 9% 6% 11% 19% On someone's Profile ncii 20% 21% 7% 9% 11% 17% 14% On a hashtag page firearms 18% 22% 8% 6% 14% 26% In my Feed nudity 17% 29% 10% 9% 9% 13% 12% drugs 17% 17% 6% 11% 35% 10% bullying_seeing 16% 27% 6% 9% 19% 15% ssi 14% 18% 7% 9% 29% 5% 17% In a story In a comment on one of my posts In a Direct Message Somewhere else They followed me spam_commercial 14% 9% 7% 28% 19% 8% 13% solicitation 11% 17% 6% 5% 10% 37% 12% bullying_experiencing 6% 10% 9% 12% 37% 23% suspicious_account 8% 16% 27% 20% 17% * We didn't ask this surface follow-up for experiencing a compromised account or inauthentic engagement 17 TOPLINE PERCEIVED REACH BY SURFACE Combining the surface and overall reach data, we can see that negative experiences on Explore and Profile are quite variable, with no problem standing out as most common. In contrast, the most common negative experience in Feed is clearly spam, while suspicious accounts and solicitation are common problems via DM. Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 19 of 22 Explore Profile Hashtag page Feed Story Comment DM Other suspicious_account 3.3% 6.9% 1.8% 1.9% 1.4% spam_commercial 6% 4% 3% -12.1% 8.5% + 0.9% -1.2% -11.8% 8.6% 3.7% 5.5% misinformation -9.2% 5% 2.8% 3.8% 4.5% + 0.8% 1.7% 5.3% bullying_seeing 4.5% 7.6% 1.7% 2.6% - 5.3% -0.9% 1.1% -4.1% hate 5.2% -6.8% 2.2% 1.4% +2.9% + 0.8% + 1% 4.7% nudity 3.8% -6.6% - 2.3% 2% +2% • 0.3% 3% 2.6% violence 5.4% 4.3% 2.2% 2.1% 2.9% 0.3% + 0.8% 2.6% child_safety 4.8% 3% +1.5% -1.4% - 3.9% 0.5% + 0.6% 2.9% eating_disorder 5.4% 3% 1.2% 2.5% 3.3% • 0.3% 0.3% 2.2% solicitation 1.8% 3% 1% + 0.9% 1.7% 0.3% - 6.5% 2.1% ncii 2.8% 3% 1% 1.2% +1.5% • 0.2% 2.4% 1.9% ssi 1.7% 2.1% + 0.8% 1.1% - 3.4% • 0.1% + 0.6% 2% drugs 1.6% -1.6% ㅏ 0.6% +1% - 3.3% • 0.1% • 0.3% + 0.9% bullying_experiencing 0.5% + 0.8% • 0.2% • 0.1% + 0.7% + 0.9% - 2.9% 1.8% terrorism 1.9% + 0.9% + 0.8% +0.4% + 0.8% • 0.2% • 0.2% 1.5% firearms 0.5% ㅏ 0.7% 0.2% 0.2% 0.4% • 0.1% • 0.1% ㅏ 0.8% * We didn't ask this surface follow-up for experiencing a compromised account or inauthentic engagement 18 Case 4:22-md-03047-YGR INTENSITY BY SURFACE When we split out the intensity data by surface, there's significant variability in which issues people most commonly rate as Very Bad Experiences. However, seeing someone being bullied or harassed is in the Top 3 for every surface. Highlighted = Top 3 issues by intensity Empty cells had < 10 responses Document 2872-4 Filed 03/25/26 Page 20 of 22 Explore Profile Hashtag page Feed Story Comment DM Other bullying_seeing 61% 60% 62% 58% 66% 57% 61% 52% terrorism 73% 67% 65% 50% 43% 35% ssi 49% 58% 50% 46% 53% 43% 49% child_safety 45% 48% 42% 58% 55% 57% 47% -28% hate 40% 49% 57% 46% -49% 39% 41% -36% bullying_experiencing 33% 38% 42% 43% -48% 47% violence 43% -42% 41% 38% 49% 42% 25% 31% ncii 43% - 40% 55% 23% 41% 42% 31% nudity 46% -39% 51% 20% -31% 33% 42% -37% solicitation 39% -31% 56% 21% 27% 38% -37% 30% firearms 43% 24% 55% 20% eating_disorder -33% -41% 36% 41% 33% misinformation suspicious_account spam_commercial 32% -37% 38% 23% - 36% 35% - 29% 37% 38% -29% 40% 30% 31% 31% 20% 33% 25% 28% 32% drugs 26% 19% 58% 21% 23% 40% 37% 30% 25% 24% 22% 29% 34% 34% 26% * We didn't ask this surface follow-up for experiencing a compromised account or inauthentic engagement 19 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 21 of 22 TL;DR Perceived reach: Overall, the perceived reach of negative experiences on Instagram is quite high. Almost 1 half of respondents reported seeing a suspicious account or commercial spam in the last week; seeing misinformation and experiencing inauthentic engagement are also common. Intensity: Seeing someone get bullied or harassed, seeing terrorist content, and seeing SSI content top the 2 list in terms of intensity: more than half of people who've encountered these problems rate them as Very Bad Experiences. Putting them together: In general, more intense experiences have lower reach, while less intense 3 experiences have higher reach. SSI, terrorism, and seeing someone being bullied or harassed are particularly problematic, with high reach for how intense they are. Surface: Explore and Profile are each the most common surface for 5 out of 16 negative experiences. In 4 addition, Direct is the most common surface to encounter suspicious accounts, and to experience bullying and solicitation. People most commonly see drug sales and SSI in Stories, and see spam in Feed. 20 Case 4:22-md-03047-YGR Document 2872-4 Filed 03/25/26 Page 22 of 22 2