Meta & Children's Online SafetyNegative Experiences Survey - May 2019 Edition
Raw text
Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 1 of 22 AMENDED Exhibit 100 PLAINTIFFS' OMNIBUS OPPOSITION TO DEFENDANTS' MOTIONS FOR SUMMARY JUDGMENT Case No.: 4:22-md-03047-YGR MDL No. 3047 In Re: Social Media Adolescent Addiction/Personal Injury Products Liability Litigation Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 2 of 22 NEGATIVE EXPERIENCES SURVEY – MAY 2019 EDITION Shilpa Mody PENGAD 800-631-6989 EXHIBIT 2 Mata-mody 3.14.25 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 3 of 22 GOALS Get a current snapshot of peoples' perception of negative experiences on Instagram, and identify top problem areas. In particular, which negative experiences are perceived most commonly, and which are most intense? WHO WE ASKED Between 05/02-05/06, we surveyed 30k Instagram users with an in-app survey. From the top 8 Instagram countries by DAP (US, BR, IN, ID, TR, RU, JP, GB). Using a stratified sample by country (i.e. we surveyed more people from countries with higher DAP). People in India and Indonesia not asked about misinformation, due to proximity of elections. WHAT'S A NEGATIVE EXPERIENCE? We asked people about seeing or experiencing 14 different “negative experiences”, which covered many of the areas that the Well-Being team is working on (e.g. bullying and harassment, nudity and sexual content, inauthentic engagement, misinformation). The language we used in the questions *did not* map onto our classifiers or policies – we were aiming to measure subjectively bad experiences, whether or not they were policy-violating. For example, if someone feels that they were bullied, even if we wouldn't take down the content, we want to count that experience. 2 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 4 of 22 WHAT WE DID Sentiment (before asking about negative experiences) Satisfaction: Overall, how satisfied or dissatisfied are you with your Instagram experience? Safety: How safe do you feel on Instagram? Support: In your opinion, how much does Instagram support people when they have a problem on Instagram? Reach (each person asked about 5 out of 14 issues) Reach: In the past 7 days, have you... Follow-up (for one issue they had experienced) We'd like to hear more. Please think about your most recent experience seeing... Intensity: How upsetting was it when this happened? Surface: Where did you see... 3 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 5 of 22 WHAT WE DID Sentiment (before asking about negative experiences) Satisfaction: Overall, how satisfied or dissatisfied are you with your Instagram experience? Safety: How safe do you feel on Instagram? Support: In your opinion, how much does Instagram support people when they have a problem on Instagram? Reach (each person asked about 5 out of 14 issues) Reach: In the past 7 days, have you... Follow-up (for one issue they had experienced) We'd like to hear more. Please think about your most recent experience seeing... Intensity: How upsetting was it when this happened? Surface: Where did you see... bullying_seeing bullying_experiencing compromise_experiencing drugs suspicious_account firearms hate ie_experiencing misinformation nudity spam_commercial solicitation ssi violence 4 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 6 of 22 PERCEIVED REACH Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 7 of 22 PERCEIVED REACH Overall, the perceived reach of negative experiences on Instagram is quite high. Over half of respondents reported seeing a suspicious account in the last week. Other problems with high perceived reach are seeing commercial spam, experiencing inauthentic engagement, and seeing misinformation. In the past 7 days, have you... suspicious_account Percent saying "yes" for SEEING (darker bars) or EXPERIENCING (lighter bars) -57% ...seen any Instagram accounts that you feel were fake or suspicious? spam_commercial ie_experiencing misinformation nudity hate bullying_seeing violence solicitation ssi drugs bullying_experiencing compromise_experiencing firearms -33% -44% ...seen any advertising or sales on Instagram that seemed fake or suspicious, or that looked like spam? ...received any comments, likes, follows, or messages on Instagram -43% that seemed fake or suspicious, or that looked like spam? ...seen anything on Instagram that you feel was intended to spread false information? 29%... seen any nudity or sexual content that you feel doesn't belong on Instagram? -28% seen any hate speech or threats that you feel don't belong on Instagram? seen someone else being harassed or bullied on Instagram? 28% 23% seen any violent content that you feel doesn't belong on Instagram? 18% ...seen anyone on Instagram soliciting others for sexual activities? ...seen anyone on Instagram who you were worried might hurt themselves or commit 12% suicide, or who was encouraging others to hurt themselves or commit suicide? ...seen anyone on Instagram offering to sell recreational or prescription drugs, or promoting the use of recreational or prescription drugs? 9% 7% ...been bullied or harassed on Instagram? 5% ...has anyone accessed your Instagram account without your permission? 3% ...have you seen anyone on Instagram offering to sell guns? Note that we couldn't survey people who aren't on Instagram anymore, e.g. if their account was compromised and not recovered 6 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 8 of 22 PERCEIVED REACH: TEENS & ADULTS Overall, teens have significantly more negative experiences than adults. Perceived reach was higher among teens than adults for 12 out of the 14 problem areas that we asked about. Teens vs. Adults Statistically significant difference: (z-tests with Bonferroni correction * for multiple comparisons) * p<.05 ** = p < .01 *** = p < .001 suspicious_account spam_commercial ie_experiencing misinformation nudity hate bullying_seeing violence solicitation ssi 9% 12% drugs 8% 10% bullying_experiencing compromise_experiencing 6% 8% 4% 5% firearms 3% 16% 18% 21% 22% 60% 56% 46% 44% 42% 43% 36% 31% 32% 27% 32% 27% 31% 27% 28% *** *** *** *** *** *** *** *** *** *** *** 7 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 9 of 22 PERCEIVED REACH BY COUNTRY Suspicious accounts and commercial spam have high perceived reach in each of the countries we surveyed. The Top 3 problems are rounded out by inauthentic engagement in GB, IN, JP, RU, & US; misinformation in BR; nudity in TR, and hate in ID. Highlighted = Top 3 issues by perceived reach BR GB ID IN JP RU TR US suspicious_account 50% 59% 53% 52% 36% 54% 68% 67% spam_commercial 35% 49% 51% 37% -39% 53% 47% 47% ie_experiencing 31% 49% 36% 33% 38% 44% 36% 57% misinformation 37% 31% 16% 30% 40% 33% nudity 21% 23% 33% 32% 11% 26% 51% 27% hate 29% 23% 49% 25% 6% 22% 39% 25% bullying_seeing 23% -28% 49% 25% 8% 16% 35% 28% violence 17% 18% 39% 25% 9% 16% 43% 19% solicitation 13% 20% 17% 26% 5% +5% 20% 23% ssi 14% 11% 14% 11% -4% 6% 16% 12% drugs 5% 9% 23% 7% 1% +5% 11% 10% bullying_experiencing compromise_experiencing firearms 2% 6% 6% 10% 9% 1% -4% 9% 6% 3% +3% 10% 7% ㅏ 2% +3% 7% 4% + 2% -4% 4% 0% ㅏ 2% 5% 4% 8 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 10 of 22 INTENSITY Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 11 of 22 INTENSITY Seeing SSI content and seeing someone get bullied or harassed top the list in terms of intensity: more than half of people who've encountered these problems rate them as Very Bad Experiences. Experiencing bullying and having your account compromised are also particularly intense experiences. Percent rating as a Very Bad Experience How bad did this experience make you feel? (in top 2 intensity buckets: "Very bad" or "Pretty bad") For SEEING (darker bars) or EXPERIENCING (lighter bars) ssi 57% 57% 48% 47% 46% 46% 45% 45% 42% 34% 31% 28% 24% 20% bullying_seeing büllying_experiencing compromise_experiencing violence hate solicitation firearms nudity drugs misinformation spam_commercial suspicious_account ie_experiencing 10 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 12 of 22 INTENSITY: TEENS & ADULTS For most negative experiences, teens and adults reported similar levels of intensity. However, teens reported that their most recent experiences seeing hate speech, misinformation, and spam were less upsetting than adults. Teens vs. Adults ssi bullying_seeing bullying_experiencing compromise_experiencing violence hate solicitation firearms nudity drugs 22% misinformation spam_commercial 23% 31% 22% suspicious_account 26% 19% ie_experiencing 20% 56% 58% 56% 57% 45% 51% 50% 44% 45% 47% 40% 49% 46% 45% 32% 42% 42% 28% 38% 35% 55% Statistically significant difference: (z-tests with Bonferroni correction for multiple comparisons) * p<.05 ** = p < .01 *** = p < .001 *** ** 11 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 13 of 22 INTENSITY BY COUNTRY When we split out the results by country, there's significant variability in which issues people rate as most intense. However, seeing someone being bullied or harassed is in the Top 3 for every country. Highlighted = Top 3 issues by intensity Empty cells had < 10 responses BR GB ID IN JP RU TR US ssi 67% 59% 39% 55% 44% 67% 61% bullying_seeing bullying_experiencing compromise_experiencing 68% 65% 57% 51% 50% 45% 77% 46% 58% 54% 47% 40% 29% 81% 38% 54% 49% 34% 50% 60% 42% violence 45% 43% 39% 45% 65% 47% 56% 48% hate 53% 55% -40% 43% 33% 42% -57% 45% solicitation 44% 20% -51% 50% 73% 40% 66% 38% firearms 75% 42% 16% 48% 52% nudity 26% 29% -47% 45% 40% 43% 59% 36% drugs 29% 22% 46% 28% 44% 49% 22% misinformation -30% 19% 47% 28% 50% 26% spam_commercial 22% 22% 37% 31% 29% 34% 49% 19% suspicious_account 24% 15% 30% -27% 40% -20% ie_experiencing 21% 13% 20% 28% 28% -21% 41% 14% 12 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 14 of 22 REACH X INTENSITY Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 15 of 22 PERCEIVED REACH X INTENSITY When we plot intensity and perceived reach together, most negative experiences fall roughly along a line more intense experiences have lower reach, while less intense experiences have higher reach. However, there are a few outliers: SSI and seeing someone being bullied or harassed are particularly problematic, with high reach for how intense they are. Seeing drug sales and receiving inauthentic engagement are less problematic than other experiences. intensity 60 55 50 45 40 ssi bullying experiencing compromise_experiencing firearms 35 drugs 30 25 20 bullying_seeing violence hate solicitation nudity misinformation spam_commercial suspicious_account ie_experiencing 0 10 20 30 40 50 60 perceived_reach 14 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 16 of 22 PERCEIVED REACH X INTENSITY We can also combine reach and intensity into a single score by multiplying the percent of people who've had the problem and the percent of people who rate it as a Very Bad Experience. Seeing bullying, suspicious accounts, and hate speech generate the largest number of Very Bad Experiences. Perceived reach of Very Bad Experiences (Percent experiencing each problem) x (Percent rating it in top 2 intensity buckets) For SEEING (darker bars) or EXPERIENCING (lighter bars) bullying_seeing suspicious_account hate spam_commercial nudity violence 16% -14% -13% -13% -12% -11% misinformation 10% ie_experiencing 8% solicitation 8% ssi 7% bullying_experiencing 3% drugs 3% compromise_experiencing 2% Note that we couldn't survey people who aren't on Instagram anymore, e.g. if their account was compromised and not recovered firearms 1% 15 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 17 of 22 SURFACE Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 18 of 22 PERCEIVED REACH: SURFACE BREAKDOWN The most common surface for 9 out of 14 negative experiences is Explore. In addition, people most commonly encounter suspicious accounts when they're followed by them, see spam in Feed, see drug sales in Stories, and experience bullying and solicitation in Direct. Where did you see... spam_commercial וןיייווייי violence 34% 19% 10% 13% 11% 7% hate 28% 23% 8% 12% 10% 12% firearms 28% 13% 13% 7% 20% 10% misinformation 28% 13% 8% 19% 14% 8% 8% bullying_seeing 25% 21% 7% 13% 12% 6% 11% In Explore On a page I found through Search On a hashtag page nudity 24% 18% 11% 15% 10% 12% 8% drugs 24% 14% 9% 12% 25% 6% 7% 23% 15% 7% 16% 21% 6% 10% In my Feed In a story In a comment on one of my posts In a Direct Message Somewhere else 14% 11% 6% 31% 19% solicitation 14% bullying_experiencing 6% 8% 5% 12% 13% suspicious_account 9% 7% 5% 5% 22% 9% 18% 8% 10% 32% 9% 5% They followed me 10% 12% 40% 35% * We didn't ask this surface follow-up for experiencing a compromised account or inauthentic engagement 17 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 19 of 22 TOPLINE PERCEIVED REACH BY SURFACE Combining the surface and overall reach data, we can see that negative experiences on Explore and pages found through Search are quite variable, with no problem standing out as most common. In contrast, the most common negative experience in Feed and Stories is clearly spam, while suspicious accounts and solicitation are common problems via DM. Explore Search Hashtag page Feed Story Comment DM Other suspicious_account spam_commercial 5.2% 3.7% 2.6% 2.9% 1.8% 3.1% -12.5% 5.2% 6.2% 4.8% 2.8% 14% 8.5% 1.8% 4% 2.3% misinformation 9.1% 4.3% 2.6% 6.1% 4.4% 1.1% 2.5% 2.5% nudity 6.8% 5.2% 3.1% 4.4% 3% 0.5% 3.4% 2.3% hate 8% 6.6% 2.3% 3.4% 2.7% 1.2% + 1% 3.3% bullying_seeing 7.1% 5.9% 2.1% 3.5% 3.3% 1.3% 1.6% 3.1% violence 7.9% 4.3% 2.2% 3.1% 2.6% +0.6% 1% 1.6% solicitation 2.5% 3.1% +0.8% 1.4% 1.8% 0.7% 5.7% 1.9% ssi 2.6% 1.8% 0.8% 1.8% 2.5% 0.2% ㅏ 0.7% 1.2% drugs 2.2% 1.4% +0.8% 1.1% 2.4% 0.5% 0.3% ㅏ 0.7% bullying_experiencing 0.4% 0.6% 0.3% 0.3% +0.8% + 0.9% 2.7% + 0.8% firearms 0.9% 0.4% 0.4% • 0.2% ㅏ0.7% 0.1% 0.2% 0.3% * We didn't ask this surface follow-up for experiencing a compromised account or inauthentic engagement 18 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 20 of 22 INTENSITY BY SURFACE When we split out the intensity data by surface, there's significant variability in which issues people most commonly rate as Very Bad Experiences. However, seeing SSI content and seeing someone being bullied or harassed are in the Top 3 for most surfaces. Highlighted = Top 3 issues by intensity Empty cells had < 10 responses Explore Search Hashtag page Feed Story Comment DM Other ssi 66% 46% 59% 70% 53% 69% 56% bullying_seeing 61% 57% 56% 70% 58% 49% 51% 54% bullying_experiencing 69% 44% 36% 40% 48% 32% 52% 40% violence 49% 44% 51% 49% 45% 57% 38% 55% hate 48% 47% 55% 49% 41% 50% 41% 49% solicitation 47% 47% 48% 56% 51% 42% 42% 42% firearms 52% 55% 27% 62% nudity 44% 40% 45% 31% 57% 45% 43% 44% drugs 35% 37% 33% 27% 29% 26% 60% 40% misinformation 32% 42% 29% 32% 31% 27% 32% 34% spam_commercial 28% 32% 34% 29% 29% 30% 23% 32% suspicious_account 25% 28% 28% 29% 34% 30% 23% 32% * We didn't ask this surface follow-up for experiencing a compromised account or inauthentic engagement 19 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 21 of 22 TL;DR Perceived reach: Overall, the perceived reach of negative experiences on Instagram is quite high. 1 Over one-third of survey respondents said they'd encountered suspicious accounts, commercial spam, inauthentic engagement, and misinformation in the last week. 2 Intensity: More than half of people who've seen SSI content or someone being bullied rated it as a Very Bad Experience. Experiencing bullying and having your account compromised are also particularly intense. Putting them together: In general, more intense experiences have lower reach, while less intense 3 experiences have higher reach. Seeing bullying, suspicious accounts, and hate speech generate the largest number of Very Bad Experiences. Surface: The most common surface for 9 out of 14 negative experiences is Explore. In addition, people most 4 commonly encounter suspicious accounts when they're followed by them, see spam in Feed, see drug sales in Stories, and experience bullying and solicitation in Direct. 20 Case 4:22-md-03047-YGR Document 2885-36 Filed 03/26/26 Page 22 of 22 21