"Teens are the target audience for Reels, but we have limited knowledge, tech, and tools to keep them safe."

"TLDR: The Reels ecosystem makes it more vulnerable to integrity challenges" "1 There are multiple Reels teams launching a high volume of product improvements, leading to increases in sexually suggestive and objectionable content." "2 The focus on entertainment / mimicry, and the teen audience leaves Reels more open to 1) sexually suggestive and offensive content and 2) vulnerability of younger people. Reels teams should build user-centered tools (audience controls, recommendation feedback) and preventive mechanisms (i.e., tuning ranking models, protections for minors) to keep users safe." "3 Teens, women, LGBT people, and communities of color are more vulnerable to harm and marginalization on IG. Early research suggests these inequitable patterns are reproduced on Reels." "There are multiple (15+) teams working on Reels launching a high volume of product improvements (100+ on 2021 H1). This product pace and complexity is leading to greater volatility in integrity, especially increases in sexually suggestive content." "We have less sophisticated knowledge + tools for empowering users to address harm" "Subsurfaces on Reels have different integrity challenges. Example: increases in objectionable content promoted by our ranking models result in bigger spikes especially on Reels Cover and In-Feed Unit (RIFU)." "System for identifying harmful content in Reels is harder than other content review systems. Systems for identifying harmful content in short form videos works less well compared to images and text, takes longer, and is harder to judge/less accurate." "Less is known about what, how, and why certain kinds of integrity challenges come with the surface. For example, while the child safety team has done extensive work to improve child safety generally across IG, Reels is not yet a focus. This is concerning, given much of Reels (and TikTok) came from viral dance trends consumed and created by teens and kids." "Ranking models cause integrity regressions by increasing the prevalence of non-recommendable content. Increasing topic diversity increased all objectionable content, and recommending based on P(click), Mimicry, and downranking watermarked media increased the prevalence of sexually suggestive content." "Trends, Entertainment, and Mimicry can lead to harm. Risky trends (i.e., the TikTok WAP trend for teens or trends mocking disabilities) may leave people open to harm, ranging from seeing harmful content to bullying or predatory behaviors. Offensive content (hate speech, violence, bullying) may also be delivered under the guise of "entertainment" at higher rates on Reels." "Unconnected dancing videos featuring young girls raise safety concerns. Studies and internal feedback suggests that people are uncomfortable with seeing and concerned about the safety of unconnected Reels content of tween and young girls dancing and posing." "Teens are the target audience for Reels, but we have limited knowledge, tech, and tools to keep them safe." "Teens don't think deeply about safety risks until something bad happens."