"You'd think we JUST started working on integrity with issues like this one"

Melissa ████: "I'm not surprised we have bad hashtags. our search safety team is a few employees who look at a list of popular hashtags every week to decide which to filter out :( it's super low tech… We also do very little to make sure handles are appropriate which is so creepy and problematic… The fact that we recommended the pedo account that activist viewed once to all her followers is really disappointing" Melissa ████: "Content moderators not enforcing the rules is such a big problem. Could be the biggest problem on right now" Melissa ████: "It's a really big problem that you view one media and then we start recommending many like it. we gotta solve the rabbit hole issue" Melissa ████: "We think rater recall could be as low as 50%, and the non-rec labelers only know English ... they label 0 media/week as hate speech, bullying, or suicide and self injury even though we know the prevalence is higher. and they frequently get easier topics wrong that don't require language comprehension, like disturbing content" Tomas Kabbabe: "You'd think we JUST started working on integrity with issues like this one" Tomas Kabbabe: "[I]t feels like we're so behind where we should be" Melissa ████: "I mean you see the chaos of the way products are shipped at Meta… We don't do comprehensive, holistic overviews often enough… We don't hold enough people responsible for metric monitoring. we only staff teams when we want to build, not maintain… the central integrity org is pivoting to focus on "voice" aka false positives and overenforcement. Their other big new focus is "integrity value": trying to justify how integrity work adds value to the business. as a result, they've stopped investing in SWOPSWOPSeverity Weighted Overall PrevalenceSWOP = Prevalence * Severity. A severity-weighted metric for the prevalence of harmful content/experiences.Full entry ↗, which is our Meta metric for content violations! Melissa ████: "integrity is an adversarial space. there's millions of people who will profit from finding ways to exploit it, so they're always trying. product teams change the way things work all the time and don't move in lockstep with integrity" Melissa ████: "and there's just SO MANY TYPES OF HARM. it's hard to think of all of them for everything always. just because there's no harm on an issue type or surface today doesn't mean there won't be harm on hashtags tomorrow, so someone makes the call that it's not a priority and then boom, things evolve" Melissa ████: "and non-rec is owned and operated by the small team on RI, so we don't benefit from Meta's best practices on making sure raters actually label the violating content as violating"