Meta discovered a video-matching technology used across child safety collaborations had not actually worked on Instagram for years

Paniz ████: "I'm writing to enlist some urgent support from IG to mitigate legal and legitimacy risks we're facing in the Adult Sexual Exploitation, Child Safety and Terrorism space. Context: Adult Sexual Exploitation (StopNCII.org), Child Safety (NCMEC) and Terrorism (GIFCT) space are all problem areas which participate in cross-industry hash-sharing collaborations. All three arrangements involve Meta receiving hashes from an external body (e.g. NCMEC), which we can use internally to match and remove violating content. We use PDQ as the hashing algorithm for photos and MD5 for videos. The problem: All three collaborations were launched with the assumption that MD5, the form of hash used for videos, can be matched on IG. We realised this wasn't the case only in ~January 2022, despite some of these collaborations having been running for years. While the root cause is a feature gap, rather than broken systems, we raised S258090 due to the legal and legitimacy risks involved in falling so short of the public expectations we have set." "Legitimacy: All three collaborations for Child Safety, Terrorism and Adult Sexual Exploitation are very high-profile given they relate to industry working together to stop high severity harms. Our legitimacy wins from participating in these efforts could easily become a legitimacy loss due to the scale of this feature gap." Karina Newton: "can someone from CI with knowledge ping me off thread with legal counsel on how this gap was not previously known or tested?"