Several major technology companies, including Microsoft, Meta, Google, and OpenAI, are focusing on developing generative Artificial Intelligence (AI) tools to combat child sexual abuse images (CSAM) that may arise from the use of this technology. These companies have committed to implementing a series of security measures by design to address this issue.
In 2023, over 104 million files suspected of containing CSAM were reported in the United States. This influx of AI-generated images poses significant risks to children and further burdens an already strained child safety ecosystem, according to child safety organization Thorn. To tackle this problem, Thorn and All Tech is Human, along with companies like Amazon, Meta, Microsoft, and Google, have joined forces to promote an initiative aimed at protecting minors from the misuse of AI.
The technology firms participating in this initiative have pledged to adhere to security by design principles, which involve implementing measures to prevent the creation of harmful content. Cybercriminals can leverage generative AI for various purposes, from making it difficult to identify victims to increasing demand for abusive material. By proactively addressing child safety risks in the development of AI models, these companies are working to prevent the dissemination of harmful content.
Some of the measures included in the security by design principles involve studying training data to ensure it does not reproduce abusive content, implementing watermarks in AI-generated images, and evaluating models for child safety before distribution. Technology giants like Google have also developed tools to detect and remove CSAM material on their platforms, such as using hash matching technology and AI classifiers, and collaborating with organizations like the National Center for Missing and Exploited Children to report incidents.
By prioritizing child safety and investing in technological solutions, these companies are demonstrating their commitment to combating the misuse of generative AI for harmful purposes. Through collaborations and initiatives like the one described, the tech industry aims to create a safer online environment for children and prevent the spread of exploitative content.