The rapidly growing industry of AI-generated child porn is a serious threat to society that needs to be tackled. Not only do these pedophiles spawn AI images by using footage of real victims, but the overwhelming amount of novel content makes it harder for police to distinguish between real and fake. Although companies understandably want to keep open-source code to promote artistic creativity, that may not be worth contributing to the evil child porn industry.
AI depictions of minors do pose serious concerns on many fronts, but they can also help law enforcement catch pedophiles before any real children are hurt. For example, police created a fake young girl to combat child webcam sex trafficking; thousands of men around the world were then exposed for paying for her content. Hopefully, as is underway in Australia, individual law enforcement agencies can each create their own AI to find and arrest more predators.