Generative AI
Overview
Generative artificial intelligence (GAI) is a powerful technology that enables a user to create new images, videos, audio and text based on user requests or prompts. While GAI technology offers exciting possibilities, it also introduces new risks to child safety online. GAI can be misused in numerous ways to sexually exploit children, including in the creation of altered images of real children that depict them as nude or in sexually explicit or exploitative circumstances.
NCMEC has received CyberTipline reports of offenders using GAI-altered sexually explicit images depicting children in cases of online enticement or sextortion as well as reports of children creating and distributing nude images using “nudify” apps or GAI CSAM of their classmates in schools.
The creation of this kind of exploitative content is a serious offense that deeply harms the children depicted and should be reported to law enforcement and the CyberTipline. To learn more about this topic, visit NCMEC.org/GAI.
What to Do
If you or someone you know has been victimized through the use of GAI to create a nude or sexually explicit image or video, you should report it to law enforcement and to the CyberTipline. NCMEC is here to help. You can also use these tips and the resources below to help prevent harm caused by exploitative use of GAI technology.
For Children:
- If nude or sexually explicit content of you is being shared or someone is threatening to share it, you can get help by reporting it to CyberTipline.org.
- Do not create or share GAI nude images or GAI CSAM of other kids. It's illegal and extremely harmful to kids depicted in the content.
- If someone you know is experiencing this, be an upstander by supporting the victim instead of blaming, bullying or ignoring them.
- If you experience this, know that there is someone who can help. Talk to a trusted adult and together you can report the incident.
For Parents, Caregivers and Other Adults:
- Stay informed about how GAI is being used by children in your life and others.
- Talk to children regularly about online safety topics, including misues of GAI.
- Make sure children know you will always be there for them.
- If a child who has experienced exploitation comes to you, take clear action to support the child and report the incident to law enforcement and the CyberTipline.
- Help children manage privacy settings online to limit access to images that could be used to create GAI content.