Analyzing urgent technology threats and trends

At Thorn, we know that nearly all technological innovation in our digital lives brings opportunities and risks – and often has safety implications for children online. That’s why we prioritize conducting original research in our field, and why we collaborate with a range of partners to expand the reach and impact of that research.

To proactively identify key technologies that stand to significantly impact the fight against child sexual abuse and exploitation in the digital age, Thorn recently partnered with the WeProtect Global Alliance on the Evolving Technologies Horizon Scan project.

This survey assembled expertise and perspectives from roughly 300 global stakeholders across sectors to analyze the most pressing technology trends and their potential intended and unintended effects on child safety online.

Key Findings

Before diving into specific technologies, here are some overarching takeaways from the joint research initiative:

• Multiple technologies must be considered together. No single technology can be the sole focus. The technologies highlighted in this report do not operate in isolation, nor do children or offenders use them independently. Addressing only one technology at a time risks creating critical protection gaps.
• A child’s privacy is integral to their safety. The debate around safeguarding children from online abuse often presents a false dichotomy: privacy removal with monitoring, or reacting to abuse reports after the abuse or report of the abuse takes place. Neither extreme is holistic in protecting children’s safety and rights.
• Technology is both a risk and a solution. While technology has accelerated risks of child sexual abuse and exploitation, it is also essential for combating these harms. However, building effective solutions requires diverse and specialized expertise and strong cross-sector and public support.

The technologies examined

Below is a high-level overview of the technologies looked at in the report. However, these technologies are complex. For a deeper understanding of each, we recommend reading the full report:

• Predictive AI:

  • What it is: The report defines “Predictive AI” as an umbrella term for a range of machine learning technologies that can recognize patterns and make predictions without being explicitly programmed to do so.
  • Implications: Predictive AI holds promise to accelerate efforts to detect sexual harms against children at scale, but also risks elevating harmful content and connections to users if not implemented carefully.

• Generative Artificial intelligence:

  • What it is: The report uses “Generative Artificial Intelligence” (generative AI) as a term for a range of machine learning (ML) technologies that can generate new content (images, videos, text, and audio) without being explicitly programmed to do so. 
  • Implications: Generative AI can and already does enable rapid creation of new and novel CSAM, reducing barriers for offenders. (Check out Thorn’s Safety by Design initiative to learn more about how we’re driving positive change in the generative AI space).

• End-to-end Encryption (E2EE):

  • What it is: E2EE is a method of securing data such that only approved users can access the content of the data. You can learn more about it on page 20 of the full report.
  • Implications: E2EE offers valuable privacy protections for individual data, regardless of the user or data type. However, these tools have also been weaponized by offenders looking to traffic in child sexual abuse material, groom children, and isolate victims from the protective features built into public spaces online and off. 
• Other technologies examined in the report include extended reality, decentralization, and quantum computing.

What the findings mean for Thorn’s work – and what they tell  us about the future of child safety

This report marks an important step in fostering continuous, cross-sector reflection on emerging and future trends. It helps better equip the child safety ecosystem to address the evolving challenges and opportunities children face in the digital world. As these efforts continue, further investment in research initiatives that leverage the knowledge of technologists, investigators, trust & safety professionals, and other frontline experts stands to deliver significant returns. Regular horizon scanning and multidisciplinary collaboration are vital to proactively address emerging threats.

Additional research and safety by design frameworks are needed to deepen our understanding and establish child safety as a foundational principle in new technologies. Most importantly, engaging youth stakeholders and raising public awareness will ensure we prioritize building a safe and vibrant digital world for the next generation. 

Read the full report for a comprehensive look at how these technologies intersect with online child safety and what it means for the future of child protection in the digital age.

We thank our friends at the WeProtect Global Alliance for their collaboration on this project and for their commitment to a goal we share: creating a safer future for children.