Jenna Dietz’s Post

Today we convened an industry briefing on the impact of generative AI on online child sexual exploitation and abuse (OCSEA). We brought together key U.S. stakeholders in the ecosystem to develop a shared understanding of the potential risks predatory actors pose to children through generative AI and the ways companies are currently addressing those threats, as well as to identify and initiate new opportunities for stakeholder collaboration. Reps from 27 of our Member companies, including Adobe, Amazon, Discord, Google, Meta, Microsoft, NAVER Z (ZEPETO), Niantic, Inc., OpenAI, Pinterest, Snap Inc., TikTok, VERISIGN, Verizon, VSCO®, Yahoo, and Zoom, joined select child safety experts, advocates, and members of law enforcement. As generative AI develops and the child safety ecosystem evolves, our Members are building a deeper understanding of the issues and challenges, so they can continue to be proactive in their efforts to reduce risk, incorporate safety by design, and innovate solutions to help keep children safe. Additionally, the tech industry and the stakeholders with whom industry engages to thwart OCSEA will continue to adapt their approaches and systems to address this new threat, as they have with past changes in technology. For this reason, today’s briefing culminated with several new multi-stakeholder efforts, among them including:  - Red teaming: With input from the U.S. Department of Justice, we will help companies explore ways to test for and mitigate OCSEA risks. - Information sharing: We will advance utilizing the Lantern program to securely share information that supports robust safety evaluations and mitigation methods for generative AI CSAM and related OCSEA incidents.    - Industry classification system: We will review and update the Industry Classification System to address different types of AI-generated OCSEA.  - Reporting: We will work with the National Center for Missing & Exploited Children (NCMEC) to help develop a process to efficiently and effectively refer cybertip reports of AI-generated OCSEA to NCMEC. Our work to understand the impact of generative AI on OCSEA began earlier this year when we started bringing Members together regularly to identify emerging challenges and share learnings. In addition, together with Thorn, we co-hosted a webinar to convene experts on the topic of understanding child safety risks with generative AI, and at the Crimes Against Children Conference we brought together industry to identify and address generative AI challenges. We look forward to continuing to facilitate discussions about OCSEA and the rapidly changing space of generative AI. See the full blog post to learn more: https://lnkd.in/er_9JkQR

So excited to continue our TC Safe Online Research Fund collaboration with Tech Coalition - thank you Sean Litton & Kay Chau for being forward looking and propelling GenAI to the top of our research agenda around prevention and response to online child sexual exploitation and abuse (CSEA). It was great to be at the Gen-AI industry briefing - with so many relevant take-aways for our research agenda: ·     We must build on past knowledge on child safety - we are not starting from zero and that is our current key advantage ·     Foundational research is critical - deepen our understanding on behaviors of users, bad actors, risks for child safety, etc. ·     Brining more visibility and transparency into model development - safety frameworks around foundational training datasets ·     Research on how mitigation measures apply across cultural contexts and languages, as well as looking into model alignment ·     How can GenAI platforms be used to signpost support, prevention messages, diversion measures, etc. ·     The need to bring the knowledge from the communities outside and diversify perspectives ·     Work collaboratively - researchers, child protection and safety experts, industry, law enforcement, etc. Thanks to Natalie Shoup on our team, for leading on this exciting work. Stay tuned for more info on this collaboration.

The Tech Coalition will fund new research on generative AI and online child sexual exploitation and abuse (OCSEA) through its Tech Coalition Safe Online Research Fund. The first project to be funded will be research from the University of Kent on the impact of generative AI child sexual abuse material (CSAM) proliferation, focusing on how generative AI CSAM may reshape attitudes, norms, and behaviors among people who engage with CSAM and on how the perpetration and prevention ecosystems may respond. Additional projects will be chosen by the end of the year for funding in 2025. Application details will be announced in the coming months, so stay tuned! The new funding was announced today at an industry briefing on generative AI with key stakeholders hosted by the Tech Coalition. This was the second briefing of its kind and took place in London with select UK child safety experts, advocates, and members of law enforcement and government. Among them were representatives from the Home Office, Internet Watch Foundation (IWF), Lucy Faithfull Foundation, the National Center for Missing & Exploited Children (NCMEC), and Safe Online, as well as 14 Tech Coalition member companies, including Adobe, Amazon, Bumble Inc., Google, Meta, Microsoft, OpenAI, Roblox, Snap Inc., and TikTok. These briefings are designed to develop a shared understanding of the potential risks predatory actors pose to children through the misuse of generative AI and the ways companies are currently addressing those threats, as well as to identify and initiate new opportunities for stakeholder collaboration on this issue. Read more here: https://lnkd.in/epR9RYhW

DHS collaborates on AI and machine learning for child abuse cases #AI #AItechnology #AIdrivensolutions #artificialintelligence #childabusecases #DHS #efficientdataanalysis #geographicalcontextdetection #ImageProcessing #lawenforcementwellbeing #legalreview #llm #machinelearning #SpeechViewtools #StreamView #voiceanalysis

Not shocking when you are vacuuming up information without regard to what is legal or illegal and without permission. This happens when an industry has a "move fast and break things" philosophy. Haven't we learned our lesson from the past? The sad thing is that the children who are harmed by these images have no recourse against the AI companies who have collected and stored them. But, if these AI companies have CSAM on their servers, federal, state and local law enforcement should be investigating immediately to determine if they are violating laws on the possession and distribution of CSAM. “If you have downloaded that full dataset for whatever purpose, for training a model for research purposes, then yes, you absolutely have CSAM, unless you took some extraordinary measures to stop it,” David Thiel, lead author of the study and Chief Technologist at the Stanford Internet Observatory told 404 Media." “We find that having possession of a LAION‐5B dataset populated even in late 2023 implies the possession of thousands of illegal images—not including all of the intimate imagery published and gathered non‐consensually, the legality of which is more variable by jurisdiction,” the paper says. “While the amount of CSAM present does not necessarily indicate that the presence of CSAM drastically influences the output of the model above and beyond the model’s ability to combine the concepts of sexual activity and children, it likely does still exert influence. The presence of repeated identical instances of CSAM is also problematic, particularly due to its reinforcement of images of specific victims.” https://lnkd.in/ePFWSj6Q #kosa #earnit #coppa2 #childsafety #csam #siliconvalley #google #meta #instagram #facebook #ai

Children are now using #deepfakes to bully peers. This is not just alarming; it's absolutely unacceptable. Policy makers are stepping up. The eSafety Commissioner, Julie Inman - Grant rightly states, "Industry cannot ignore what’s happening now. Our collective safety and well-being are at stake if we don’t get this right." 🚨 We echo this sentiment.🚨 The industry needs to move, but robust #legislation must underpin this movement. It’s high time influential figures like Ed Husic MP and Hon Karen Andrews accelerate dialogues to enact stringent laws around #AI and deepfakes. These laws are crucial to ensure industry players act preemptively, not just reactively. Deepfake #detection and image #fingerprint technologies are invaluable, but they act after the incident. This is not enough. We, at #Thatsmyface, believe in thwarting malicious deepfakes BEFORE they wreak havoc, fostering a safer digital environment for everyone, especially our children. Let’s not wait for the storm to hit. Let’s be the barrier that stops it from forming. #AIRegulation #ResponsibleAI #DeepfakeMitigation

Technology continues to drive innovation and has a positive impact on society as a whole. However, the abuse and exploitation of children remains a terrible by-product of this innovation, to include #GenAI. Microsoft has joined resources with Thorn, All Tech Is Human, and other leading companies in their effort to prevent the misuse of generative AI technologies to perpetrate, proliferate, and further sexual harms against children. Today, Microsoft is committing to implementing preventative and proactive principles into our generative AI technologies and products to protect children. Chad Wallace Mark Starr Dai P. Sai Narain Charlie S. Troy B. Susan Locke Ewaliko Benjamin LaBelle Marife Casem Lori Kim Allison Swaim

Abuse in the machine: Study shows AI image-generators being trained on explicit photos of children | AP News: An investigative report reveals the presence of thousands of images of child sexual abuse concealed within popular AI image-generating frameworks. The findings have prompted urgent calls for action to address the issue, which has facilitated the creation of explicit fake imagery of children and posed challenges for law enforcement and educational institutions. The report emphasizes the need for stricter measures to prevent the proliferation of abusive content and the implementation of effective safeguards to address the issue. - Artificial Intelligence topics! #ai #artificialintelligence #intelligenzaartificiale

The world’s leading independent open source generative #AI company Stability AI joins IWF’s mission to make the internet a safer space for children. As an IWF Member, Stability AI now has access to a suite of cutting-edge tools developed to stop the spread of criminal videos and images on the internet, such as the IWF Hash List. Our CEO Susie Hargreaves OBE, said: “We know predators online are quick to exploit new technologies to create child sexual abuse material, with text-to-image based generative AI being one of them. “Last year, the IWF raised the alarm over how this type of criminal content can be generated at scale and at pace. We highlighted that collaboration was key to successfully tackling the abuses of AI. “We are therefore delighted to welcome Stability AI to our growing network of international organisations devoted to making the internet a safer place for all users, especially for children. “By working together with partners around the world we can lead the fight against online child sexual abuse images and videos and stop the repeated victimisation of child victims of this cruel crime.” Read more on our website.