Justin Maier
e51fe3691b
Documents the Lucy Faithfull Foundation partnership that redirects users searching for CSAM toward professional support resources. Written for non-technical team members to understand where the feature appears and how it works. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2.1 KiB
Stop It Now! / Lucy Faithfull Foundation Integration
Overview
Civitai partners with the Lucy Faithfull Foundation to help redirect individuals who may be searching for child sexual abuse material (CSAM) toward professional support resources. When our system detects searches that may indicate someone is looking for this type of content, we display an intervention message with confidential help resources instead of search results.
Where It Appears
The intervention appears in two places on the site:
- Search Results Page — When a user submits a search from the main search page, a full-page intervention replaces the normal results
- Search Autocomplete — When typing in the search bar, the dropdown will show "Blocked" instead of suggestions
What Users See
When triggered, users see a warning message that includes:
- A clear statement that their search may be for illegal content
- Information that viewing, sharing, or creating such content is a serious crime
- Confidential support resources:
- Phone (UK): Stop It Now! helpline — 0808 1000 900 (no caller ID saved)
- Online Support (Global): Link to stopitnow.org.uk for self-help tools, live chat, and secure email
- Links to our Terms of Service and Safety Center
- A link to return to the homepage
What Triggers It
The system automatically detects search queries that combine inappropriate terms with references to minors. This includes:
- Explicit age references (e.g., specific ages under 18)
- Common terms used to describe minors
- Various spelling variations and attempts to evade detection
The detection is designed to minimize false positives while catching genuine attempts to find harmful content.
Tracking
When an intervention is triggered, we log the event (labeled CSAM_Help_Triggered) for internal analytics. This helps us understand how often the feature is used and ensures the system is working as intended.