So much for sorry I can’t generate that lol
How a prompt bypassed content filters for a gothic lingerie shoot
A viral Reddit post on r/ChatGPT has highlighted the quirks of AI content moderation. The user, u/ManaKhalifa, first asked for an image of a woman in lingerie and was met with a refusal. However, by rephrasing the request as a 'tasteful gothic lingerie product shoot' with a clearly 19-year-old adult model, the AI generated the image. The prompt included specific details like angles (front, side, rear three-quarter) and a puppy yoga pose, with conditions of no nudity and no sexual framing. This demonstrates how prompt engineering can navigate AI safety filters.
The incident underscores the challenges in AI content moderation, where subtle language changes can bypass restrictions. It also raises questions about the effectiveness of current filter systems and the potential for misuse. As AI image generators become more accessible, the need for robust yet nuanced safety measures grows. This case serves as a practical example for developers and users alike on the importance of crafting precise prompts, while also highlighting the ethical considerations in AI-generated content.
- Initial request for explicit lingerie image was rejected by AI content filter
- Rephrased prompt with 'tasteful gothic lingerie product shoot' and specific angles bypassed the filter
- Prompt specified a 19-year-old model, puppy yoga pose, and no nudity to avoid sexual framing
Why It Matters
Demonstrates AI content filter vulnerabilities and the power of prompt engineering in image generation.