Description: (Jailbreak) prompts created by real-world users
Source: Reddit, Discord, websites, open datasets
Size: 15,140 prompts, including 1,405 jailbreak prompts

Description: Questions that LLMs should not answer, covering 13 forbidden scenarios from OpenAI usage policy
Source: GPT-4 generated, based on OpenAI usage policy
Size: 390

Description: GPT (user-customized ChatGPT) metadata spanning four categories: basic information, GPT builders, user feedback, and GPT configurations
Source: The official GPT Store, collected bi-weekly
Size: 755,297

Description: User-crafted prompts with generated images
Source: Lexica.art
Size: 61,467

Description: Safe/unsafe images from the Web, including both real-world and AI-generated examples
Source: LAION-5B (real) and Lexica.art (AI), human-labeled across 11 categories
Size: 10,146

Description: Real/AI-generated social media posts
Source: Medium, Quora, Reddit
Size: 845,497

Description: Hate speech dataset generated by LLMs, covering 34 identity groups
Source: LLMs (GPT‑3.5, GPT‑4, Vicuna, Baichuan2, Dolly2, OPT), manually annotated
Size: 7,838

Description: Responses of VLMs to hateful memes, annotated for informativeness and soundness
Source: VLMs (InstructBlip, ShareGPT-4V, LLaVA, CogVLM), manually annotated
Size: 27,373

Description: Unsafe images generated by text-to-image models
Source: Generated from harmful prompts (4chan, Lexica.art) and safe prompts (COCO-based)
Size: 800