├── assets ├── Document.png └── JailbreakingPrompts.png ├── README.md └── LICENSE /assets/Document.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RyanFcr/awesome-ChatGPT-jailbreaking/HEAD/assets/Document.png -------------------------------------------------------------------------------- /assets/JailbreakingPrompts.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/RyanFcr/awesome-ChatGPT-jailbreaking/HEAD/assets/JailbreakingPrompts.png -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # awesome-ChatGPT-jailbreaking 2 | 3 | ChatGPT是由OpenAI训练的大语言模型下的聊天对话机器人。 4 | 5 | 而随着ChatGPT的诞生，大家对ChatGPT安全的讨论也愈发热烈，ChatGPT Jailbreaking也随之诞生，ChatGPT Jailbreaking是指通过某些手段来规避大语言模型回答上的限制。 6 | 7 | 本篇文章主要的贡献为**收录了目前为止的越狱prompts，100多个**。结合论文和自己的思考，**针对越狱的prompts和ChatGPT的限制，去进行了分类和实验**。最后得出了结论。主要着重实验部分。本篇文章的目的是希望科研工作者以及大模型的研究者可以从攻击的角度去更好的做alignment和防御，而不是鼓吹大家多做ChatGPT越狱，越狱有风险，操作需谨慎。 8 | 9 | 文章的详细链接如下，欢迎大家贡献 10 | 11 | [⁡⁣‬‬⁣‍‍⁡⁤‍⁤⁣⁣⁢⁣⁡⁣‌⁡⁣⁢⁢‬⁡⁤⁤⁢⁤ChatGPT Jailbreaking - 飞书云文档 (feishu.cn)](https://k5ms77k0o1.feishu.cn/wiki/GmBzwJGGyivO4tkn3pQcgq3XnTf) 12 | 13 | ![](./assets/Document.png) 14 | 15 | ![](./assets/JailbreakingPrompts.png) -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2023 RyanFcr 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | --------------------------------------------------------------------------------