├── LICENSE ├── README.md ├── Sample ├── c_desc.csv ├── c_summary.csv ├── java_bug_explanation.json ├── java_bug_summary.json └── readme.md ├── c_all_results.csv └── java_all_results.csv /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2024 Knowledge and Data Engineering Group 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Prompt-Enhanced Software Vulnerability Detection Using ChatGPT 2 | 3 | This repository includes C/C++ and Java language ChatGPT samples for human evaluation, datasets and partial response results for our ICSE'24 poster `Prompt-Enhanced Software Vulnerability Detection Using ChatGPT` [[arXiv]](https://arxiv.org/abs/2308.12697). 4 | 5 | 1. `Sample` contains 200 samples for human evaluation on the C/C++ and Java datasets. 6 | 7 | 2. `c_all_results.csv` includes 1,015 vulnerability functions and 922 non-vulnerability function attributes as well as some prompt results. 8 | 9 | 3. `java_all_results.csv` includes the attributes of 1,171 vulnerability functions and 917 non-vulnerability functions as well as the results of all prompts. 10 | -------------------------------------------------------------------------------- /Sample/c_summary.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/KDEGroup/LLMVulnerabilityDetection/47574344fa6d92043b6accaaaa3bf7c225efd181/Sample/c_summary.csv -------------------------------------------------------------------------------- /Sample/readme.md: -------------------------------------------------------------------------------- 1 | These are the samples for Java and C/C++ with the score of bug explanation and summary. 2 | --------------------------------------------------------------------------------