├── .gitignore ├── README.md ├── defihack_res_temp0_230723.csv ├── defihack_res_temp0_230723.xlsx ├── reports ├── MetaScan_AI_Analyzer_Report_Hack-20210519-PancakeBunny (1OK-FLP)_202308051351.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20210603-PancakeHunny (1OK-FLP)_202308051355.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220321-OneRingFinance (1OK-FLP)_202308051355.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220529-NOVOProtocol (1Negative-UT) (1Positive-ANC)_202308051356.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220606-Discover (1OK-FLP)_202308051356.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220616-InverseFinance (1OK-FLP)_202308051359.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220807-EGDFinance (1OK-FLP) (1New-FLB)_202308051357.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220902-ShadowFi (1OK-UT)_202308051358.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220906-NXUSD (1OK-FLP)_202308051401.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220909-YYDS (1Negative-FLP)_202308051359.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20220928-BXH (1OK-FLP)_202308051400.pdf ├── MetaScan_AI_Analyzer_Report_Hack-20221001-RLToken (1Negative-FLP)_202308051400.pdf └── MetaScan_AI_Analyzer_Report_Hack-20221012-ATK (1Negative-FLP)_202308051401.pdf └── screenshots ├── Hack-20210519-PancakeBunny.png ├── Hack-20210603-PancakeHunny.png ├── Hack-20220321-OneRingFinance.png ├── Hack-20220529-NOVOProtocol.png ├── Hack-20220606-Discover.png ├── Hack-20220616-InverseFinance.png ├── Hack-20220807-EGDFinance.png ├── Hack-20220902-ShadowFi.png ├── Hack-20220906-NXUSD.png ├── Hack-20220909-YYDS.png ├── Hack-20220928-BXH.png ├── Hack-20221001-RLToken.png └── Hack-20221012-ATK.png /.gitignore: -------------------------------------------------------------------------------- 1 | .DS_Store 2 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # GPTScan-DefiHacks 2 | 3 | Paper: **When GPT Meets Program Analysis: Towards Intelligent Detection of Smart Contract Logic Vulnerabilities in GPTScan** https://arxiv.org/abs/2308.03314 4 | 5 | Screenshot 2023-08-07 at 23 00 11 6 | 7 | See the result of another Web3Bugs dataset at https://github.com/MetaTrustLabs/GPTScan-Web3Bugs. 8 | 9 | ### Hack-20210519-PancakeBunny 10 | 11 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20210519-PancakeBunny%20(1OK-FLP)_202308051351.pdf 12 | 13 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20210519-PancakeBunny.png) 14 | 15 | ### Hack-20210603-PancakeHunny 16 | 17 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20210603-PancakeHunny%20(1OK-FLP)_202308051355.pdf 18 | 19 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20210603-PancakeHunny.png) 20 | 21 | ### Hack-20220321-OneRingFinance 22 | 23 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220321-OneRingFinance%20(1OK-FLP)_202308051355.pdf 24 | 25 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220321-OneRingFinance.png) 26 | 27 | ### Hack-20220529-NOVOProtocol 28 | 29 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220529-NOVOProtocol%20(1Negative-UT)%20(1Positive-ANC)_202308051356.pdf 30 | 31 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220529-NOVOProtocol.png) 32 | 33 | ### Hack-20220606-Discover 34 | 35 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220606-Discover%20(1OK-FLP)_202308051356.pdf 36 | 37 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220606-Discover.png) 38 | 39 | ### Hack-20220616-InverseFinance 40 | 41 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220616-InverseFinance%20(1OK-FLP)_202308051359.pdf 42 | 43 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220616-InverseFinance.png) 44 | 45 | ### Hack-20220807-EGDFinance 46 | 47 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220807-EGDFinance%20(1OK-FLP)%20(1New-FLB)_202308051357.pdf 48 | 49 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220807-EGDFinance.png) 50 | 51 | ### Hack-20220902-ShadowFi 52 | 53 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220902-ShadowFi%20(1OK-UT)_202308051358.pdf 54 | 55 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220902-ShadowFi.png) 56 | 57 | ### Hack-20220906-NXUSD 58 | 59 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220906-NXUSD%20(1OK-FLP)_202308051401.pdf 60 | 61 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220906-NXUSD.png) 62 | 63 | ### Hack-20220909-YYDS 64 | 65 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220909-YYDS%20(1Negative-FLP)_202308051359.pdf 66 | 67 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220909-YYDS.png) 68 | 69 | ### Hack-20220928-BXH 70 | 71 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20220928-BXH%20(1OK-FLP)_202308051400.pdf 72 | 73 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20220928-BXH.png) 74 | 75 | ### Hack-20221001-RLToken 76 | 77 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20221001-RLToken%20(1Negative-FLP)_202308051400.pdf 78 | 79 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20221001-RLToken.png) 80 | 81 | ### Hack-20221012-ATK 82 | 83 | https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/reports/MetaScan_AI_Analyzer_Report_Hack-20221012-ATK%20(1Negative-FLP)_202308051401.pdf 84 | 85 | ![alt text](https://github.com/MetaTrustLabs/GPTScan-DefiHacks/blob/dev/screenshots/Hack-20221012-ATK.png) 86 | -------------------------------------------------------------------------------- /defihack_res_temp0_230723.csv: -------------------------------------------------------------------------------- 1 | Project Name,Rule,TP,TP-Type,TN,FP,FP-Type,FN,FN-Type,TP+TN+FP+FN,Minus 2 | Hack-20210519-PancakeBunny,2,1,FLP,1,0,,0,,2,0 3 | Hack-20210603-PancakeHunny,5,1,FLP,4,0,,0,,5,0 4 | Hack-20220321-OneRingFinance,3,1,FLP,2,0,,0,,3,0 5 | Hack-20220529-NOVOProtocol,4,0,,2,1,ANC,1,UT,4,0 6 | Hack-20220606-Discover,2,1,FLP,1,0,,0,,2,0 7 | Hack-20220616_InverseFinance,2,1,FLP,1,0,,0,,2,0 8 | Hack-20220807_EGDFinance,3,2,"FLB (new), FLP",1,0,,0,,3,0 9 | Hack-20220902-ShadowFi,3,1,UT,2,0,,0,,3,0 10 | Hack-20220906-NXUSD,2,1,FLP,1,0,,0,,2,0 11 | Hack-20220909_YYDS,2,0,,1,0,,1,FLP,2,0 12 | Hack-20220928-BXH,2,1,FLP,1,0,,0,,2,0 13 | Hack-20221001-RLToken,2,0,,1,0,,1,FLP,2,0 14 | Hack-20221012-ATK,2,0,,1,0,,1,FLP,2,0 15 | ,34,10,,19,1,,4,,34,0 16 | ,,,,,,,,,, 17 | ,Precision,0.909090909,Recall,0.714285714,F1 score,0.8,Accuracy,0.852941176,, 18 | ,,,,,,,,,, 19 | ,,,,,,,,,, 20 | ,,,,,,,,,, -------------------------------------------------------------------------------- /defihack_res_temp0_230723.xlsx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/defihack_res_temp0_230723.xlsx -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20210519-PancakeBunny (1OK-FLP)_202308051351.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20210519-PancakeBunny (1OK-FLP)_202308051351.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20210603-PancakeHunny (1OK-FLP)_202308051355.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20210603-PancakeHunny (1OK-FLP)_202308051355.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220321-OneRingFinance (1OK-FLP)_202308051355.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220321-OneRingFinance (1OK-FLP)_202308051355.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220529-NOVOProtocol (1Negative-UT) (1Positive-ANC)_202308051356.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220529-NOVOProtocol (1Negative-UT) (1Positive-ANC)_202308051356.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220606-Discover (1OK-FLP)_202308051356.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220606-Discover (1OK-FLP)_202308051356.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220616-InverseFinance (1OK-FLP)_202308051359.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220616-InverseFinance (1OK-FLP)_202308051359.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220807-EGDFinance (1OK-FLP) (1New-FLB)_202308051357.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220807-EGDFinance (1OK-FLP) (1New-FLB)_202308051357.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220902-ShadowFi (1OK-UT)_202308051358.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220902-ShadowFi (1OK-UT)_202308051358.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220906-NXUSD (1OK-FLP)_202308051401.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220906-NXUSD (1OK-FLP)_202308051401.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220909-YYDS (1Negative-FLP)_202308051359.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220909-YYDS (1Negative-FLP)_202308051359.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20220928-BXH (1OK-FLP)_202308051400.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20220928-BXH (1OK-FLP)_202308051400.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20221001-RLToken (1Negative-FLP)_202308051400.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20221001-RLToken (1Negative-FLP)_202308051400.pdf -------------------------------------------------------------------------------- /reports/MetaScan_AI_Analyzer_Report_Hack-20221012-ATK (1Negative-FLP)_202308051401.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/reports/MetaScan_AI_Analyzer_Report_Hack-20221012-ATK (1Negative-FLP)_202308051401.pdf -------------------------------------------------------------------------------- /screenshots/Hack-20210519-PancakeBunny.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20210519-PancakeBunny.png -------------------------------------------------------------------------------- /screenshots/Hack-20210603-PancakeHunny.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20210603-PancakeHunny.png -------------------------------------------------------------------------------- /screenshots/Hack-20220321-OneRingFinance.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220321-OneRingFinance.png -------------------------------------------------------------------------------- /screenshots/Hack-20220529-NOVOProtocol.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220529-NOVOProtocol.png -------------------------------------------------------------------------------- /screenshots/Hack-20220606-Discover.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220606-Discover.png -------------------------------------------------------------------------------- /screenshots/Hack-20220616-InverseFinance.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220616-InverseFinance.png -------------------------------------------------------------------------------- /screenshots/Hack-20220807-EGDFinance.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220807-EGDFinance.png -------------------------------------------------------------------------------- /screenshots/Hack-20220902-ShadowFi.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220902-ShadowFi.png -------------------------------------------------------------------------------- /screenshots/Hack-20220906-NXUSD.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220906-NXUSD.png -------------------------------------------------------------------------------- /screenshots/Hack-20220909-YYDS.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220909-YYDS.png -------------------------------------------------------------------------------- /screenshots/Hack-20220928-BXH.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20220928-BXH.png -------------------------------------------------------------------------------- /screenshots/Hack-20221001-RLToken.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20221001-RLToken.png -------------------------------------------------------------------------------- /screenshots/Hack-20221012-ATK.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/MetaTrustLabs/GPTScan-DefiHacks/87026508a2e1752927e521b63766196a5ed2ea67/screenshots/Hack-20221012-ATK.png --------------------------------------------------------------------------------