├── LICENSE └── README.md /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2020 swyx 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | > this list is now archived - look inside https://github.com/sw-yx/brain if you would like an updated list! thank you. 2 | 3 | # gpt3-list 4 | 5 | List of things that people are claiming is enabled by GPT3. unverified but links to sources. 6 | 7 | ## Official info 8 | 9 | - Official paper https://arxiv.org/abs/2005.14165 10 | - GitHub: https://github.com/openai/gpt-3 11 | - HN: https://news.ycombinator.com/item?id=23345379 12 | - criticism https://www.lesswrong.com/posts/ZHrpjDc3CepSeeBuE/gpt-3-a-disappointing-paper 13 | - nvidia summary https://news.developer.nvidia.com/openai-presents-gpt-3-a-175-billion-parameters-language-model/ 14 | - venturebeat summary https://venturebeat.com/2020/05/29/openai-debuts-gigantic-gpt-3-language-model-with-175-billion-parameters/ 15 | - how it works visualized/animated https://jalammar.github.io/how-gpt3-works-visualizations-animations/ 16 | - Vicki Boykis on CommonCrawl and WebText https://vicki.substack.com/p/are-you-as-smart-as-a-toddler 17 | - beta signup https://beta.openai.com/ 18 | 19 | another list like this one https://gpt-3.is/ 20 | 21 | ## Notable takes 22 | 23 | - "racecar for the mind" https://twitter.com/zebulgar/status/1284294275430117376?s=20 24 | - polluting gpt4 https://twitter.com/karpathy/status/1284660899198820352?s=20 25 | - precision and specification https://twitter.com/JoeHughesDev/status/1284985137298575366?s=20 26 | - more applications https://nesslabs.com/gpt-3-future-productivity 27 | - makes SWEs more valuable https://davnicwil.com/ai-writing-code-makes-software-engineers-more-valuable/ 28 | - "beginning of the end" https://kitze.io/posts/gpt3-is-the-beginning-of-the-end 29 | - Astroturfing risk https://jayriverlong.github.io/2020/07/24/gpt3.html 30 | > GPT-3 marks a new generation of tools enabling states to interfere in online discourse with unprecedented scale and persuasiveness, enabling great damage at low cost. 31 | - a16z What's hype, What's real: https://a16z.com/2020/07/29/16mins-gpt3-natural-language-neural-net-deep-learning-few-shot-zero-shot/ 32 | - Tempering expectations https://minimaxir.com/2020/07/gpt3-expectations/ 33 | 34 | > However, a 30-40% success rate implies **a 60-70% failure rate**, which is patently unsuitable for a production application. If it takes seconds to generate a React component and it takes on average 3 tries to get something usable, it might be more pragmatic to just create the component the hard, boring way. Compare again to Apple’s Siri, which can get very frustrating when it performs the wrong action. 35 | 36 | 37 | GPT3 responding to GPT3 takes: https://twitter.com/raphamilliere/status/1289129723310886912?s=20 38 | 39 | 40 | 41 |
42 | 43 | 44 | [Yann LeCun take](https://www.facebook.com/yann.lecun/posts/10157253205637143?notif_id=1603803722095314¬if_t=story_reshare&ref=notif) endorsing [Nabla health's article](https://www.nabla.com/blog/gpt-3/) 45 | 46 | 47 | 48 | ![image](https://user-images.githubusercontent.com/6764957/97315898-2470af80-18a4-11eb-9d07-f37b7785fd3b.png) 49 | 50 | 51 |
52 | 53 | More: 54 | 55 | - https://twitter.com/michael_nielsen/status/1284937254666768384?s=20 56 | - https://maraoz.com/2020/07/18/openai-gpt3/ 57 | - https://youtube.com/watch?v=SY5PvZrJhLE&feature=youtu.be 58 | - https://youtube.com/watch?v=S0KakHcj_rs 59 | - Andrew Ng https://youtube.com/watch?v=SysgYptB198 60 | - @AnalyticsVidhya: https://analyticsvidhya.com/blog/2019/06/understanding-transformers-nlp-state-of-the-art-models/ 61 | - @JayAlammar: http://jalammar.github.io/illustrated-transformer/ 62 | 63 | ## Projects/Startups 64 | 65 | 66 | https://trends.vc/trends-0057-ai-generated-content/ 67 | 68 | - AI Dungeon https://twitter.com/nickwalton00/status/1283143210999484416?s=20 69 | - codegen 70 | - Debuild.co (text to codegen) https://docs.google.com/forms/d/e/1FAIpQLSeI-QTsXJV0cF5MuB7RwgA0QdHEWn7E6zrs7dCHDLHA3s64Dg/viewform 71 | - source.ai https://twitter.com/jesuisFurkan57/status/1326248254791688192?s=20 72 | - AI Channels https://andrewmayneblog.wordpress.com/2020/06/11/the-aichannels-project/ 73 | - Suhail browser autocomplete https://twitter.com/Suhail/status/1284562825084416000?s=20 74 | - Search Engine https://twitter.com/paraschopra/status/1284801028676653060?s=20 75 | - QuickResponse (Email completion) https://twitter.com/OthersideAI/status/1285776335638614017?s=20 76 | - QuickChat https://blog.quickchat.ai/post/knowledge-base-chat-bot/ 77 | - Lossless (english to regex) https://losslesshq.com/ 78 | - Producing Customer Feedback Insight https://askviable.com/ ([Rahul Vohra demo](https://askviable.com/)) 79 | - Replit Code Oracle - code querying https://twitter.com/amasad/status/1285959600584265729?s=20 80 | - Explain Like I'm Five https://twitter.com/chris__lu/status/1284535970164088832?s=20 81 | - [Taglines.ai](https://www.taglines.ai/) https://twitter.com/chris__lu/status/1290426666477592576?s=20 82 | - AI email composer https://compose.ai/ 83 | - AI video creator https://www.synthesia.io/ 84 | - https://www.copysmith.ai/ "This startup is using GPT-3 for content marketing, just tried it out and it's surprisingly good at generating 2-3 sentence pitches (going off of some key words and a brief description)" 85 | - Philosopher.ai philosopher prompting 86 | 87 | 88 | ## Code 89 | 90 | - HTML/Layout 91 | - https://twitter.com/sharifshameem/status/1282676454690451457?s=20 92 | - Google homepage layout https://twitter.com/sharifshameem/status/1283322990625607681?s=20 93 | - CSS https://twitter.com/harlandduman/status/1282370494092599297?s=20 94 | - Functioning React code 95 | - Small button counters https://twitter.com/sharifshameem/status/1284095222939451393?s=20 96 | - Todo-list https://twitter.com/sharifshameem/status/1284421499915403264?s=20 97 | - based on variable name https://twitter.com/hturan/status/1282261783147958272?s=20 98 | - SQL 99 | - https://twitter.com/FaraazNishtar/status/1285934622891667457?s=20 100 | - Keras Models 101 | - https://twitter.com/mattshumer_/status/1287125015528341506 102 | - Swift UI 103 | - https://twitter.com/jsngr/status/1284518632878477312?s=20 104 | - shell commands 105 | - https://twitter.com/harlandduman/status/1282132804034150400?s=20 106 | - regex 107 | - https://twitter.com/mathdroid/status/1286266220505833473?s=20 108 | - https://twitter.com/parthi_logan/status/1286818567631982593?s=20 109 | - Google 110 | - Sheets https://twitter.com/pavtalk/status/1285410751092416513?s=20 111 | - Docs https://twitter.com/IntuitMachine/status/1286974653345542145?s=20 112 | 113 | ## Design 114 | 115 | - Figma https://twitter.com/jsngr/status/1284511080715362304?s=20 116 | 117 | ## Finance 118 | 119 | - financial statements https://twitter.com/itsyashdani/status/1285695850300219392?s=20 120 | 121 | ## Music 122 | 123 | - Guitar tabs https://twitter.com/AmandaAskell/status/1283900372281511937?s=20 124 | 125 | ## Image completion 126 | 127 | - Image-GPT3 https://twitter.com/xuenay/status/1273898995706998790?s=20 128 | 129 | ## Therapy 130 | 131 | - https://twitter.com/nicklovescode/status/1283300424418619393?s=20 132 | 133 | ## Domain specific Text 134 | 135 | - Medical questions: https://twitter.com/xuenay/status/1283376153156362242?s=20 136 | - Law: https://twitter.com/f_j_j_/status/1283349995144359937 137 | - Presentations: https://twitter.com/bemmu/status/1285284131656445952?s=20 138 | 139 | ## General Text 140 | 141 | - Fortune cookies 142 | - Music https://twitter.com/TomWhitwell/status/1283997889887383564?s=20 143 | - https://twitter.com/Siddharth87/status/1283920116007092224?s=20 144 | - philosophy https://twitter.com/quasimondo/status/1284422930710102016?s=20 145 | - tweets https://thoughts.sushant-kumar.com/hong%20kong 146 | - Poetry 147 | - https://twitter.com/nicklovescode/status/1282471881887473666?s=20 148 | - Creative Fiction 149 | - https://www.gwern.net/GPT-3 150 | - NPC text? 151 | - Non English Languages 152 | - https://towardsdatascience.com/gpt-3-creative-potential-of-nlp-d5ccae16c1ab 153 | - Emulating famous people 154 | - https://twitter.com/paraschopra/status/1284423029443850240?s=20 155 | - john carmack https://twitter.com/kirkouimet/status/1283231652609552384?s=20 156 | - Essay completion 157 | - https://twitter.com/zebulgar/status/1283927560435326976?s=20 158 | - https://twitter.com/zebulgar/status/1283921361627344896?s=20 159 | - tweet completion https://twitter.com/Plinz/status/1283211048145711104?s=20 160 | - GPT3 vs GPT3 161 | - https://twitter.com/JerschowNikita/status/1283755514061520898?s=20 162 | 163 | ## Failures 164 | 165 | - Turing test 166 | - http://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html (origin https://twitter.com/nabeelqu/status/1284167539141087232?s=20) 167 | - you can warn about nonsense qtns https://twitter.com/xuenay/status/1284053165483143172?s=20 168 | - you can give uncertainty prompts "yo be real" https://arr.am/2020/07/25/gpt-3-uncertainty-prompts/ 169 | - https://aiweirdness.com/post/621186154843324416/all-your-questions-answered 170 | - inhuman response times https://www.kmeme.com/2020/10/gpt-3-bot-went-undetected-askreddit-for.html?m=1 171 | - Technical Interviews 172 | - https://twitter.com/lacker/status/1279136788326432771?s=20 173 | - memory 174 | - https://twitter.com/karpathy/status/1284928564530278400?s=20 175 | - Bias 176 | - racism/sexism https://twitter.com/AnimaAnandkumar/status/1271137176529416193?s=20 177 | - antisemitic https://twitter.com/an_open_mind/status/1284487376312709120 178 | 179 | ## Funny 180 | 181 | - https://twitter.com/SC_Griffith/status/1283416905043279873?s=20 182 | - religion https://twitter.com/flantz/status/1284322274313752576?s=20 183 | --------------------------------------------------------------------------------