├── LICENSE └── README.md /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2019 swyx 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | > this list is now archived - look inside https://github.com/sw-yx/brain if you would like an updated list! thank you. 2 | 3 | # automation 4 | 5 | ## human 6 | 7 | - [fancyhands](https://www.fancyhands.com/) - US virtual assistant 8 | - [gethuman](https://gethuman.com/) - Help for customer service 9 | - [pickfu](https://www.pickfu.com/) - Market feedback from US consumers 10 | - [Gosquaredaway](https://www.gosquaredaway.com/)- military spouse personal assistants 11 | 12 | ## code 13 | 14 | ### reddit bots and their source 15 | 16 | - [Reddit CSS bot](https://github.com/Lachcim/css-irl-bot/blob/master/README.md) 17 | - [Making a Reddit Reply Bot](https://dev.to/seiyria/making-a-reddit-reply-bot-f55) 18 | - [Bot that scrapes reddit for keywords](https://intoli.com/blog/f5bot/) 19 | 20 | ### HN 21 | 22 | - [SQL social media queries](https://github.com/antontarasenko/smq/blob/master/README.md) 23 | 24 | ### twitter bots 25 | 26 | - [Self-care Twitter Bots](https://medium.com/@carolstran/a-guide-to-self-care-twitter-bots-f2430160fad4) 27 | - [Make @hydratebot](https://medium.com/@NoraReed/make-your-own-hydratebot-a-tutorial-for-non-coders-d4c149da29b8) 28 | - [Wikipedia scraper bot](https://github.com/catleeball/tmnt_wikipedia_bot/) 29 | - [Year Progress Twitter bot](https://github.com/MrDatastorage/Year-Progress-Twitter-Bot) 30 | - [100daysofcode bot](https://github.com/freeCodeCamp/100DaysOfCode-twitter-bot) 31 | - [Tweepy Twitter Bot](https://realpython.com/twitter-bot-python-tweepy/) 32 | - [Github release -> Twitter bot](https://dev.to/prahladyeri/announcing-ghannounce-a-python-bot-that-posts-a-tweet-each-time-you-make-a-release-on-github-5abc) 33 | - Tracery generative story twitter bots: [BotWiki](https://botwiki.org/learn/), [Intro to Twitter Bots](https://programminghistorian.org/en/lessons/intro-to-twitterbots), [Cheap bots done quick](https://cheapbotsdonequick.com/) 34 | - [Google Earth stills over time bot](https://github.com/doersino/earthacrosstime) 35 | - [AWS markov chain bot](https://github.com/pndurette/aws_prodbot) - js version https://github.com/swang/markovchain 36 | - [Ace Attorney bot](https://github.com/LuisMayo/ace-attorney-twitter-bot) 37 | 38 | twint https://nixintel.info/osint/the-attrition-of-information-in-osint-why-acting-quickly-matters-and-how-to-recover-when-you-dont/ 39 | 40 | small replit twitter bots (usually useless) 41 | 42 | - [Another tweepy bot](https://repl.it/talk/share/Twitter-Bot/2738) 43 | - [Old tweepy bot](https://repl.it/@LilyInskip_Shes/Twitter-Bot) 44 | 45 | 46 | ### discord bots 47 | 48 | - [Discordpy bots](https://repl.it/talk/learn/Hosting-discordpy-bots-with-replit/11008) 49 | - [Nodejs discord bot](https://www.codementor.io/@garethdwyer/building-a-discord-bot-with-node-js-and-repl-it-mm46r1u8y) 50 | - [Typescript community bot](https://github.com/typescript-community/community-bot) 51 | - discord bot for community moderation - https://top.gg/bot/677184239472607299 52 | - snowpack comunity has it 53 | 54 | ### whatsapp 55 | 56 | - [Build a Whatsapp bot](https://repl.it/talk/challenge/Build-a-WhatsApp-bot-in-30-minutes/7673) 57 | 58 | ### tiktok 59 | 60 | - [Tiktok Scraper](https://dev.to/id1/tiktok-scraper-25a9) 61 | 62 | ### general automation 63 | 64 | - https://github.com/huginn/huginn (Ruby) 65 | - https://n8n.io/ 66 | - https://nodered.org/ 67 | - https://github.com/agenda/agenda nodes jobrunner 68 | - https://airflow.apache.org/ 69 | - more https://news.ycombinator.com/item?id=21772610 70 | - https://news.ycombinator.com/item?id=20822637 71 | - python! https://automatetheboringstuff.com/2e/ 72 | 73 | 74 | ### scraping 75 | 76 | Info from Checkly/Tim Nolet ([podcast](https://stackoverflow.blog/2020/12/15/podcast-295-diving-into-headless-automation-active-monitoring-playwright-and-puppeteer/)) 77 | 78 | - Old: Selenium 79 | - New: https://developers.google.com/web/tools/puppeteer (Google), https://playwright.dev/ (ex Puppeteer team left for Microsoft), [Headless Recorder from checkly](https://github.com/checkly/headless-recorder) generates scripts for either 80 | - learn either: https://theheadless.dev 81 | - https://mihaisplace.blog/2021/10/03/the-state-of-web-scraping-in-2021/ 82 | 83 | misc 84 | 85 | - https://github.com/lorien/awesome-web-scraping 86 | - https://simonwillison.net/2020/Nov/14/personal-data-warehouses/ 87 | - https://beepb00p.xyz/exports.html 88 | - https://news.ycombinator.com/item?id=23142220 89 | - https://news.ycombinator.com/item?id=22778089 90 | - https://www.scrapingbee.com/blog/web-scraping-javascript/ 91 | - https://www.scrapingbee.com/ 92 | - https://www.scrapingbee.com/blog/web-scraping-without-getting-blocked/ 93 | - their Twitter surfaces good stuff 94 | - setting cookies https://theheadless.dev/posts/managing-cookies/ 95 | - https://twitter.com/SahinKevin/status/1216343661459451906?s=20 96 | - https://qoob.cc/web-scraping/ 97 | - https://chrome.google.com/webstore/detail/simplescraper-%E2%81%A0%E2%80%94-a-fast-a/lnddbhdmiciimpkbilgpklcglkdegdkg?utm_source=brainpint&utm_medium=email&utm_campaign=its_ok_to_go_off_script&utm_term=2021-07-06 98 | * [Beehive](https://github.com/muesli/beehive) - A flexible event/agent & automation system with lots of bees 99 | * [DataFire](https://github.com/DataFire/DataFire) - An open source framework for building and integrating APIs. Each integration provides a set of composable actions. New actions can be built by combining existing actions, JavaScript, and external libraries. They are driven by JavaScript Promises, and can be triggered by a URL, on a schedule, or manually. 100 | * [Kibitzr](https://kibitzr.github.io) - Get notified when important things happen 101 | * [Netflix Scumblr](https://github.com/Netflix/Scumblr) ([#1522](https://github.com/cantino/huginn/issues/1522)) - A web application that allows performing periodic searches and storing / taking actions on the identified results. 102 | * [Node-RED](http://nodered.org) ([#1296](https://github.com/cantino/huginn/issues/1296)) - A tool for wiring together hardware devices, APIs, and online services in new and interesting ways. 103 | * [NoFlo](https://NoFlojs.org) - A JavaScript implementation of Flow-Based Programming (FBP). Separating the control flow of software from the actual software logic. Helping you organize large applications easier than traditional OOP paradigms, especially when importing and modifying large data sets. 104 | * [Pico-Engine](https://github.com/Picolab/pico-engine/) - A prototype implementation of the pico-engine written in node.js 105 | * [Riemann](https://github.com/riemann/riemann) - "A network event stream processing system, in Clojure. Riemann aggregates events from your servers and applications with a powerful stream processing language." 106 | * [RSS-Bridge](https://github.com/RSS-Bridge/rss-bridge) - A PHP application offering a wide selection of feeds for popular and niche services. This includes several services where queries are involved, such as translating Twitter accounts or searches into atom/JSON feeds. Possibly a valuable source of easy data for simpler Huginn scenarios. 107 | * [Trigger Happy](https://github.com/foxmask/django-th) - "opensource clone of IFTTT, a bridge between your internet services" 108 | * [Welcomer Framework](https://github.com/welcomer/framework) - Supports building microservices to flexibly automate your online tasks, putting control of your personal data back in your hands. 109 | * https://apify.com 110 | 111 | to Scrape Twitter you have to fake googlebot 112 | https://twitter.com/magusnn/status/1339833122456662017?s=20 113 | 114 | webscraper.io 115 | 116 | ### companies 117 | 118 | - Tray.io https://techcrunch.com/2019/11/26/tray-io-brings-in-50m-more-at-a-600m-valuation-for-its-workflow-automation-tools/ 119 | - pipedream 120 | - https://n8n.io/ 121 | 122 | ## text generation 123 | 124 | - https://github.com/minimaxir/gpt-2-simple 125 | 126 | ## users 127 | 128 | - webflow 129 | - https://twitter.com/tomjohndesign/status/1199027657473712128 130 | 131 | ## Scraping 132 | 133 | - https://www.daolf.com/posts/avoiding-being-blocked-while-scraping-ultimate-guide/ 134 | - https://tryspider.com/ 135 | - https://medium.com/hackernoon/scraping-the-web-with-node-js-f7da67d2f734 136 | - https://github.com/paperswithcode/sota-extractor 137 | - https://github.com/karpathy/arxiv-sanity-preserver 138 | - https://theheadless.dev/ 139 | 140 | 141 | WEBCRAWLING ARCHITECTURE https://nlp.stanford.edu/IR-book/information-retrieval-book.html https://news.ycombinator.com/item?id=24338964 142 | 143 | ## Low Code 144 | 145 | - Slack https://slackhq.com/automate-tasks-in-slack-with-workflow-builder 146 | 147 | ## Funny 148 | 149 | - https://github.com/pjf/rickastley 150 | --------------------------------------------------------------------------------