└── README.md /README.md: -------------------------------------------------------------------------------- 1 | # 🤖 AI/ML Resources 2 | 3 | Curated collection of AI/ML resources and tools to jumpstart your artificial intelligence and machine learning journey. Explore tutorials, datasets, libraries, and more! 4 | 5 | If you like this content, you may also be interested in getting the [newsletter](https://hn-ai-newsletter.beehiiv.com/) with a weekly AI/ML digest from Hacker News in your mailbox. 6 | 7 | PRs with additional resources or suggestions are much welcome! 8 | 9 | ## Resources 📕 10 | 11 | ### Learning Resources 📚 12 | 13 | - [Neural Networks: Zero to Hero](https://karpathy.ai/zero-to-hero.html) - From Andrej Karpathy, former Director of AI at Tesla and now at OpenAI. 14 | - [Full Stack LLM Bootcamp](https://fullstackdeeplearning.com/llm-bootcamp/) - From the creators of the [Full Stack Deep Learning](https://fullstackdeeplearning.com/) course and book. 15 | - [All about LLMs](https://gist.github.com/rain-1/eebd5e5eb2784feecf450324e3341c8d) - A gist with great curated learning resources. 16 | - [Transformers](https://www.youtube.com/watch?v=XfpMkf4rD6E) - Introduction to Transformers with Andrej Karpathy. 17 | - [The Illustrated Transformer](https://jalammar.github.io/illustrated-transformer/) - A great visual explanation of the Transformer architecture. 18 | - [How ChatGPT really works](https://bootcamp.uxdesign.cc/how-chatgpt-really-works-explained-for-non-technical-people-71efb078a5c9) - A great initial explanation of how ChatGPT works. 19 | - [ChatGPT Prompt Engineering for Developers!](https://www.deeplearning.ai/short-courses/chatgpt-prompt-eng/) - Great course by OpenAI employees. 20 | - [Learn Prompting](https://learnprompting.org/) - Another great course (text-based) about prompting. 21 | - [Prompt Engineering Guide](https://github.com/dair-ai/Prompt-Engineering-Guide) - Guides, papers, lectures, and resources for prompt engineering. 22 | - [Prompt Engineering](https://lilianweng.github.io/posts/2023-03-15-prompt-engineering/) - Great post from Lilian Weng, Head of Applied AI Research at OpenAI. 23 | - [MLOps Guide](https://github.com/Nyandwi/machine_learning_complete/blob/main/010_mlops/1_mlops_guide.md) - A guide on MLOps. 24 | - [MLOps Zoomcamp](https://github.com/DataTalksClub/mlops-zoomcamp) - A great course on MLOps. 25 | - [Gandalf](https://gandalf.lakera.ai/) - A fun way to learn about prompt injection. 26 | - [Practical Deep Learning](https://course.fast.ai/) - A course designed for people with some coding experience who want to learn how to apply deep learning and machine learning to practical problems. 27 | - [Let's build GPT](https://www.youtube.com/watch?v=kCc8FmEb1nY) - From Andrej Karpathy, Let's build GPT: from scratch, in code, spelled out. 28 | - [AI Canon](https://a16z.com/2023/05/25/ai-canon/) - A great curated list of resources to get smarter about modern AI. 29 | - [Generative AI Learning Path](https://www.cloudskillsboost.google/paths/118) - This learning path guides you through curated content on Generative AI products and technologies. 30 | - [Rules of Machine Learning](https://developers.google.com/machine-learning/guides/rules-of-ml) - Intended to help those with a basic knowledge of machine learning get the benefit of Google's best practices. 31 | - [AI Companion App](https://github.com/a16z-infra/companion-app) - A tutorial stack to create and host AI companions that you can chat with on a browser or text via SMS. 32 | - [Microsoft AI Lab](https://github.com/microsoft/ailab) - AI Lab helps a large, fast-growing community of developers get started on AI. 33 | - [ML Course Notes](https://github.com/dair-ai/ML-Course-Notes) - A place to collaborate and share lecture notes on all topics related to machine learning, NLP, and AI. 34 | - [Generative AI for Beginners](https://github.com/microsoft/generative-ai-for-beginners) - A 12-lesson course teaching everything you need to know to start building Generative AI applications. 35 | - [ML YouTube Courses](https://github.com/dair-ai/ML-YouTube-Courses) - An index of some of the best and most recent machine learning courses available on YouTube. 36 | - [ML Papers Explained](https://github.com/dair-ai/ML-Papers-Explained) - Explanations of key concepts in machine learning. 37 | - [LLM Course](https://github.com/mlabonne/llm-course) - A course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks. 38 | - [Hugging Face Course](https://github.com/huggingface/course) - Learn how to apply Transformers to various tasks in natural language processing and beyond. 39 | - [Andrew Ng’s Machine Learning](https://www.coursera.org/learn/machine-learning) - A foundational course on machine learning. 40 | - [Machine Learning Roadmap](https://github.com/mrdbourke/machine-learning-roadmap) - A roadmap connecting important concepts in machine learning. 41 | - [Robert Miles AI Safety](https://www.youtube.com/@RobertMilesAI) - YouTube channel about AI safety. 42 | 43 | ### LLMs 44 | 45 | - [OpenAI LLMs](https://openai.com/product/gpt-4) - The best LLMs, especially GPT-4. GPT-3.5 and GPT-4 are used in ChatGPT. 46 | - [Hugging Face](https://huggingface.co/) - The leading open-source AI community. Find trending models, datasets, and spaces. 47 | - [Bloom](https://huggingface.co/bigscience/bloom) - An open-source multilingual model similar to GPT-3. 48 | - [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/) - A foundational large language model by Meta. 49 | - [Llama 2](https://ai.meta.com/llama/) - The next generation of Meta's open-source large language model. 50 | - [JARVIS](https://github.com/microsoft/JARVIS) - An interface for LLMs to connect numerous AI models. 51 | - [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) - Evaluate and rank open-source LLMs. 52 | - [Vicuna-13B](https://lmsys.org/blog/2023-03-30-vicuna/) - An open-source chatbot fine-tuned from LLaMA. 53 | - [Guidance](https://github.com/microsoft/guidance) - Control modern language models more effectively and efficiently. 54 | - [TheBloke on Hugging Face](https://huggingface.co/TheBloke) - Compiles the best open-source models in various formats. 55 | - [DemoGPT](https://github.com/melih-unsal/DemoGPT) - Create 🦜️🔗 LangChain apps by just using prompts. 56 | - [Llama2 Web UI](https://github.com/liltom-eth/llama2-webui) - Run Llama 2 with Gradio web UI on GPU or CPU from anywhere. 57 | - [llama.cpp](https://github.com/ggerganov/llama.cpp) - Run LLaMA model using 4-bit integer quantization on a MacBook and more. 58 | - [LocalAI](https://github.com/mudler/LocalAI) - Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. 59 | - [LocalAGI](https://github.com/mudler/LocalAGI) - A small virtual assistant you can run locally, powered by LocalAI. 60 | - [Ollama](https://github.com/jmorganca/ollama) - A backend that allows you to run large language models locally. 61 | - [KoboldCpp](https://github.com/LostRuins/koboldcpp) - An easy-to-use AI text-generation software for GGML and GGUF models. 62 | - [GPT4All](https://github.com/nomic-ai/gpt4all) - Open-source large language models that run locally on your CPU and nearly any GPU. 63 | - [vLLM](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs. 64 | - [ExLlama](https://github.com/turboderp/exllamav2) - A fast inference library for running LLMs locally on modern consumer-class GPUs. 65 | - [Stable Beluga 2](https://huggingface.co/stabilityai/StableBeluga2) - A fine-tuned Llama2 70B model. 66 | - [Claude 2](https://www.anthropic.com/index/introducing-claude-2) - An AI assistant from Anthropic with advanced reasoning and extended context. 67 | 68 | ### Chat and Agents 69 | 70 | - [ChatGPT](https://chat.openai.com/) - The leading chatbot built on GPT-3.5 and GPT-4. 71 | - [Bing Chat](https://www.bing.com/chat) - A conversational AI language model powered by Microsoft Bing. 72 | - [Open-Assistant](https://github.com/LAION-AI/Open-Assistant) - Open-source chat agent that interacts with external sources. 73 | - [Auto-GPT](https://github.com/Significant-Gravitas/Auto-GPT) - An experimental open-source attempt to make GPT-4 fully autonomous. 74 | - [LoopGPT](https://github.com/farizrahman4u/loopgpt) - A modular reimplementation of Auto-GPT. 75 | - [ThinkGPT](https://github.com/jina-ai/thinkgpt) - Implementing Chain-of-Thought reasoning for Large Language Models. 76 | - [Transformers Agents](https://huggingface.co/docs/transformers/transformers_agents) - Provides a natural language API on top of transformers. 77 | - [MetaGPT](https://github.com/geekan/MetaGPT) - The Multi-Agent Framework: Given one-line requirement, return PRD, design, tasks, repo. 78 | - [GPT-Engineer](https://github.com/AntonOsika/gpt-engineer) - Specify what you want it to build; the AI asks for clarification and then builds it. 79 | - [Khoj](https://github.com/khoj-ai/khoj) - An AI personal assistant for your digital brain. 80 | - [Danswer](https://github.com/danswer-ai/danswer) - Open-source enterprise question-answering. 81 | - [simpleaichat](https://github.com/minimaxir/simpleaichat) - Python package for easily interfacing with chat apps. 82 | - [RealChar](https://github.com/Shaunwei/RealChar) - Create and chat with AI characters. 83 | - [ChatGPT AutoExpert](https://github.com/spdustin/ChatGPT-AutoExpert) - Supercharged Custom Instructions for ChatGPT. 84 | - [Bee Agent Framework](https://github.com/i-am-bee/bee-agent-framework) - Framework for building scalable agentic applications. 85 | - [Local AI](https://github.com/louisgv/local.ai) - A desktop app for local, private, secured AI experimentation. 86 | - [Serge](https://github.com/serge-chat/serge) - A chat interface crafted with llama.cpp for running GGUF models. 87 | - [SillyTavern](https://github.com/SillyTavern/SillyTavern) - A chat UI for interacting with text generation AIs and roleplay characters. 88 | - [TavernAI](https://github.com/TavernAI/TavernAI) - An atmospheric frontend for chat and story writing. 89 | - [Maid](https://github.com/danemadsen/Maid) - A cross-platform Flutter app for interfacing with GGUF/llama.cpp models locally. 90 | - [AgentGPT](https://github.com/reworkd/AgentGPT) - Configure and deploy autonomous AI agents. 91 | - [SuperAGI](https://github.com/TransformerOptimus/SuperAGI) - A dev-first open-source autonomous AI agent framework. 92 | - [BabyAGI](https://github.com/yoheinakajima/babyagi) - AI-powered task management system using OpenAI. 93 | - [Open Interpreter](https://github.com/KillianLucas/open-interpreter/) - Open-source, locally running implementation of OpenAI's Code Interpreter. 94 | - [AutoPR](https://github.com/irgolic/AutoPR) - Automated pull request workflow powered by AI. 95 | - [Phind](https://www.phind.com/) - An AI search engine and assistant for programmers. 96 | - [Character.AI](https://beta.character.ai/) - Create and chat with AI-powered characters. 97 | 98 | ### Development 99 | 100 | - [LangChain](https://github.com/hwchase17/langchain) - Framework for developing applications powered by LLMs. 101 | - [Pinecone](https://www.pinecone.io/) - Long-term memory for models with a vector database. 102 | - [Chroma](https://www.trychroma.com/) - The open-source alternative to Pinecone. 103 | - [Plug-in-Play](https://github.com/edreisMD/plugnplai) - Simplify the integration of plugins into open-source LLMs. 104 | - [GPTCache](https://github.com/zilliztech/GPTCache) - Caching for LLM responses. Useful for cost savings. 105 | - [OpenAI Cookbook](https://github.com/openai/openai-cookbook) - A collection of examples and best practices for building with OpenAI. 106 | - [How to build an agent with LangChain](https://github.com/openai/openai-cookbook/blob/main/examples/How_to_build_a_tool-using_agent_with_langchain.ipynb) - Great Jupyter notebook from OpenAI. 107 | - [Mojo](https://docs.modular.com/mojo/) - A new programming language combining Python syntax with systems programming. 108 | - [Semantic Kernel](https://github.com/microsoft/semantic-kernel) - SDK that enables integration of AI LLMs with conventional programming languages. 109 | - [Langcorn](https://github.com/msoedov/langcorn) - API server for serving LangChain models with FastAPI. 110 | - [smol developer](https://github.com/smol-ai/developer) - Your own personal junior developer :) 111 | - [smol plugin](https://github.com/gmchad/smol-plugin) - Automatically generate OpenAI plugins by specifying your API in markdown. 112 | - [Kor](https://eyurtsev.github.io/kor/tutorial.html) - A thin wrapper on top of LLMs to extract structured data. 113 | - [tiktoken](https://github.com/openai/tiktoken) - A fast BPE tokenizer used with OpenAI's models. 114 | - [OpenAI Function Calling](https://platform.openai.com/docs/guides/gpt/function-calling) - Standardize LLM output. 115 | - [Vercel AI SDK](https://github.com/vercel-labs/ai) - Build AI-powered applications with React, Svelte, and Vue. 116 | - [Code Interpreter API](https://github.com/shroominic/codeinterpreter-api) - Open-source implementation of ChatGPT Code Interpreter. 117 | - [Unsloth](https://github.com/unslothai/unsloth) - Framework for fine-tuning Large Language Models. 118 | - [Pezzo](https://github.com/pezzolabs/pezzo) - Developer-first LLMOps platform to streamline prompt design and version management. 119 | - [Lunary](https://github.com/lunary-ai/lunary) - Production toolkit for LLMs focusing on observability and evaluations. 120 | - [Ludwig](https://github.com/ludwig-ai/ludwig) - Low-code framework for building custom AI models. 121 | - [Langroid](https://github.com/langroid/langroid) - Lightweight Python framework to build LLM-powered applications. 122 | - [LLMware](https://github.com/llmware-ai/llmware) - Unified framework for developing LLM-based application patterns. 123 | - [LLM App](https://github.com/pathwaycom/llm-app) - Production framework for building and serving AI applications. 124 | - [LlamaIndex](https://github.com/jerryjliu/llama_index) - A data framework for building LLM applications over external data. 125 | - [LMQL](https://lmql.ai/) - A query language for large language models. 126 | - [Haystack](https://haystack.deepset.ai/) - Framework for building NLP applications with language models. 127 | - [Prediction Guard](https://www.predictionguard.com/) - Integrate private, controlled, and compliant LLM functionality. 128 | - [Portkey](https://portkey.ai/) - LLMOps platform to monitor, manage, and improve LLM-based apps. 129 | 130 | ### Tools 131 | 132 | - [Vault AI](https://github.com/pashpashpash/vault-ai) - Tool for uploading documents and asking questions about their content. 133 | - [LangFlow](https://github.com/logspace-ai/langflow) - Visual prototyping and experimentation with LangChain. 134 | - [Flowise](https://github.com/FlowiseAI/Flowise) - Visual tool to build your customized LLM flow. 135 | - [PentestGPT](https://github.com/GreyDGL/PentestGPT) - A GPT-empowered penetration testing tool 🕵️. 136 | - [TypingMind](https://www.typingmind.com/) - A better UI for ChatGPT. 137 | - [privateGPT](https://github.com/imartinez/privateGPT) - Ask questions to your documents without an internet connection. 138 | - [Quivr](https://github.com/StanGirard/quivr) - Dump all your files and thoughts into your Generative AI second brain and chat with it. 139 | - [Stable Diffusion Web UI](https://github.com/AUTOMATIC1111/stable-diffusion-webui) - A browser interface based on Gradio for Stable Diffusion. 140 | - [h2oGPT](https://github.com/h2oai/h2ogpt) - Like privateGPT, but with GPU inference supported. 141 | - [localGPT](https://github.com/PromtEngineer/localGPT) - Inspired by privateGPT, using Vicuna-7b and InstructorEmbeddings. 142 | - [Promptflow](https://github.com/InsuranceToolkits/promptflow) - Create executable flowcharts linking LLMs, prompts, and functions. 143 | - [Dify](https://github.com/langgenius/dify) - Create and operate AI-native apps based on OpenAI GPT models. 144 | - [txtai](https://github.com/neuml/txtai) - Semantic search and workflows powered by language models. 145 | - [Unofficial OpenAI Status](https://openai-status.llm-utils.org/) - An in-depth OpenAI status page. 146 | - [gpt-prompt-engineer](https://github.com/mshumer/gpt-prompt-engineer) - Generates, tests, and ranks prompts for your task. 147 | - [rag-stack](https://github.com/psychic-api/rag-stack) - Deploy a private ChatGPT alternative hosted within your VPC. 148 | - [AnythingLLM](https://github.com/Mintplex-Labs/anything-llm) - Open-source ChatGPT equivalent for open and closed-source LLMs. 149 | - [DocsGPT](https://github.com/arc53/docsgpt) - Streamlines finding information in project documentation. 150 | - [Dialoqbase](https://github.com/n4ze3m/dialoqbase) - Facilitate the creation of custom chatbots using a knowledge base. 151 | 152 | #### ChatGPT Extensions 153 | 154 | - [WebChatGPT](https://chrome.google.com/webstore/detail/webchatgpt-chatgpt-with-i/lpfemeioodjbpieminkklglpmhlngfcn) - Augment ChatGPT prompts with relevant web results. 155 | - [GPT for Sheets and Docs](https://workspace.google.com/marketplace/app/gpt_for_sheets_and_docs/677318054654) - ChatGPT extension for Google Sheets and Docs. 156 | - [YouTube Summary with ChatGPT](https://chrome.google.com/webstore/detail/youtube-summary-with-chat/nmmicjeknamkfloonkhcjmomieiodli) - Summarize YouTube videos with ChatGPT. 157 | - [ChatGPT Prompt Genius](https://chrome.google.com/webstore/detail/chatgpt-prompt-genius/jjdnakkfjnnbbckhifcfchagnpofjffo) - Discover and share the best prompts for ChatGPT. 158 | - [ChatGPT for Search Engines](https://chrome.google.com/webstore/detail/chatgpt-for-search-engine/eeeonhemodpkdckaljcjogdncpiiban) - Display ChatGPT responses alongside search results. 159 | 160 | ### Code Assistants 161 | 162 | - [Refact](https://github.com/smallcloudai/refact) - Open-source AI coding assistant with code completion and chat. 163 | - [Draw a UI](https://github.com/SawyerHood/draw-a-ui) - Draw a mockup and generate HTML using AI. 164 | - [Continue](https://github.com/continuedev/continue) - Open-source autopilot for VS Code and JetBrains. 165 | - [Sweep AI](https://github.com/sweepai/sweep) - AI junior developer that turns bugs and requests into code changes. 166 | - [Cody](https://github.com/sourcegraph/cody) - Free, open-source AI coding assistant for code completion and Q&A. 167 | - [Aider](https://github.com/paul-gauthier/aider) - Pair program with GPT-3.5/GPT-4 to edit code in your git repo. 168 | - [AutoPR](https://github.com/irgolic/AutoPR) - Automated pull request workflow powered by AI. 169 | - [bloop](https://github.com/BloopAI/bloop) - ChatGPT for your codebase; search and generate patches. 170 | - [GitHub Copilot](https://github.com/features/copilot) - Uses OpenAI Codex to suggest code and functions. 171 | - [Ghostwriter](https://replit.com/site/ghostwriter) - AI-powered pair programmer by Replit. 172 | - [Amazon CodeWhisperer](https://aws.amazon.com/codewhisperer/) - Build applications faster with ML-powered coding companion. 173 | - [MutableAI](https://mutable.ai/) - AI-accelerated software development. 174 | - [GPT-Code UI](https://github.com/ricklamers/gpt-code-ui) - Open-source implementation of ChatGPT Code Interpreter. 175 | 176 | ### Vector Databases 177 | 178 | - [Weaviate](https://github.com/weaviate/weaviate) - An open-source vector database that's robust and scalable. 179 | - [Milvus](https://github.com/milvus-io/milvus) - Open-source vector database for embedding similarity search. 180 | - [Qdrant](https://github.com/qdrant/qdrant) - Vector similarity search engine and database. 181 | - [Deep Lake](https://github.com/activeloopai/deeplake) - Database for AI optimized for deep-learning applications. 182 | 183 | ### Stable Diffusion 184 | 185 | - [Stable Diffusion Web UI](https://github.com/AUTOMATIC1111/stable-diffusion-webui) - Browser interface for Stable Diffusion. 186 | - [Midjourney](https://www.midjourney.com/) - Independent research lab exploring new mediums of thought. 187 | - [InvokeAI](https://github.com/invoke-ai/InvokeAI) - Creative engine for Stable Diffusion models. 188 | - [ComfyUI](https://github.com/comfyanonymous/ComfyUI) - Powerful and modular Stable Diffusion GUI and backend. 189 | - [Lama Cleaner](https://github.com/Sanster/lama-cleaner) - Image inpainting tool powered by SOTA AI models. 190 | 191 | ### Audio Generation 192 | 193 | #### AI Voice Cloning 194 | 195 | - [Eleven Labs](https://beta.elevenlabs.io/) - AI voice generator with lifelike voices. 196 | - [Resemble AI](https://www.resemble.ai/) - AI voice generator and voice cloning for text-to-speech. 197 | - [Murf AI](https://murf.ai/) - Create voiceovers with lifelike AI voices. 198 | - [Bark](https://github.com/suno-ai/bark) - Transformer-based text-to-audio model. #opensource 199 | 200 | #### Music Generation 201 | 202 | - [Harmonai](https://www.harmonai.org/) - Open-source generative audio tools for music production. 203 | - [Mubert](https://www.mubert.com/) - Royalty-free music ecosystem powered by AI. 204 | - [MusicLM](https://google-research.github.io/seanet/musiclm/examples/) - Google's model for generating high-fidelity music from text. 205 | 206 | ### Marketing AI Tools 207 | 208 | - [Jasper AI](https://www.jasper.ai/) - AI-powered tool for generating marketing content like blogs, emails, and ad copy. 209 | - [Mutiny](https://www.mutinyhq.com/) - Personalization platform to improve website conversions using AI. 210 | - [Clearbit](https://clearbit.com/) - Lead enrichment and data intelligence platform. 211 | - [Adzooma](https://www.adzooma.com/) - AI-powered PPC campaign management platform. 212 | - [Phrasee](https://www.phrasee.co/) - AI tool that generates optimized marketing copy. 213 | - [Rupert AI](https://www.getrupert.com/) - AI tools for designers and marketers. 214 | - [Persuva](https://persuva.ai) - AI-driven platform to create persuasive, high-converting ad copy at scale. 215 | 216 | ### Other 217 | 218 | - [PromptBase](https://promptbase.com/) - Marketplace for buying and selling quality prompts for AI models. 219 | - [Have I Been Trained?](https://haveibeentrained.com/) - Check if your image has been used to train AI art models. 220 | - [GummySearch](https://gummysearch.com/) - AI-based customer research via Reddit. 221 | - [Taplio](https://taplio.com/) - AI-powered LinkedIn tool. 222 | - [PromptPal](https://promptpal.net) - Search for prompts and bots, then use them with your favorite AI. 223 | - [Code to Flow](https://codetoflow.com) - Visualize code logic as flowcharts using AI. 224 | - [AI-Flow](https://ai-flow.net/) - Connect multiple AI models easily. 225 | - [Architecture Helper](https://architecturehelper.com) - Analyze building architecture and generate custom styles. 226 | 227 | --------------------------------------------------------------------------------