├── CONTRIBUTING.md ├── LICENSE └── README.md /CONTRIBUTING.md: -------------------------------------------------------------------------------- 1 | # Contribution Guide 2 | 3 | - If you find a resource that would be great fit here, send a pull request. 4 | - Before creating a pull request, make sure to check if your suggestion is already included. 5 | - The format for a row in the table looks like the following: 6 | ``` 7 | [Title](url) | Company | Date (Month, Year) 8 | ``` 9 | - The contents in the table are sorted by the year and month of the publication in the descending order. Make sure your suggestion are present in the correct location. The order of contents with same month and year of publication is not important. 10 | 11 | Thank you for contributing 😊 -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2021 Prashant Anand 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # LLMs in Production 2 | 3 | [![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen.svg?style=flat)](./CONTRIBUTING.md) [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT) 4 | 5 | A curated collection of engineering blogs on the use of **Large Language Models (LLMs) in production**. 6 | 7 | If you've been searching for information on LLMs online, you've probably come across numerous articles explaining what LLMs are, how they work, steps for integrating them into your applications, and their potential applications in various industries. Two of the best ones I've read are from Chip Huyen ([Building LLM applications for production](https://huyenchip.com/2023/04/11/llm-engineering.html#part_3_promising_use_cases)) and Eugene Yan ([Patterns for Building LLM-based Systems & Products](https://eugeneyan.com/writing/llm-patterns/)). 8 | 9 | > It's easy to make something cool with LLMs, but very hard to make something production-ready with them. 10 | 11 | I wholeheartedly agree with Chip's statement in the linked blog post. On top of top that, I'd add that making something production-ready with LLMs that actually benefits a business (improves a business metric in a cost-efficient way) is damn hard! I have found it pretty hard to find blogs describing the use of LLMs in real products to tackle actual business issues. 12 | 13 | I'll list the engineering blogs from different companies that I've explored and read here. These blogs detail real-world applications of LLMs in solving specific business problems. I hope they will provide valuable insights and ideas on how you might employ LLMs to address challenges in your business problems. 14 | 15 | I'll keep the list updated as and when I find new blogs. If you find a blog that fits here, send a PR or share it with me! 16 | 17 | Title | Company | Date 18 | ------|---------|----- 19 | [A scalable LLM approach to enhancing chatbot knowledge with user-generated content](https://careersatdoordash.com/blog/doordash-llm-chatbot-knowledge-with-ugc/) | DoorDash | Aug, 2025 20 | [Unlocking Financial Insights with Finch: Uber’s Conversational AI Data Agent](https://www.uber.com/en-JP/blog/unlocking-financial-insights-with-finch/) | Uber | Jul, 2025 21 | [Profile Generation with LLMs: Understanding consumers, merchants, and items](https://careersatdoordash.com/blog/doordash-profile-generation-llms-understanding-consumers-merchants-and-items/) | DoorDash | Jul, 2025 22 | [Advancing Menu Content with AI: How DoorDash uses AI to generate menu descriptions](https://careersatdoordash.com/blog/doordash-ai-menu-descriptions/) | DoorDash | Jun, 2025 23 | [Enhanced Agentic-RAG: What If Chatbots Could Deliver Near-Human Precision?](https://www.uber.com/en-JP/blog/enhanced-agentic-rag/) | Uber | May, 2025 24 | [Evolution of Product Classification at Shopify: From Categories to Comprehensive Product Understanding](https://shopify.engineering/evolution-product-classification) | Shopify | May, 2025 25 | [Building the next generation of job search at LinkedIn](https://www.linkedin.com/blog/engineering/ai/building-the-next-generation-of-job-search-at-linkedin) | LinkedIn | May, 2025 26 | [Advancing Invoice Document Processing at Uber using GenAI](https://www.uber.com/en-IN/blog/advancing-invoice-document-processing-using-genai/) | Uber | Apr, 2025 27 | [Building Dash: How RAG and AI agents help us meet the needs of businesses](https://dropbox.tech/machine-learning/building-dash-rag-multi-step-ai-agents-business-users) | Dropbox | Apr, 2025 28 | [Improving Pinterest Search Relevance Using Large Language Models](https://medium.com/pinterest-engineering/improving-pinterest-search-relevance-using-large-language-models-4cd938d4e892) | Pinterest | Apr, 2025 29 | [Using LLM to transcribe restaurant menu photos](https://careersatdoordash.com/blog/doordash-llm-transcribe-menu/) | DoorDash | Mar, 2025 30 | [Automated GenAI-driven search quality evaluation](https://www.linkedin.com/blog/engineering/ai/automated-genai-driven-search-quality-evaluation) | LinkedIn | Dec, 2024 31 | [How DoorDash leverages LLMs for better search retrieval](https://careersatdoordash.com/blog/how-doordash-leverages-llms-for-better-search-retrieval/) | DoorDash | Nov, 2024 32 | [Unleashing the power of large language models at DoorDash for a seamless shopping adventure](https://careersatdoordash.com/blog/unleashing-the-power-of-large-language-models-at-doordash-for-a-seamless-shopping-adventure/) | DoorDash | Oct, 2024 33 | [Automation Platform v2: Improving Conversational AI at Airbnb](https://medium.com/airbnb-engineering/automation-platform-v2-improving-conversational-ai-at-airbnb-d86c9386e0cb) | Airbnb | Oct, 2024 34 | [Leveraging RAG-powered LLMs for Analytical Tasks](https://engineering.grab.com/transforming-the-analytics-landscape-with-RAG-powered-LLM) | Grab | Oct, 2024 35 | [Fine-Tuning an LLM to Extract Dynamically Specified Attributes](https://engineering.mercari.com/en/blog/entry/20240913-fine-tuning-an-llm-to-extract-dynamically-specified-attributes/) | Mercari | Sep, 2024 36 | [QueryGPT – Natural Language to SQL Using Generative AI](https://www.uber.com/en-JP/blog/query-gpt/?uclick_id=eaf82e80-940f-4baf-87d6-76c4fbd37f1a) | Uber | Sep, 2024 37 | [Supercharging Discovery in Search with LLMs](https://tech.instacart.com/supercharging-discovery-in-search-with-llms-556c585d4720) | Instacart | Sep, 2024 38 | [Path to high-quality LLM-based Dasher support automation](https://careers.doordash.com/blog/large-language-modules-based-dasher-support-automation/) | DoorDash | Sep, 2024 39 | [Using Predictive and Gen AI to Improve Product Categorization at Walmart](https://medium.com/walmartglobaltech/using-predictive-and-gen-ai-to-improve-product-categorization-at-walmart-dc9821c6a481) | Walmart | Jul, 2024 40 | [Hermes: A Text-to-SQL solution at Swiggy](https://bytes.swiggy.com/hermes-a-text-to-sql-solution-at-swiggy-81573fb4fb6e) | Swiggy | Jul, 2024 41 | [Bringing AI-powered answers and summaries to file previews on the web](https://dropbox.tech/machine-learning/bringing-ai-powered-answers-and-summaries-to-file-previews-on-the-web) | Dropbox | Jul, 2024 42 | [LLM-powered data classification for data entities at scale](https://engineering.grab.com/llm-powered-data-classification) | Grab | Jul, 2024 43 | [Using AI to Understand the Complexities and Pitfalls of Real Estate Data](https://www.zillow.com/tech/using-ai-to-understand-the-complexities-and-pitfalls-of-real-estate-data/) | Zillow | Apr, 2024 44 | [Building DoorDash’s Product Knowledge Graph with Large Language Models](https://doordash.engineering/2024/04/23/building-doordashs-product-knowledge-graph-with-large-language-models/) | DoorDash | Apr, 2024 45 | [Navigating Fair Housing Guardrails in LLMs](https://www.zillow.com/tech/navigating-fair-housing-guardrails-in-llms/) | Zillow | Jan, 2024 46 | [Leveraging LLMs in Production: Looking Back, Going Forward](https://engineering.mercari.com/en/blog/entry/20231219-leveraging-llms-in-production-looking-back-going-forward/) | Mercari | Dec, 2023 47 | [CoEdIT: State-of-the-Art Text Editing With Fewer Parameters](https://www.grammarly.com/blog/engineering/coedit-text-editing/) | Grammarly | Dec, 2023 48 | [Let AI Entertain You: Increasing User Engagement with Generative AI and Rejection Sampling](https://engblog.nextdoor.com/let-ai-entertain-you-increasing-user-engagement-with-generative-ai-and-rejection-sampling-50a402264f56) | Nextdoor | Oct, 2023 49 | [Dont you (forget NLP): Prompt injection with control characters in ChatGPT](https://dropbox.tech/machine-learning/prompt-injection-with-control-characters-openai-chatgpt-llm) | Dropbox | Jul, 2023 50 | [From reviews to insights: Building analytic applications with Large Language Models in e-commerce](https://medium.com/data-science-at-microsoft/from-reviews-to-insights-building-analytic-applications-with-large-language-models-in-e-commerce-ad28ee60e2a7) | Microsoft | Jul, 2023 51 | [Automating data analytics with ChatGPT](https://medium.com/data-science-at-microsoft/automating-data-analytics-with-chatgpt-827a51eaa2c) | Microsoft | Jul, 2023 52 | [The Right Tools For The Job](https://tech.buzzfeed.com/the-right-tools-for-the-job-c05de96e949e) | BuzzFeed | May, 2023 53 | [How AI Text Generation Models Are Reshaping Customer Support at Airbnb](https://medium.com/airbnb-engineering/how-ai-text-generation-models-are-reshaping-customer-support-at-airbnb-a851db0b4fa3) | Airbnb | Nov, 2022 54 | --------------------------------------------------------------------------------