└── README.md /README.md: -------------------------------------------------------------------------------- 1 | # MLOPS - Definitive Guides for DevOps Engineers 2 | A curated list of publicly available and community-contributed resources to learn MLOPS. 3 | 4 | This repository is focused on people who want to start with MLOPS from a DevOps background. 5 | 6 | ## What is MLOPS? 7 | 8 | MLOPS is a practice followed to develop and deploy machine learning applications. 9 | 10 | MLOPS = DevOps + Machine Learning 11 | 12 | If you follow DevOps culture and practices for ML projects, you can call it as MLOPS. 13 | 14 | Here is the high-level workflow of an MLOps pipeline. 15 | 16 |

17 | MLOPS 18 |

19 | 20 | 21 | ## How is MLOPS is different from DevOps? 22 | 23 | MLOPS is different from DevOps in the same areas how a Machine learning development is different from a traditional software development process. 24 | 25 | As Devops engineers, we understand the complete life cycle of an application from development to production. It includes CI/CD, logging, monitoring, alerting, etc. 26 | 27 | In the same way, for MLOPS, a DevOps engineer should understand the ML application lifecycle and core concepts around it. It enables the DevOps engineer to collaborate when multiple ML teams are involved. 28 | 29 | Following are the key teams involved in MLOPS 30 | 31 | 1. **Data Scientists:** These are the experts who develop and train the machine learning models. They understand the business problem and translate it into a modeling approach. They're the brains behind the algorithms! 32 | 2. **Data Engineers:** They build the infrastructure to collect, store, and process the data used to train and deploy the models. They are the plumbers who ensure the data flows smoothly. 33 | 3. **Software Engineers:** They develop the web applications or APIs that will use the machine learning models. They ensure the models can be easily integrated into existing systems. 34 | 4. **ML Engineers:** These folks combine the skills of data scientists and software engineers. They take the models from development to production, building pipelines to automate the training, deployment, and monitoring processes. They bridge the gap between creating and implementing the models. 35 | 5. **DevOps engineers:** They automate the process of deploying and managing the machine learning models in production. They ensure the models are reliable and scalable. 36 | 6. **Business Stakeholders:** These are the people who represent the business needs and goals for the machine learning project. They define the success metrics and ensure that the models are aligned with the overall business strategy. 37 | 38 | ## Role of DevOps in MLOPS 39 | 40 | DevOps brings automation and collaboration to MLOps, making machine learning model development and deployment smoother. 41 | 42 | Here are some guide to get started. 43 | 44 | 1. [Why is DevOps for Machine Learning so Different?](https://hackernoon.com/why-is-devops-for-machine-learning-so-different-384z32f1) 45 | 2. [Need for DevOps for ML Data](https://www.tecton.ai/blog/devops-ml-data/) 46 | 3. [MLOps and DevOps: Why Data Makes It Different](https://www.kqzyfj.com/click-7056991-12181821?url=https%3A%2F%2Fwww.oreilly.com%2Fradar%2Fmlops-and-devops-why-data-makes-it-different%2F) 47 | 48 | ## ML Basics 49 | 50 | 1. [How Does Machine Learning Work?](https://www.dummies.com/programming/big-data/data-science/how-does-machine-learning-work/) 51 | 2. [Machine Learning Visual Explanation](https://towardsdatascience.com/what-is-machine-learning-a-visual-explanation-14642b90429f) 52 | 3. [Understanding ML Algorithm & Model](https://machinelearningmastery.com/difference-between-algorithm-and-model-in-machine-learning/) 53 | 54 | ## Data Engineering Basics 55 | 56 | 1. [150 Data Engineering Concepts](https://towardsdatascience.com/150-concepts-heard-in-data-engineering-a2e3a99212ed) 57 | 58 | ## Free MLOPS Tools & Services 59 | 60 | 1. [AWS Sagemaker Studio](https://studiolab.sagemaker.aws/) 61 | 2. [Kubeflow](https://www.kubeflow.org/) 62 | 3. [MLFlow](https://mlflow.org/) 63 | 64 | ## MLOPS Courses 65 | 66 | 1. [MLOps Concepts (Datacamp)](https://datacamp.pxf.io/vNk1Dv) 67 | 68 | ## MLOPS Roadmap 69 | 70 | <--Comming Soon--> 71 | 72 | 73 | ## MLOPS Real World Use Cases 74 | 75 | 1/ [Saving 10s of Thousands of Dollars Deploying Low Cost Open Source AI Technologies At Scale with Kubernetes](https://opensauced.pizza/blog/how-we-saved-thousands-of-dollars-deploying-low-cost-open-source-ai-technologies) 76 | 77 | ## MLOPS Practical Labs for Beginners 78 | 79 | <--Comming Soon--> 80 | 81 | ## MLOPS Advanced Labs 82 | 83 | <--Comming Soon--> 84 | 85 | ## Datasets 86 | 87 | 1. https://www.kaggle.com/datasets 88 | --------------------------------------------------------------------------------