├── .gitignore ├── README.md ├── assets ├── Init_git_dvc.png ├── aws_arn_team0.png ├── aws_bucket.png ├── aws_bucket_list_team0.png ├── aws_bucket_team1.png ├── aws_management_console_validation.png ├── aws_md5_validation.png ├── aws_version.png ├── dvc_push.png ├── key_file_structure.png ├── tracking_wineqt_dvc.png └── which_python_dvc.png ├── data └── raw │ └── wine_quality_df.csv ├── docs ├── 0_Aws_Setup │ └── AWS_Setup.md ├── 1.1_Introduction │ ├── 1.1_Introduction_to_MLOps.pdf │ └── Initial_Setup.md ├── 1.2_Data_Background │ └── Data_Versioning.md ├── 1.3_Modeling_pipeline │ └── MLFlow_first_steps.md ├── 2.1_Developing │ └── 2.1_Refactor_OOP.pdf ├── 2.2_Tracking │ └── 2.2_MLFlow_tracking_registry.pdf ├── 2.3 Reproducibility │ └── 2.3 Reproducibility.pdf ├── 2.4 Testing │ ├── 2.4 Testing.pdf │ └── Unit_Testing_ML_Examples.md └── 3.1 Orchestration │ ├── 3.1 Orchestration and Deployment.pdf │ └── PreDocker_tutorial_WSL.pdf ├── notebooks ├── 1.2 Data_Background │ ├── 1.2.1.0 Gettting_the_data.ipynb │ ├── 1.2.1.1_intro_numpy_pandas.ipynb │ ├── 1.2.1.2_descriptive_statistics.ipynb │ └── 1.2.1.3_Wine_EDA.ipynb ├── 1.3 Modeling Pipeline │ └── 1.intro_mlflow.ipynb ├── 2.1 Developing │ ├── 2.1.3.1_Wine_Refactored_V1.ipynb │ ├── 2.1.3.2_Wine_Refactored_V2.ipynb │ └── spaguetti_code.py ├── 2.2 Tracking │ └── 2.2_Model_Tracking_logging_versioning_and_registry.ipynb ├── 2.3 Reproducibility │ └── Sklearn_Pipeline_Wine_example.ipynb ├── 2.4 Testing │ ├── Testing_Feature_Engineering_Process.ipynb │ ├── Testing_Input_Data.ipynb │ ├── Testing_Model_Quality.ipynb │ ├── Testing_Model_Settings.ipynb │ └── Testing_Normality_Test.ipynb └── 3.1_Orchestration │ └── fastapi_docker │ ├── Dockerfile │ ├── README.md │ ├── main.py │ ├── requirements.txt │ ├── train_model.py │ └── wine_model.pkl ├── requirements.txt └── src ├── evaluate_v1.py ├── evaluate_v2.py ├── load_data_v1.py ├── load_data_v2.py ├── preprocess_data_v1.py ├── preprocess_data_v2.py ├── train_v1.py ├── train_v2.py ├── wine_refactored_v1.py └── wine_refactored_v2.py /.gitignore: -------------------------------------------------------------------------------- 1 | # macOS metadata 2 | .DS_Store 3 | 4 | # Virtual Environments 5 | venv/ -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/README.md -------------------------------------------------------------------------------- /assets/Init_git_dvc.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/Init_git_dvc.png -------------------------------------------------------------------------------- /assets/aws_arn_team0.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_arn_team0.png -------------------------------------------------------------------------------- /assets/aws_bucket.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_bucket.png -------------------------------------------------------------------------------- /assets/aws_bucket_list_team0.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_bucket_list_team0.png -------------------------------------------------------------------------------- /assets/aws_bucket_team1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_bucket_team1.png -------------------------------------------------------------------------------- /assets/aws_management_console_validation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_management_console_validation.png -------------------------------------------------------------------------------- /assets/aws_md5_validation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_md5_validation.png -------------------------------------------------------------------------------- /assets/aws_version.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/aws_version.png -------------------------------------------------------------------------------- /assets/dvc_push.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/dvc_push.png -------------------------------------------------------------------------------- /assets/key_file_structure.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/key_file_structure.png -------------------------------------------------------------------------------- /assets/tracking_wineqt_dvc.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/tracking_wineqt_dvc.png -------------------------------------------------------------------------------- /assets/which_python_dvc.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/assets/which_python_dvc.png -------------------------------------------------------------------------------- /data/raw/wine_quality_df.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/data/raw/wine_quality_df.csv -------------------------------------------------------------------------------- /docs/0_Aws_Setup/AWS_Setup.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/0_Aws_Setup/AWS_Setup.md -------------------------------------------------------------------------------- /docs/1.1_Introduction/1.1_Introduction_to_MLOps.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/1.1_Introduction/1.1_Introduction_to_MLOps.pdf -------------------------------------------------------------------------------- /docs/1.1_Introduction/Initial_Setup.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/1.1_Introduction/Initial_Setup.md -------------------------------------------------------------------------------- /docs/1.2_Data_Background/Data_Versioning.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/1.2_Data_Background/Data_Versioning.md -------------------------------------------------------------------------------- /docs/1.3_Modeling_pipeline/MLFlow_first_steps.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/1.3_Modeling_pipeline/MLFlow_first_steps.md -------------------------------------------------------------------------------- /docs/2.1_Developing/2.1_Refactor_OOP.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/2.1_Developing/2.1_Refactor_OOP.pdf -------------------------------------------------------------------------------- /docs/2.2_Tracking/2.2_MLFlow_tracking_registry.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/2.2_Tracking/2.2_MLFlow_tracking_registry.pdf -------------------------------------------------------------------------------- /docs/2.3 Reproducibility/2.3 Reproducibility.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/2.3 Reproducibility/2.3 Reproducibility.pdf -------------------------------------------------------------------------------- /docs/2.4 Testing/2.4 Testing.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/2.4 Testing/2.4 Testing.pdf -------------------------------------------------------------------------------- /docs/2.4 Testing/Unit_Testing_ML_Examples.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/2.4 Testing/Unit_Testing_ML_Examples.md -------------------------------------------------------------------------------- /docs/3.1 Orchestration/3.1 Orchestration and Deployment.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/3.1 Orchestration/3.1 Orchestration and Deployment.pdf -------------------------------------------------------------------------------- /docs/3.1 Orchestration/PreDocker_tutorial_WSL.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/docs/3.1 Orchestration/PreDocker_tutorial_WSL.pdf -------------------------------------------------------------------------------- /notebooks/1.2 Data_Background/1.2.1.0 Gettting_the_data.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/1.2 Data_Background/1.2.1.0 Gettting_the_data.ipynb -------------------------------------------------------------------------------- /notebooks/1.2 Data_Background/1.2.1.1_intro_numpy_pandas.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/1.2 Data_Background/1.2.1.1_intro_numpy_pandas.ipynb -------------------------------------------------------------------------------- /notebooks/1.2 Data_Background/1.2.1.2_descriptive_statistics.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/1.2 Data_Background/1.2.1.2_descriptive_statistics.ipynb -------------------------------------------------------------------------------- /notebooks/1.2 Data_Background/1.2.1.3_Wine_EDA.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/1.2 Data_Background/1.2.1.3_Wine_EDA.ipynb -------------------------------------------------------------------------------- /notebooks/1.3 Modeling Pipeline/1.intro_mlflow.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/1.3 Modeling Pipeline/1.intro_mlflow.ipynb -------------------------------------------------------------------------------- /notebooks/2.1 Developing/2.1.3.1_Wine_Refactored_V1.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.1 Developing/2.1.3.1_Wine_Refactored_V1.ipynb -------------------------------------------------------------------------------- /notebooks/2.1 Developing/2.1.3.2_Wine_Refactored_V2.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.1 Developing/2.1.3.2_Wine_Refactored_V2.ipynb -------------------------------------------------------------------------------- /notebooks/2.1 Developing/spaguetti_code.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.1 Developing/spaguetti_code.py -------------------------------------------------------------------------------- /notebooks/2.2 Tracking/2.2_Model_Tracking_logging_versioning_and_registry.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.2 Tracking/2.2_Model_Tracking_logging_versioning_and_registry.ipynb -------------------------------------------------------------------------------- /notebooks/2.3 Reproducibility/Sklearn_Pipeline_Wine_example.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.3 Reproducibility/Sklearn_Pipeline_Wine_example.ipynb -------------------------------------------------------------------------------- /notebooks/2.4 Testing/Testing_Feature_Engineering_Process.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.4 Testing/Testing_Feature_Engineering_Process.ipynb -------------------------------------------------------------------------------- /notebooks/2.4 Testing/Testing_Input_Data.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.4 Testing/Testing_Input_Data.ipynb -------------------------------------------------------------------------------- /notebooks/2.4 Testing/Testing_Model_Quality.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.4 Testing/Testing_Model_Quality.ipynb -------------------------------------------------------------------------------- /notebooks/2.4 Testing/Testing_Model_Settings.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.4 Testing/Testing_Model_Settings.ipynb -------------------------------------------------------------------------------- /notebooks/2.4 Testing/Testing_Normality_Test.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/2.4 Testing/Testing_Normality_Test.ipynb -------------------------------------------------------------------------------- /notebooks/3.1_Orchestration/fastapi_docker/Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/3.1_Orchestration/fastapi_docker/Dockerfile -------------------------------------------------------------------------------- /notebooks/3.1_Orchestration/fastapi_docker/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/3.1_Orchestration/fastapi_docker/README.md -------------------------------------------------------------------------------- /notebooks/3.1_Orchestration/fastapi_docker/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/3.1_Orchestration/fastapi_docker/main.py -------------------------------------------------------------------------------- /notebooks/3.1_Orchestration/fastapi_docker/requirements.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /notebooks/3.1_Orchestration/fastapi_docker/train_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/3.1_Orchestration/fastapi_docker/train_model.py -------------------------------------------------------------------------------- /notebooks/3.1_Orchestration/fastapi_docker/wine_model.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/notebooks/3.1_Orchestration/fastapi_docker/wine_model.pkl -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/requirements.txt -------------------------------------------------------------------------------- /src/evaluate_v1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/evaluate_v1.py -------------------------------------------------------------------------------- /src/evaluate_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/evaluate_v2.py -------------------------------------------------------------------------------- /src/load_data_v1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/load_data_v1.py -------------------------------------------------------------------------------- /src/load_data_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/load_data_v2.py -------------------------------------------------------------------------------- /src/preprocess_data_v1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/preprocess_data_v1.py -------------------------------------------------------------------------------- /src/preprocess_data_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/preprocess_data_v2.py -------------------------------------------------------------------------------- /src/train_v1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/train_v1.py -------------------------------------------------------------------------------- /src/train_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/train_v2.py -------------------------------------------------------------------------------- /src/wine_refactored_v1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/wine_refactored_v1.py -------------------------------------------------------------------------------- /src/wine_refactored_v2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ITESM-MNA/MLOps/HEAD/src/wine_refactored_v2.py --------------------------------------------------------------------------------