├── .github └── workflows │ └── pipeline.yml ├── .gitignore ├── ARM-Templates ├── azuredeploy.databricks.json ├── azuredeploy.keyvault.json ├── parameters.databricks.json └── parameters.keyvault.json ├── Databricks Dev Ops.pptx ├── README.md ├── Sample-REST-API-To-Databricks.sh ├── azure-pipelines.yml ├── clusters ├── large-cluster.json ├── medium-cluster.json └── small-cluster.json ├── deployment-scripts ├── deploy-clusters.sh ├── deploy-init-scripts.sh ├── deploy-jobs.sh └── deploy-notebooks.sh ├── images ├── Databricks-Clusters-Deployed.png ├── Databricks-Dev-Ops.gif ├── Databricks-Jobs-Deployed.png ├── Databricks-Notebooks-Deployed.png ├── DeployedResourceGroups.png ├── Deployment-Mode.png ├── DevOps-Stages-Environments.png └── YouTube.png ├── init-scripts └── sampleinit.sh ├── jobs ├── Test-DevOps-Job-Interactive-Cluster.json └── Test-DevOps-Job-OnDemand-Cluster.json └── notebooks └── MyProject ├── Nested-Folder-01 ├── Nested-Notebook-01.sql └── Sub-Nested-Folder-01 │ └── Sub-Nested-Notebook-01.sql ├── Nested-Folder-02 ├── Nested-Notebook-02.sql └── Sub-Nested-Folder-02 │ └── Sub-Nested-Notebook-02.sql ├── Pop vs. Price SQL.sql ├── Pop. vs. Price LR.py └── Process IoT Device Data Using Datasets.scala /.github/workflows/pipeline.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/.github/workflows/pipeline.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/.gitignore -------------------------------------------------------------------------------- /ARM-Templates/azuredeploy.databricks.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/ARM-Templates/azuredeploy.databricks.json -------------------------------------------------------------------------------- /ARM-Templates/azuredeploy.keyvault.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/ARM-Templates/azuredeploy.keyvault.json -------------------------------------------------------------------------------- /ARM-Templates/parameters.databricks.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/ARM-Templates/parameters.databricks.json -------------------------------------------------------------------------------- /ARM-Templates/parameters.keyvault.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/ARM-Templates/parameters.keyvault.json -------------------------------------------------------------------------------- /Databricks Dev Ops.pptx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/Databricks Dev Ops.pptx -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/README.md -------------------------------------------------------------------------------- /Sample-REST-API-To-Databricks.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/Sample-REST-API-To-Databricks.sh -------------------------------------------------------------------------------- /azure-pipelines.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/azure-pipelines.yml -------------------------------------------------------------------------------- /clusters/large-cluster.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/clusters/large-cluster.json -------------------------------------------------------------------------------- /clusters/medium-cluster.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/clusters/medium-cluster.json -------------------------------------------------------------------------------- /clusters/small-cluster.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/clusters/small-cluster.json -------------------------------------------------------------------------------- /deployment-scripts/deploy-clusters.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/deployment-scripts/deploy-clusters.sh -------------------------------------------------------------------------------- /deployment-scripts/deploy-init-scripts.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/deployment-scripts/deploy-init-scripts.sh -------------------------------------------------------------------------------- /deployment-scripts/deploy-jobs.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/deployment-scripts/deploy-jobs.sh -------------------------------------------------------------------------------- /deployment-scripts/deploy-notebooks.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/deployment-scripts/deploy-notebooks.sh -------------------------------------------------------------------------------- /images/Databricks-Clusters-Deployed.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/Databricks-Clusters-Deployed.png -------------------------------------------------------------------------------- /images/Databricks-Dev-Ops.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/Databricks-Dev-Ops.gif -------------------------------------------------------------------------------- /images/Databricks-Jobs-Deployed.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/Databricks-Jobs-Deployed.png -------------------------------------------------------------------------------- /images/Databricks-Notebooks-Deployed.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/Databricks-Notebooks-Deployed.png -------------------------------------------------------------------------------- /images/DeployedResourceGroups.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/DeployedResourceGroups.png -------------------------------------------------------------------------------- /images/Deployment-Mode.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/Deployment-Mode.png -------------------------------------------------------------------------------- /images/DevOps-Stages-Environments.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/DevOps-Stages-Environments.png -------------------------------------------------------------------------------- /images/YouTube.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/images/YouTube.png -------------------------------------------------------------------------------- /init-scripts/sampleinit.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/init-scripts/sampleinit.sh -------------------------------------------------------------------------------- /jobs/Test-DevOps-Job-Interactive-Cluster.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/jobs/Test-DevOps-Job-Interactive-Cluster.json -------------------------------------------------------------------------------- /jobs/Test-DevOps-Job-OnDemand-Cluster.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/jobs/Test-DevOps-Job-OnDemand-Cluster.json -------------------------------------------------------------------------------- /notebooks/MyProject/Nested-Folder-01/Nested-Notebook-01.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Nested-Folder-01/Nested-Notebook-01.sql -------------------------------------------------------------------------------- /notebooks/MyProject/Nested-Folder-01/Sub-Nested-Folder-01/Sub-Nested-Notebook-01.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Nested-Folder-01/Sub-Nested-Folder-01/Sub-Nested-Notebook-01.sql -------------------------------------------------------------------------------- /notebooks/MyProject/Nested-Folder-02/Nested-Notebook-02.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Nested-Folder-02/Nested-Notebook-02.sql -------------------------------------------------------------------------------- /notebooks/MyProject/Nested-Folder-02/Sub-Nested-Folder-02/Sub-Nested-Notebook-02.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Nested-Folder-02/Sub-Nested-Folder-02/Sub-Nested-Notebook-02.sql -------------------------------------------------------------------------------- /notebooks/MyProject/Pop vs. Price SQL.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Pop vs. Price SQL.sql -------------------------------------------------------------------------------- /notebooks/MyProject/Pop. vs. Price LR.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Pop. vs. Price LR.py -------------------------------------------------------------------------------- /notebooks/MyProject/Process IoT Device Data Using Datasets.scala: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AdamPaternostro/Azure-Databricks-Dev-Ops/HEAD/notebooks/MyProject/Process IoT Device Data Using Datasets.scala --------------------------------------------------------------------------------