├── 1635662105292.jfif ├── Apache Beam -Python ├── Documentation │ ├── Tutorial 0 - Introduction to Apache Beam.docx │ ├── Tutorial 1 - Pipeline in Apache Beam.docx │ ├── Tutorial 2 - PCollection in Apache Beam.docx │ ├── Tutorial 3a – Map, FlatMap and Filter Transforms in Apache Beam.docx │ ├── Tutorial 3b – ParDo, Keys, Kvswap, Values, ToString Transform in Apache Beam.docx │ ├── Tutorial 3c – GroupBy, GroupByKey, GroupIntoBatches and CoGroupByKey Transform in Apache Beam.docx │ ├── Tutorial 3d – Flatten and Partition Transform in Apache Beam.docx │ ├── Tutorial 3e – latest, Max, Min, Sample, Sum and Top Transform in Apache Beam.docx │ ├── Tutorial 3f - Combine Core Transform in Apache Beam.docx │ ├── Tutorial 3g - Composite Core Transform in Apache Beam.docx │ ├── Tutorial 3h - Side Inputs and Outputs Apache Beam.docx │ └── readme.md ├── Resources.txt ├── Tutorial 1 - Pipeline in Apache beam.ipynb ├── Tutorial 2- Pcollection in Apache beam.ipynb ├── Tutorial 3a Map, Flatmap and Filter In Apache Beam Transformation.ipynb ├── Tutorial 3b ParDo, Keys, Values, ToString, Kvswap In Apache Beam Transformation.ipynb ├── Tutorial 3c Updated – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam.ipynb ├── Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam.ipynb ├── Tutorial 3d – Flatten and Partition Transform in Apache Beam.ipynb ├── Tutorial 3e – Latest, Max, Min, Sample, Sum and Top Transform in Apache Beam.ipynb ├── Tutorial 3f – Combine Core Transform in Apache Beam.ipynb ├── Tutorial 3g - Composite Transformation in Apache Beam.ipynb ├── Tutorial 3h - Side Inputs and Outputs Apache Beam.ipynb ├── combinetransform_example.txt └── data │ ├── Students_age.txt │ ├── dept_data.txt │ ├── grocery.txt │ ├── students.txt │ └── students_exclude.txt ├── Basics └── commands.md ├── BigData ├── Apache sparkVs FLink.pdf └── demo.py ├── BigLake └── readme.md ├── BigQuery ├── Basics of Cloud BigQuery.md ├── Batch Loading in BigQuery │ ├── LOAD_DATA_SQL.sql │ ├── Readme.md │ └── titanic_datafusion.csv ├── BigQuery_Nested_and_Repeated.sql ├── Hands on Different ways of loading csv file into Cloud BigQuery using bq CLI.md ├── Lab on Streaming Analytics into BigQuery.md ├── ReaddatafromBQ_pythonclient.py ├── Tutorial - Python API │ ├── bq_dataset_client.py │ ├── bq_table_client.py │ └── readme.md ├── View_BQ_Python.py ├── bigquery.py ├── bqtogcsdatafusion.csv ├── commands.txt ├── dataset │ ├── readme.md │ └── yob2021.txt ├── exportbqtogcsbucket.py ├── load_table_dataframetoBQ.py ├── nyc_tlc_yellow_trips_2018_subset_1.csv └── readme.md ├── Cloud Bigtable ├── Bigtable: Qwik Start - Command Line.txt ├── Hands-on - Loading and Querying Data with Cloud Bigtable.docx ├── Lab on Creating and Populating a Bigtable Instance using Dataflow.md ├── dataloader.py ├── forestfires.csv └── readme.md ├── Cloud Certifications ├── Google Cloud Platform │ ├── Associate Cloud Engineer.png │ ├── Cloud Digital Leader.png │ ├── Google Cloud Professional Cloud Database Engineer.md │ ├── Professional Cloud Architect.png │ ├── Professional Data Engineer.png │ └── readme.md └── Microsoft Azure │ ├── Microsoft Certified- Azure AI Engineer Associate.pdf │ ├── Microsoft Certified- Azure AI Fundamentals.pdf │ ├── Microsoft Certified- Azure Data Fundamentals.pdf │ ├── Microsoft Certified- Azure Data Scientist Associate.pdf │ ├── Microsoft Certified- Azure Fundamentals.pdf │ ├── Microsoft Certified- Security, Compliance, and Identity Fundamentals.pdf │ └── readme.md ├── Cloud Datastore & Firestore ├── Part01 & 02 - Cloud Datastore & Firestore.docx └── readme.md ├── Cloud Memory Store ├── Part01 & 02 - Cloud Memory store.docx └── readme.md ├── Cloud PubSub ├── Sub Qwik Start - Command Line.md ├── commands-cli.md └── readme.md ├── Cloud Spanner ├── Cloud Spanner.docx └── readme.md ├── Cloud Storage ├── Google Cloud - Cloud Storage Bucket Lock.md ├── Object_versioning.txt ├── Spark │ ├── pandas_df.py │ ├── readme.md │ ├── spark_df.py │ └── sparkloc_gcs.py ├── bq_to_gcs_export_daily.sql ├── filestore_commands.md ├── gcs_read_csvfile.py ├── gcs_read_jsonfile.py ├── gcs_read_otherfiles.py ├── gsutil_commands.txt ├── read_yaml_gcs.py └── readme.md ├── CloudSQL ├── Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step) │ ├── README.md │ ├── python │ │ ├── main.py │ │ └── requirements.txt │ └── terraform │ │ ├── main.tf │ │ ├── outputs.tf │ │ ├── postgres_sql.tf │ │ ├── terraform.tfvars │ │ └── variables.tf ├── Creating PostgreSQL instance and writing data to Cloud.pptx └── demo.py ├── Cloud_Composer ├── airflow_script.py ├── dataflow_script_titanic.py ├── readme.md └── titanic_dataset.csv ├── Compute Options in GCP ├── Compute Engine │ └── command_lab.md ├── Compute Options In GCP - Detail .pages ├── Google Kubernetes │ ├── kubernetesquickstart.md │ └── readme.md └── readme.md ├── Dataflow ├── Beam_installation.pptx ├── Bigquery to postgresql │ ├── BQtoPostgresql.pptx │ ├── constants.py │ ├── main.py │ ├── setup.py │ ├── text.txt │ └── theory_check_single.py ├── count_allelements.py ├── count_perkey.py ├── count_unique.py ├── dataflowtopostgresql.py ├── demo.py └── python-dataflow.md ├── E2E-DataEngineering-Projects ├── End to end Data Engineering Project in Google Cloud Platform.md └── readme.md ├── GCP_Service_Images └── Compute Engine │ ├── disk_type_in_compute_engine_gcp.png │ └── readme.md ├── Liens on a project.md ├── PMLE_resources.md ├── README.md ├── RealTime-Usecases ├── Event-Driven PubSub to BigQuery │ ├── README.md │ ├── export-pubusb-to-bq.drawio.png │ ├── json │ │ └── sample_message.json │ └── terraform │ │ ├── bigquery.tf │ │ ├── cloud_functions.tf │ │ ├── function │ │ ├── main.py │ │ └── requirements.txt │ │ ├── gcp_iam.tf │ │ ├── gcs.tf │ │ ├── main.tf │ │ ├── outputs.tf │ │ ├── provider.tf │ │ ├── pubsub.tf │ │ ├── terraform.tfvars │ │ └── variables.tf ├── Serverless Data Processing with Cloud Dataflow │ ├── Latest-Serverless Data Processing with Dataflow - Using Dataflow SQL for Streaming Analytics (Python).md │ ├── etlpipeline_streaming.py │ └── readme.md └── readme.md ├── Service Account ├── ServiceAccount.md ├── labonServiceAccount.md ├── labonsa.py └── readme.md ├── etl-dataflow-GCP ├── commands.md ├── data_ingestion.py ├── data_transformation.py ├── presentation.key ├── readme.md └── usa_names_year_as_date.json ├── etlvselt.docx └── userdata.csv /1635662105292.jfif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/1635662105292.jfif -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 0 - Introduction to Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 0 - Introduction to Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 1 - Pipeline in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 1 - Pipeline in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 2 - PCollection in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 2 - PCollection in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3a – Map, FlatMap and Filter Transforms in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3a – Map, FlatMap and Filter Transforms in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3b – ParDo, Keys, Kvswap, Values, ToString Transform in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3b – ParDo, Keys, Kvswap, Values, ToString Transform in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3c – GroupBy, GroupByKey, GroupIntoBatches and CoGroupByKey Transform in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3c – GroupBy, GroupByKey, GroupIntoBatches and CoGroupByKey Transform in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3d – Flatten and Partition Transform in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3d – Flatten and Partition Transform in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3e – latest, Max, Min, Sample, Sum and Top Transform in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3e – latest, Max, Min, Sample, Sum and Top Transform in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3f - Combine Core Transform in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3f - Combine Core Transform in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3g - Composite Core Transform in Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3g - Composite Core Transform in Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/Tutorial 3h - Side Inputs and Outputs Apache Beam.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Documentation/Tutorial 3h - Side Inputs and Outputs Apache Beam.docx -------------------------------------------------------------------------------- /Apache Beam -Python/Documentation/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Apache Beam -Python/Resources.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Resources.txt -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 1 - Pipeline in Apache beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 1 - Pipeline in Apache beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 2- Pcollection in Apache beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 2- Pcollection in Apache beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3a Map, Flatmap and Filter In Apache Beam Transformation.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3a Map, Flatmap and Filter In Apache Beam Transformation.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3b ParDo, Keys, Values, ToString, Kvswap In Apache Beam Transformation.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3b ParDo, Keys, Values, ToString, Kvswap In Apache Beam Transformation.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3c Updated – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3c Updated – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3c – GroupBy, GroupByKey, CoGroupByKey and GroupIntoBatches Transform in Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3d – Flatten and Partition Transform in Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3d – Flatten and Partition Transform in Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3e – Latest, Max, Min, Sample, Sum and Top Transform in Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3e – Latest, Max, Min, Sample, Sum and Top Transform in Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3f – Combine Core Transform in Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3f – Combine Core Transform in Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3g - Composite Transformation in Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3g - Composite Transformation in Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/Tutorial 3h - Side Inputs and Outputs Apache Beam.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/Tutorial 3h - Side Inputs and Outputs Apache Beam.ipynb -------------------------------------------------------------------------------- /Apache Beam -Python/combinetransform_example.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/combinetransform_example.txt -------------------------------------------------------------------------------- /Apache Beam -Python/data/Students_age.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/data/Students_age.txt -------------------------------------------------------------------------------- /Apache Beam -Python/data/dept_data.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/data/dept_data.txt -------------------------------------------------------------------------------- /Apache Beam -Python/data/grocery.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/data/grocery.txt -------------------------------------------------------------------------------- /Apache Beam -Python/data/students.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Apache Beam -Python/data/students.txt -------------------------------------------------------------------------------- /Apache Beam -Python/data/students_exclude.txt: -------------------------------------------------------------------------------- 1 | 1 2 | 3 3 | 7 4 | 9 -------------------------------------------------------------------------------- /Basics/commands.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Basics/commands.md -------------------------------------------------------------------------------- /BigData/Apache sparkVs FLink.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigData/Apache sparkVs FLink.pdf -------------------------------------------------------------------------------- /BigData/demo.py: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /BigLake/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigLake/readme.md -------------------------------------------------------------------------------- /BigQuery/Basics of Cloud BigQuery.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Basics of Cloud BigQuery.md -------------------------------------------------------------------------------- /BigQuery/Batch Loading in BigQuery/LOAD_DATA_SQL.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Batch Loading in BigQuery/LOAD_DATA_SQL.sql -------------------------------------------------------------------------------- /BigQuery/Batch Loading in BigQuery/Readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /BigQuery/Batch Loading in BigQuery/titanic_datafusion.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Batch Loading in BigQuery/titanic_datafusion.csv -------------------------------------------------------------------------------- /BigQuery/BigQuery_Nested_and_Repeated.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/BigQuery_Nested_and_Repeated.sql -------------------------------------------------------------------------------- /BigQuery/Hands on Different ways of loading csv file into Cloud BigQuery using bq CLI.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Hands on Different ways of loading csv file into Cloud BigQuery using bq CLI.md -------------------------------------------------------------------------------- /BigQuery/Lab on Streaming Analytics into BigQuery.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Lab on Streaming Analytics into BigQuery.md -------------------------------------------------------------------------------- /BigQuery/ReaddatafromBQ_pythonclient.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/ReaddatafromBQ_pythonclient.py -------------------------------------------------------------------------------- /BigQuery/Tutorial - Python API/bq_dataset_client.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Tutorial - Python API/bq_dataset_client.py -------------------------------------------------------------------------------- /BigQuery/Tutorial - Python API/bq_table_client.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/Tutorial - Python API/bq_table_client.py -------------------------------------------------------------------------------- /BigQuery/Tutorial - Python API/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /BigQuery/View_BQ_Python.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/View_BQ_Python.py -------------------------------------------------------------------------------- /BigQuery/bigquery.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/bigquery.py -------------------------------------------------------------------------------- /BigQuery/bqtogcsdatafusion.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/bqtogcsdatafusion.csv -------------------------------------------------------------------------------- /BigQuery/commands.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/commands.txt -------------------------------------------------------------------------------- /BigQuery/dataset/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /BigQuery/dataset/yob2021.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/dataset/yob2021.txt -------------------------------------------------------------------------------- /BigQuery/exportbqtogcsbucket.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/exportbqtogcsbucket.py -------------------------------------------------------------------------------- /BigQuery/load_table_dataframetoBQ.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/load_table_dataframetoBQ.py -------------------------------------------------------------------------------- /BigQuery/nyc_tlc_yellow_trips_2018_subset_1.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/BigQuery/nyc_tlc_yellow_trips_2018_subset_1.csv -------------------------------------------------------------------------------- /BigQuery/readme.md: -------------------------------------------------------------------------------- 1 | 2 | ![alt text](https://thecloudgirl.dev/images/BigQuery.png) 3 | -------------------------------------------------------------------------------- /Cloud Bigtable/Bigtable: Qwik Start - Command Line.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Bigtable/Bigtable: Qwik Start - Command Line.txt -------------------------------------------------------------------------------- /Cloud Bigtable/Hands-on - Loading and Querying Data with Cloud Bigtable.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Bigtable/Hands-on - Loading and Querying Data with Cloud Bigtable.docx -------------------------------------------------------------------------------- /Cloud Bigtable/Lab on Creating and Populating a Bigtable Instance using Dataflow.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Bigtable/Lab on Creating and Populating a Bigtable Instance using Dataflow.md -------------------------------------------------------------------------------- /Cloud Bigtable/dataloader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Bigtable/dataloader.py -------------------------------------------------------------------------------- /Cloud Bigtable/forestfires.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Bigtable/forestfires.csv -------------------------------------------------------------------------------- /Cloud Bigtable/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Bigtable/readme.md -------------------------------------------------------------------------------- /Cloud Certifications/Google Cloud Platform/Associate Cloud Engineer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Google Cloud Platform/Associate Cloud Engineer.png -------------------------------------------------------------------------------- /Cloud Certifications/Google Cloud Platform/Cloud Digital Leader.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Google Cloud Platform/Cloud Digital Leader.png -------------------------------------------------------------------------------- /Cloud Certifications/Google Cloud Platform/Google Cloud Professional Cloud Database Engineer.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Google Cloud Platform/Google Cloud Professional Cloud Database Engineer.md -------------------------------------------------------------------------------- /Cloud Certifications/Google Cloud Platform/Professional Cloud Architect.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Google Cloud Platform/Professional Cloud Architect.png -------------------------------------------------------------------------------- /Cloud Certifications/Google Cloud Platform/Professional Data Engineer.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Google Cloud Platform/Professional Data Engineer.png -------------------------------------------------------------------------------- /Cloud Certifications/Google Cloud Platform/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure AI Engineer Associate.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure AI Engineer Associate.pdf -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure AI Fundamentals.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure AI Fundamentals.pdf -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure Data Fundamentals.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure Data Fundamentals.pdf -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure Data Scientist Associate.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure Data Scientist Associate.pdf -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure Fundamentals.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Microsoft Azure/Microsoft Certified- Azure Fundamentals.pdf -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/Microsoft Certified- Security, Compliance, and Identity Fundamentals.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Certifications/Microsoft Azure/Microsoft Certified- Security, Compliance, and Identity Fundamentals.pdf -------------------------------------------------------------------------------- /Cloud Certifications/Microsoft Azure/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Cloud Datastore & Firestore/Part01 & 02 - Cloud Datastore & Firestore.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Datastore & Firestore/Part01 & 02 - Cloud Datastore & Firestore.docx -------------------------------------------------------------------------------- /Cloud Datastore & Firestore/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Datastore & Firestore/readme.md -------------------------------------------------------------------------------- /Cloud Memory Store/Part01 & 02 - Cloud Memory store.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Memory Store/Part01 & 02 - Cloud Memory store.docx -------------------------------------------------------------------------------- /Cloud Memory Store/readme.md: -------------------------------------------------------------------------------- 1 | Cloud Memory Store 2 | -------------------------------------------------------------------------------- /Cloud PubSub/Sub Qwik Start - Command Line.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud PubSub/Sub Qwik Start - Command Line.md -------------------------------------------------------------------------------- /Cloud PubSub/commands-cli.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud PubSub/commands-cli.md -------------------------------------------------------------------------------- /Cloud PubSub/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Cloud Spanner/Cloud Spanner.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Spanner/Cloud Spanner.docx -------------------------------------------------------------------------------- /Cloud Spanner/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Spanner/readme.md -------------------------------------------------------------------------------- /Cloud Storage/Google Cloud - Cloud Storage Bucket Lock.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/Google Cloud - Cloud Storage Bucket Lock.md -------------------------------------------------------------------------------- /Cloud Storage/Object_versioning.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/Object_versioning.txt -------------------------------------------------------------------------------- /Cloud Storage/Spark/pandas_df.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/Spark/pandas_df.py -------------------------------------------------------------------------------- /Cloud Storage/Spark/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/Spark/readme.md -------------------------------------------------------------------------------- /Cloud Storage/Spark/spark_df.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/Spark/spark_df.py -------------------------------------------------------------------------------- /Cloud Storage/Spark/sparkloc_gcs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/Spark/sparkloc_gcs.py -------------------------------------------------------------------------------- /Cloud Storage/bq_to_gcs_export_daily.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/bq_to_gcs_export_daily.sql -------------------------------------------------------------------------------- /Cloud Storage/filestore_commands.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/filestore_commands.md -------------------------------------------------------------------------------- /Cloud Storage/gcs_read_csvfile.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/gcs_read_csvfile.py -------------------------------------------------------------------------------- /Cloud Storage/gcs_read_jsonfile.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/gcs_read_jsonfile.py -------------------------------------------------------------------------------- /Cloud Storage/gcs_read_otherfiles.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/gcs_read_otherfiles.py -------------------------------------------------------------------------------- /Cloud Storage/gsutil_commands.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/gsutil_commands.txt -------------------------------------------------------------------------------- /Cloud Storage/read_yaml_gcs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/read_yaml_gcs.py -------------------------------------------------------------------------------- /Cloud Storage/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud Storage/readme.md -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/README.md -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/python/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/python/main.py -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/python/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/python/requirements.txt -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/main.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/main.tf -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/outputs.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/outputs.tf -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/postgres_sql.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/postgres_sql.tf -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/terraform.tfvars: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/terraform.tfvars -------------------------------------------------------------------------------- /CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/variables.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Automate Google Cloud SQL PostgreSQL with Terraform and Python (Step‑by‑Step)/terraform/variables.tf -------------------------------------------------------------------------------- /CloudSQL/Creating PostgreSQL instance and writing data to Cloud.pptx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/CloudSQL/Creating PostgreSQL instance and writing data to Cloud.pptx -------------------------------------------------------------------------------- /CloudSQL/demo.py: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Cloud_Composer/airflow_script.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud_Composer/airflow_script.py -------------------------------------------------------------------------------- /Cloud_Composer/dataflow_script_titanic.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud_Composer/dataflow_script_titanic.py -------------------------------------------------------------------------------- /Cloud_Composer/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Cloud_Composer/titanic_dataset.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Cloud_Composer/titanic_dataset.csv -------------------------------------------------------------------------------- /Compute Options in GCP/Compute Engine/command_lab.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Compute Options in GCP/Compute Engine/command_lab.md -------------------------------------------------------------------------------- /Compute Options in GCP/Compute Options In GCP - Detail .pages: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Compute Options in GCP/Compute Options In GCP - Detail .pages -------------------------------------------------------------------------------- /Compute Options in GCP/Google Kubernetes/kubernetesquickstart.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Compute Options in GCP/Google Kubernetes/kubernetesquickstart.md -------------------------------------------------------------------------------- /Compute Options in GCP/Google Kubernetes/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Compute Options in GCP/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Compute Options in GCP/readme.md -------------------------------------------------------------------------------- /Dataflow/Beam_installation.pptx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/Beam_installation.pptx -------------------------------------------------------------------------------- /Dataflow/Bigquery to postgresql/BQtoPostgresql.pptx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/Bigquery to postgresql/BQtoPostgresql.pptx -------------------------------------------------------------------------------- /Dataflow/Bigquery to postgresql/constants.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/Bigquery to postgresql/constants.py -------------------------------------------------------------------------------- /Dataflow/Bigquery to postgresql/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/Bigquery to postgresql/main.py -------------------------------------------------------------------------------- /Dataflow/Bigquery to postgresql/setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/Bigquery to postgresql/setup.py -------------------------------------------------------------------------------- /Dataflow/Bigquery to postgresql/text.txt: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Dataflow/Bigquery to postgresql/theory_check_single.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/Bigquery to postgresql/theory_check_single.py -------------------------------------------------------------------------------- /Dataflow/count_allelements.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/count_allelements.py -------------------------------------------------------------------------------- /Dataflow/count_perkey.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/count_perkey.py -------------------------------------------------------------------------------- /Dataflow/count_unique.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/count_unique.py -------------------------------------------------------------------------------- /Dataflow/dataflowtopostgresql.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/dataflowtopostgresql.py -------------------------------------------------------------------------------- /Dataflow/demo.py: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Dataflow/python-dataflow.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Dataflow/python-dataflow.md -------------------------------------------------------------------------------- /E2E-DataEngineering-Projects/End to end Data Engineering Project in Google Cloud Platform.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/E2E-DataEngineering-Projects/End to end Data Engineering Project in Google Cloud Platform.md -------------------------------------------------------------------------------- /E2E-DataEngineering-Projects/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /GCP_Service_Images/Compute Engine/disk_type_in_compute_engine_gcp.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/GCP_Service_Images/Compute Engine/disk_type_in_compute_engine_gcp.png -------------------------------------------------------------------------------- /GCP_Service_Images/Compute Engine/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/GCP_Service_Images/Compute Engine/readme.md -------------------------------------------------------------------------------- /Liens on a project.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Liens on a project.md -------------------------------------------------------------------------------- /PMLE_resources.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/PMLE_resources.md -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/README.md -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/README.md -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/export-pubusb-to-bq.drawio.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/export-pubusb-to-bq.drawio.png -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/json/sample_message.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/json/sample_message.json -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/bigquery.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/bigquery.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/cloud_functions.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/cloud_functions.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/function/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/function/main.py -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/function/requirements.txt: -------------------------------------------------------------------------------- 1 | cloudevents 2 | functions-framework 3 | google-cloud-bigquery 4 | -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/gcp_iam.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/gcp_iam.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/gcs.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/gcs.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/main.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/main.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/outputs.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/outputs.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/provider.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/provider.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/pubsub.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/pubsub.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/terraform.tfvars: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/terraform.tfvars -------------------------------------------------------------------------------- /RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/variables.tf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Event-Driven PubSub to BigQuery/terraform/variables.tf -------------------------------------------------------------------------------- /RealTime-Usecases/Serverless Data Processing with Cloud Dataflow/Latest-Serverless Data Processing with Dataflow - Using Dataflow SQL for Streaming Analytics (Python).md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Serverless Data Processing with Cloud Dataflow/Latest-Serverless Data Processing with Dataflow - Using Dataflow SQL for Streaming Analytics (Python).md -------------------------------------------------------------------------------- /RealTime-Usecases/Serverless Data Processing with Cloud Dataflow/etlpipeline_streaming.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Serverless Data Processing with Cloud Dataflow/etlpipeline_streaming.py -------------------------------------------------------------------------------- /RealTime-Usecases/Serverless Data Processing with Cloud Dataflow/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/RealTime-Usecases/Serverless Data Processing with Cloud Dataflow/readme.md -------------------------------------------------------------------------------- /RealTime-Usecases/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Service Account/ServiceAccount.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Service Account/ServiceAccount.md -------------------------------------------------------------------------------- /Service Account/labonServiceAccount.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Service Account/labonServiceAccount.md -------------------------------------------------------------------------------- /Service Account/labonsa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Service Account/labonsa.py -------------------------------------------------------------------------------- /Service Account/readme.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/Service Account/readme.md -------------------------------------------------------------------------------- /etl-dataflow-GCP/commands.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/etl-dataflow-GCP/commands.md -------------------------------------------------------------------------------- /etl-dataflow-GCP/data_ingestion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/etl-dataflow-GCP/data_ingestion.py -------------------------------------------------------------------------------- /etl-dataflow-GCP/data_transformation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/etl-dataflow-GCP/data_transformation.py -------------------------------------------------------------------------------- /etl-dataflow-GCP/presentation.key: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/etl-dataflow-GCP/presentation.key -------------------------------------------------------------------------------- /etl-dataflow-GCP/readme.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /etl-dataflow-GCP/usa_names_year_as_date.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/etl-dataflow-GCP/usa_names_year_as_date.json -------------------------------------------------------------------------------- /etlvselt.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/etlvselt.docx -------------------------------------------------------------------------------- /userdata.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vigneshSs-07/Cloud-AI-Analytics/HEAD/userdata.csv --------------------------------------------------------------------------------