├── High Level Infra.drawio.png ├── README.md ├── airflow-redshift-template.yaml ├── dags ├── openweather_api.py └── transform_redshift_load.py ├── requirements.txt └── scripts └── transform.py /High Level Infra.drawio.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AnandDedha/aws-airflow-dataengineering-pipeline/HEAD/High Level Infra.drawio.png -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AnandDedha/aws-airflow-dataengineering-pipeline/HEAD/README.md -------------------------------------------------------------------------------- /airflow-redshift-template.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AnandDedha/aws-airflow-dataengineering-pipeline/HEAD/airflow-redshift-template.yaml -------------------------------------------------------------------------------- /dags/openweather_api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AnandDedha/aws-airflow-dataengineering-pipeline/HEAD/dags/openweather_api.py -------------------------------------------------------------------------------- /dags/transform_redshift_load.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AnandDedha/aws-airflow-dataengineering-pipeline/HEAD/dags/transform_redshift_load.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | pandas==1.3.5 2 | requests==2.31.0 3 | 4 | -------------------------------------------------------------------------------- /scripts/transform.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AnandDedha/aws-airflow-dataengineering-pipeline/HEAD/scripts/transform.py --------------------------------------------------------------------------------