├── README.md ├── create_tables.py ├── dags ├── Sparkify_Data_Pipeline_dag.py └── sql_statements.py ├── images ├── Pipelineview.jpg └── SparfiyDAG.jpg └── plugins ├── __init__.py ├── helpers ├── __init__.py └── sql_queries.py └── operators ├── __init__.py ├── data_quality.py ├── load_dimension.py ├── load_fact.py └── stage_redshift.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/README.md -------------------------------------------------------------------------------- /create_tables.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/create_tables.py -------------------------------------------------------------------------------- /dags/Sparkify_Data_Pipeline_dag.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/dags/Sparkify_Data_Pipeline_dag.py -------------------------------------------------------------------------------- /dags/sql_statements.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/dags/sql_statements.py -------------------------------------------------------------------------------- /images/Pipelineview.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/images/Pipelineview.jpg -------------------------------------------------------------------------------- /images/SparfiyDAG.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/images/SparfiyDAG.jpg -------------------------------------------------------------------------------- /plugins/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/__init__.py -------------------------------------------------------------------------------- /plugins/helpers/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/helpers/__init__.py -------------------------------------------------------------------------------- /plugins/helpers/sql_queries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/helpers/sql_queries.py -------------------------------------------------------------------------------- /plugins/operators/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/operators/__init__.py -------------------------------------------------------------------------------- /plugins/operators/data_quality.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/operators/data_quality.py -------------------------------------------------------------------------------- /plugins/operators/load_dimension.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/operators/load_dimension.py -------------------------------------------------------------------------------- /plugins/operators/load_fact.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/operators/load_fact.py -------------------------------------------------------------------------------- /plugins/operators/stage_redshift.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ddgope/Data-Pipelines-with-Airflow/HEAD/plugins/operators/stage_redshift.py --------------------------------------------------------------------------------