├── Capstone Project ├── Capstone Project.ipynb ├── I94_SAS_Labels_Descriptions.SAS ├── README.md ├── airport-codes_csv.csv ├── create_tables.py ├── immigration_data_sample.csv ├── sql_queries.py └── us-cities-demographics.csv ├── Data Lake ├── README.md ├── dl.cfg └── etl.py ├── Data Modeling with Cassandra ├── .DS_Store ├── Project_1B_ Project_Template.ipynb ├── README.md └── images │ └── image_event_datafile_new.jpg ├── Data Modeling with Postgres ├── README.md ├── create_tables.py ├── etl.ipynb ├── etl.py ├── requirements.txt ├── sql_queries.py └── test.ipynb ├── Data Pipeline ├── .DS_Store ├── README.md ├── create_tables.sql ├── dags │ └── udac_example_dag.py └── plugins │ ├── __init__.py │ ├── helpers │ ├── __init__.py │ └── sql_queries.py │ └── operators │ ├── __init__.py │ ├── data_quality.py │ ├── load_dimension.py │ ├── load_fact.py │ └── stage_redshift.py ├── Data Warehouse ├── README.md ├── create_tables.py ├── dwh.cfg ├── etl.py └── sql_queries.py └── README.md /Capstone Project/Capstone Project.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/Capstone Project.ipynb -------------------------------------------------------------------------------- /Capstone Project/I94_SAS_Labels_Descriptions.SAS: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/I94_SAS_Labels_Descriptions.SAS -------------------------------------------------------------------------------- /Capstone Project/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/README.md -------------------------------------------------------------------------------- /Capstone Project/airport-codes_csv.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/airport-codes_csv.csv -------------------------------------------------------------------------------- /Capstone Project/create_tables.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/create_tables.py -------------------------------------------------------------------------------- /Capstone Project/immigration_data_sample.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/immigration_data_sample.csv -------------------------------------------------------------------------------- /Capstone Project/sql_queries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/sql_queries.py -------------------------------------------------------------------------------- /Capstone Project/us-cities-demographics.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Capstone Project/us-cities-demographics.csv -------------------------------------------------------------------------------- /Data Lake/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Lake/README.md -------------------------------------------------------------------------------- /Data Lake/dl.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Lake/dl.cfg -------------------------------------------------------------------------------- /Data Lake/etl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Lake/etl.py -------------------------------------------------------------------------------- /Data Modeling with Cassandra/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Cassandra/.DS_Store -------------------------------------------------------------------------------- /Data Modeling with Cassandra/Project_1B_ Project_Template.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Cassandra/Project_1B_ Project_Template.ipynb -------------------------------------------------------------------------------- /Data Modeling with Cassandra/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Cassandra/README.md -------------------------------------------------------------------------------- /Data Modeling with Cassandra/images/image_event_datafile_new.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Cassandra/images/image_event_datafile_new.jpg -------------------------------------------------------------------------------- /Data Modeling with Postgres/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/README.md -------------------------------------------------------------------------------- /Data Modeling with Postgres/create_tables.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/create_tables.py -------------------------------------------------------------------------------- /Data Modeling with Postgres/etl.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/etl.ipynb -------------------------------------------------------------------------------- /Data Modeling with Postgres/etl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/etl.py -------------------------------------------------------------------------------- /Data Modeling with Postgres/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/requirements.txt -------------------------------------------------------------------------------- /Data Modeling with Postgres/sql_queries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/sql_queries.py -------------------------------------------------------------------------------- /Data Modeling with Postgres/test.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Modeling with Postgres/test.ipynb -------------------------------------------------------------------------------- /Data Pipeline/.DS_Store: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/.DS_Store -------------------------------------------------------------------------------- /Data Pipeline/README.md: -------------------------------------------------------------------------------- 1 | # Data-Pipelines-with-Airflow -------------------------------------------------------------------------------- /Data Pipeline/create_tables.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/create_tables.sql -------------------------------------------------------------------------------- /Data Pipeline/dags/udac_example_dag.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/dags/udac_example_dag.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/__init__.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/helpers/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/helpers/__init__.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/helpers/sql_queries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/helpers/sql_queries.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/operators/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/operators/__init__.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/operators/data_quality.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/operators/data_quality.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/operators/load_dimension.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/operators/load_dimension.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/operators/load_fact.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/operators/load_fact.py -------------------------------------------------------------------------------- /Data Pipeline/plugins/operators/stage_redshift.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Pipeline/plugins/operators/stage_redshift.py -------------------------------------------------------------------------------- /Data Warehouse/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Warehouse/README.md -------------------------------------------------------------------------------- /Data Warehouse/create_tables.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Warehouse/create_tables.py -------------------------------------------------------------------------------- /Data Warehouse/dwh.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Warehouse/dwh.cfg -------------------------------------------------------------------------------- /Data Warehouse/etl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Warehouse/etl.py -------------------------------------------------------------------------------- /Data Warehouse/sql_queries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/Data Warehouse/sql_queries.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/manuel-lang/Data-Engineering-Nanodegree/HEAD/README.md --------------------------------------------------------------------------------