├── .gitignore ├── .pre-commit-config.yaml ├── Dockerfile ├── README.md ├── docker-compose.yaml ├── git-hooks ├── copy_hooks.sh └── hooks │ └── pre-commit ├── requirements.txt ├── src └── main.py └── tests └── test_main.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/.gitignore -------------------------------------------------------------------------------- /.pre-commit-config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/.pre-commit-config.yaml -------------------------------------------------------------------------------- /Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/Dockerfile -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/README.md -------------------------------------------------------------------------------- /docker-compose.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/docker-compose.yaml -------------------------------------------------------------------------------- /git-hooks/copy_hooks.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/git-hooks/copy_hooks.sh -------------------------------------------------------------------------------- /git-hooks/hooks/pre-commit: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/git-hooks/hooks/pre-commit -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | pyspark==3.2.1 2 | pandas==1.0.5 3 | -------------------------------------------------------------------------------- /src/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/src/main.py -------------------------------------------------------------------------------- /tests/test_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/danielbeach/dataEngineeringTemplate/HEAD/tests/test_main.py --------------------------------------------------------------------------------