├── Airflow ├── AirflowDemo │ ├── Helloworld.py │ └── datatest.py ├── README.md ├── airflow_docs.docx └── ~$rflow_docs.docx ├── Celery ├── Celerydemo │ └── celery_blog.py ├── README.md └── celery_install_doc.docx ├── DASK ├── DASKDemo │ ├── AWSDASKDemo.ipynb │ └── DaskDemo.ipynb ├── InstructionsForDASK.docx └── README.md ├── DataPipelining.docx ├── Luigi ├── Instructions.docx ├── LuigiDemo │ ├── aggregateTask.py │ ├── loadFromAPI.py │ ├── loadFromMySQL.py │ └── saveFinalOutput.py ├── Readme.md ├── luigidemo.mp4 └── ~$structions.docx ├── Make ├── InstructionsForMakeDemo.docx ├── MakeDemo.mp4 ├── MakeDemo │ ├── Makefile │ ├── aggregateTask.py │ ├── loadFromAPI1.py │ ├── loadFromAPI2.py │ └── saveFinalOutput.py └── Readme.md ├── README.md └── Team1_DataPipelining.pptx /Airflow/AirflowDemo/Helloworld.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Airflow/AirflowDemo/Helloworld.py -------------------------------------------------------------------------------- /Airflow/AirflowDemo/datatest.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Airflow/AirflowDemo/datatest.py -------------------------------------------------------------------------------- /Airflow/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Airflow/README.md -------------------------------------------------------------------------------- /Airflow/airflow_docs.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Airflow/airflow_docs.docx -------------------------------------------------------------------------------- /Airflow/~$rflow_docs.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Airflow/~$rflow_docs.docx -------------------------------------------------------------------------------- /Celery/Celerydemo/celery_blog.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Celery/Celerydemo/celery_blog.py -------------------------------------------------------------------------------- /Celery/README.md: -------------------------------------------------------------------------------- 1 | Youtube Link: https://youtu.be/XelpLUcpKLM -------------------------------------------------------------------------------- /Celery/celery_install_doc.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Celery/celery_install_doc.docx -------------------------------------------------------------------------------- /DASK/DASKDemo/AWSDASKDemo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/DASK/DASKDemo/AWSDASKDemo.ipynb -------------------------------------------------------------------------------- /DASK/DASKDemo/DaskDemo.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/DASK/DASKDemo/DaskDemo.ipynb -------------------------------------------------------------------------------- /DASK/InstructionsForDASK.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/DASK/InstructionsForDASK.docx -------------------------------------------------------------------------------- /DASK/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/DASK/README.md -------------------------------------------------------------------------------- /DataPipelining.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/DataPipelining.docx -------------------------------------------------------------------------------- /Luigi/Instructions.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/Instructions.docx -------------------------------------------------------------------------------- /Luigi/LuigiDemo/aggregateTask.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/LuigiDemo/aggregateTask.py -------------------------------------------------------------------------------- /Luigi/LuigiDemo/loadFromAPI.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/LuigiDemo/loadFromAPI.py -------------------------------------------------------------------------------- /Luigi/LuigiDemo/loadFromMySQL.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/LuigiDemo/loadFromMySQL.py -------------------------------------------------------------------------------- /Luigi/LuigiDemo/saveFinalOutput.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/LuigiDemo/saveFinalOutput.py -------------------------------------------------------------------------------- /Luigi/Readme.md: -------------------------------------------------------------------------------- 1 | #Youtube Link for Luigi Demo 2 | https://youtu.be/NxsVEj0NeH4 3 | -------------------------------------------------------------------------------- /Luigi/luigidemo.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/luigidemo.mp4 -------------------------------------------------------------------------------- /Luigi/~$structions.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Luigi/~$structions.docx -------------------------------------------------------------------------------- /Make/InstructionsForMakeDemo.docx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/InstructionsForMakeDemo.docx -------------------------------------------------------------------------------- /Make/MakeDemo.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/MakeDemo.mp4 -------------------------------------------------------------------------------- /Make/MakeDemo/Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/MakeDemo/Makefile -------------------------------------------------------------------------------- /Make/MakeDemo/aggregateTask.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/MakeDemo/aggregateTask.py -------------------------------------------------------------------------------- /Make/MakeDemo/loadFromAPI1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/MakeDemo/loadFromAPI1.py -------------------------------------------------------------------------------- /Make/MakeDemo/loadFromAPI2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/MakeDemo/loadFromAPI2.py -------------------------------------------------------------------------------- /Make/MakeDemo/saveFinalOutput.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Make/MakeDemo/saveFinalOutput.py -------------------------------------------------------------------------------- /Make/Readme.md: -------------------------------------------------------------------------------- 1 | #Youtube Link 2 | https://youtu.be/Pb7lJMeXczo 3 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/README.md -------------------------------------------------------------------------------- /Team1_DataPipelining.pptx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/vishalsatam/Data-Pipelining/HEAD/Team1_DataPipelining.pptx --------------------------------------------------------------------------------