├── Chapter03 ├── AirflowCSV.py ├── fromAirflow.json ├── loadcsv.py ├── loadjson.py ├── readcsv.py └── readjson.py ├── Chapter04 ├── AirflowDB.py ├── createrecord.py ├── elasticsearchbulk.py ├── elasticsearchquery.py ├── elasticsearchsingle.py ├── executemany.py ├── fromdb.csv ├── querydf.py ├── queryusers.py └── scroll.py ├── Chapter05 ├── AirflowClean.py ├── geocodedstreet.csv └── scooter.csv ├── Chapter06 ├── GetEveryPage.py ├── QuerySCFArchived.py ├── SCF.xml ├── coords.py └── querySCF.py ├── Chapter07 ├── loadcsv-fail.py ├── loadcsv.py └── peoplevalidatescript.py ├── Chapter09 ├── api.py └── api.txt ├── Chapter11 ├── CreateDataLake.py ├── createtablescript └── sv.py ├── Chapter13 ├── kclient.py ├── kproducer.py ├── python-log.log └── pythonlog.py ├── Chapter14 ├── DataFrame-Kafka.py ├── EstimatePi.py └── data.csv ├── LICENSE └── README.md /Chapter03/AirflowCSV.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter03/AirflowCSV.py -------------------------------------------------------------------------------- /Chapter03/fromAirflow.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter03/fromAirflow.json -------------------------------------------------------------------------------- /Chapter03/loadcsv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter03/loadcsv.py -------------------------------------------------------------------------------- /Chapter03/loadjson.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter03/loadjson.py -------------------------------------------------------------------------------- /Chapter03/readcsv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter03/readcsv.py -------------------------------------------------------------------------------- /Chapter03/readjson.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter03/readjson.py -------------------------------------------------------------------------------- /Chapter04/AirflowDB.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/AirflowDB.py -------------------------------------------------------------------------------- /Chapter04/createrecord.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/createrecord.py -------------------------------------------------------------------------------- /Chapter04/elasticsearchbulk.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/elasticsearchbulk.py -------------------------------------------------------------------------------- /Chapter04/elasticsearchquery.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/elasticsearchquery.py -------------------------------------------------------------------------------- /Chapter04/elasticsearchsingle.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/elasticsearchsingle.py -------------------------------------------------------------------------------- /Chapter04/executemany.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/executemany.py -------------------------------------------------------------------------------- /Chapter04/fromdb.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/fromdb.csv -------------------------------------------------------------------------------- /Chapter04/querydf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/querydf.py -------------------------------------------------------------------------------- /Chapter04/queryusers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/queryusers.py -------------------------------------------------------------------------------- /Chapter04/scroll.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter04/scroll.py -------------------------------------------------------------------------------- /Chapter05/AirflowClean.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter05/AirflowClean.py -------------------------------------------------------------------------------- /Chapter05/geocodedstreet.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter05/geocodedstreet.csv -------------------------------------------------------------------------------- /Chapter05/scooter.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter05/scooter.csv -------------------------------------------------------------------------------- /Chapter06/GetEveryPage.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter06/GetEveryPage.py -------------------------------------------------------------------------------- /Chapter06/QuerySCFArchived.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter06/QuerySCFArchived.py -------------------------------------------------------------------------------- /Chapter06/SCF.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter06/SCF.xml -------------------------------------------------------------------------------- /Chapter06/coords.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter06/coords.py -------------------------------------------------------------------------------- /Chapter06/querySCF.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter06/querySCF.py -------------------------------------------------------------------------------- /Chapter07/loadcsv-fail.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter07/loadcsv-fail.py -------------------------------------------------------------------------------- /Chapter07/loadcsv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter07/loadcsv.py -------------------------------------------------------------------------------- /Chapter07/peoplevalidatescript.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter07/peoplevalidatescript.py -------------------------------------------------------------------------------- /Chapter09/api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter09/api.py -------------------------------------------------------------------------------- /Chapter09/api.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter09/api.txt -------------------------------------------------------------------------------- /Chapter11/CreateDataLake.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter11/CreateDataLake.py -------------------------------------------------------------------------------- /Chapter11/createtablescript: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter11/createtablescript -------------------------------------------------------------------------------- /Chapter11/sv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter11/sv.py -------------------------------------------------------------------------------- /Chapter13/kclient.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter13/kclient.py -------------------------------------------------------------------------------- /Chapter13/kproducer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter13/kproducer.py -------------------------------------------------------------------------------- /Chapter13/python-log.log: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter13/python-log.log -------------------------------------------------------------------------------- /Chapter13/pythonlog.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter13/pythonlog.py -------------------------------------------------------------------------------- /Chapter14/DataFrame-Kafka.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter14/DataFrame-Kafka.py -------------------------------------------------------------------------------- /Chapter14/EstimatePi.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter14/EstimatePi.py -------------------------------------------------------------------------------- /Chapter14/data.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/Chapter14/data.csv -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Data-Engineering-with-Python/HEAD/README.md --------------------------------------------------------------------------------