├── 61515pyspark-filter.png ├── BatchProcessing ├── 1- SparkRDD Operations &DFs.ipynb ├── 2- SparkDataFrameOperations.ipynb ├── NullData.csv ├── RDD operations.ipynb ├── departuredelays.zip ├── people.json ├── sf-fire-calls.zip └── userdata.parquet ├── README.md └── StreamingProcessing ├── SparkStreaming-Reading from files (Text).ipynb ├── SparkStreaming-Reading from files (csv&parquet).ipynb ├── SparkStreamingWriting to files (memory).ipynb └── SparkStructuredStreamingIntro.ipynb /61515pyspark-filter.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/61515pyspark-filter.png -------------------------------------------------------------------------------- /BatchProcessing/1- SparkRDD Operations &DFs.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/1- SparkRDD Operations &DFs.ipynb -------------------------------------------------------------------------------- /BatchProcessing/2- SparkDataFrameOperations.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/2- SparkDataFrameOperations.ipynb -------------------------------------------------------------------------------- /BatchProcessing/NullData.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/NullData.csv -------------------------------------------------------------------------------- /BatchProcessing/RDD operations.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/RDD operations.ipynb -------------------------------------------------------------------------------- /BatchProcessing/departuredelays.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/departuredelays.zip -------------------------------------------------------------------------------- /BatchProcessing/people.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/people.json -------------------------------------------------------------------------------- /BatchProcessing/sf-fire-calls.zip: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/sf-fire-calls.zip -------------------------------------------------------------------------------- /BatchProcessing/userdata.parquet: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/BatchProcessing/userdata.parquet -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/README.md -------------------------------------------------------------------------------- /StreamingProcessing/SparkStreaming-Reading from files (Text).ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/StreamingProcessing/SparkStreaming-Reading from files (Text).ipynb -------------------------------------------------------------------------------- /StreamingProcessing/SparkStreaming-Reading from files (csv&parquet).ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/StreamingProcessing/SparkStreaming-Reading from files (csv&parquet).ipynb -------------------------------------------------------------------------------- /StreamingProcessing/SparkStreamingWriting to files (memory).ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/StreamingProcessing/SparkStreamingWriting to files (memory).ipynb -------------------------------------------------------------------------------- /StreamingProcessing/SparkStructuredStreamingIntro.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Muhammadatef/Spark-Recap/HEAD/StreamingProcessing/SparkStructuredStreamingIntro.ipynb --------------------------------------------------------------------------------