├── Cassandra ├── README.md ├── data-storage.py └── requirements.txt ├── Kafka ├── README.md ├── config │ └── dev.cfg ├── flask-data-producer.py ├── requirements.txt └── simple-data-producer.py ├── Node.js ├── README.md ├── index.js ├── package.json ├── public │ ├── index.html │ └── main.js └── redis-kafka │ ├── index.js │ └── public │ ├── index.html │ └── main.js ├── README.md ├── Redis ├── README.md ├── redis-publisher.py └── requirements.txt ├── ResultSnapshots ├── 2stocks.jpeg ├── 3stocks.jpeg ├── AAPL.jpeg ├── AMZN.jpeg ├── GOOG.jpeg └── README.md └── Spark ├── README.md ├── spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar └── stream-processing.py /Cassandra/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Cassandra/README.md -------------------------------------------------------------------------------- /Cassandra/data-storage.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Cassandra/data-storage.py -------------------------------------------------------------------------------- /Cassandra/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Cassandra/requirements.txt -------------------------------------------------------------------------------- /Kafka/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Kafka/README.md -------------------------------------------------------------------------------- /Kafka/config/dev.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Kafka/config/dev.cfg -------------------------------------------------------------------------------- /Kafka/flask-data-producer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Kafka/flask-data-producer.py -------------------------------------------------------------------------------- /Kafka/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Kafka/requirements.txt -------------------------------------------------------------------------------- /Kafka/simple-data-producer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Kafka/simple-data-producer.py -------------------------------------------------------------------------------- /Node.js/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/README.md -------------------------------------------------------------------------------- /Node.js/index.js: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/index.js -------------------------------------------------------------------------------- /Node.js/package.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/package.json -------------------------------------------------------------------------------- /Node.js/public/index.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/public/index.html -------------------------------------------------------------------------------- /Node.js/public/main.js: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/public/main.js -------------------------------------------------------------------------------- /Node.js/redis-kafka/index.js: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/redis-kafka/index.js -------------------------------------------------------------------------------- /Node.js/redis-kafka/public/index.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/redis-kafka/public/index.html -------------------------------------------------------------------------------- /Node.js/redis-kafka/public/main.js: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Node.js/redis-kafka/public/main.js -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/README.md -------------------------------------------------------------------------------- /Redis/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Redis/README.md -------------------------------------------------------------------------------- /Redis/redis-publisher.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Redis/redis-publisher.py -------------------------------------------------------------------------------- /Redis/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Redis/requirements.txt -------------------------------------------------------------------------------- /ResultSnapshots/2stocks.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/ResultSnapshots/2stocks.jpeg -------------------------------------------------------------------------------- /ResultSnapshots/3stocks.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/ResultSnapshots/3stocks.jpeg -------------------------------------------------------------------------------- /ResultSnapshots/AAPL.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/ResultSnapshots/AAPL.jpeg -------------------------------------------------------------------------------- /ResultSnapshots/AMZN.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/ResultSnapshots/AMZN.jpeg -------------------------------------------------------------------------------- /ResultSnapshots/GOOG.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/ResultSnapshots/GOOG.jpeg -------------------------------------------------------------------------------- /ResultSnapshots/README.md: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /Spark/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Spark/README.md -------------------------------------------------------------------------------- /Spark/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Spark/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar -------------------------------------------------------------------------------- /Spark/stream-processing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LuQQiu/DataPipeline/HEAD/Spark/stream-processing.py --------------------------------------------------------------------------------