├── .gitignore ├── LICENSE ├── README.md ├── img ├── graphx_aggmsg_map.jpg ├── graphx_aggmsg_reduce.jpg ├── graphx_build_edge.jpg ├── graphx_build_graph.jpg ├── graphx_build_vertex.jpg ├── graphx_global.jpg ├── hidden-kcore.png ├── k-cores.png ├── k.png ├── kcore-runtime-after.jpg ├── kcore-runtime-before.jpg ├── saprk_8_1_dep.jpg ├── saprk_8_1_dep_data.jpg ├── saprk_8_1_dep_fn.jpg ├── saprk_8_framework.jpg ├── spark_8_2_dag_concept.jpg ├── spark_8_2_dag_concept2.jpg ├── spark_8_overview.jpg ├── spark_core_dag_finalstage.jpg ├── spark_core_dag_submitstage.jpg ├── spark_core_executor_before_run.jpg ├── spark_core_executor_resulttask.jpg ├── spark_core_full.jpg ├── spark_core_init.jpg ├── spark_core_program.jpg ├── spark_core_submitjob.jpg ├── spark_core_taskscheduler.jpg ├── spark_repl │ ├── 1_entrance.jpg │ ├── 2_1_create_intp.jpg │ ├── 2_2_chose_reader.jpg │ ├── 2_3_bind.jpg │ ├── 2_8_loop_rep.jpg │ ├── 3_summary.jpg │ └── spark_repl.jpg ├── spark_ui_jetty_server.png └── spark_ui_master.png ├── jvm_serializer_benchmark.pdf ├── overview.markdown ├── spark_core_getstart_from_pi.markdown ├── spark_eight_style.markdown ├── spark_eight_style_1_rdd.markdown ├── spark_eight_style_2_dag_lazy.markdown ├── spark_graphx_analyze.markdown ├── spark_repl.markdown ├── spark_ui.markdown ├── src ├── saprk_八法.graffle ├── spark_core.graffle ├── spark_graphx_analyze.graffle ├── spark_repl.graffle └── spark_streaming.graffle └── 食不厌精，脍不厌细：如何一步步将kcore算法提升5倍性能.markdown /.gitignore: -------------------------------------------------------------------------------- 1 | .DS_Store 2 | *.zip 3 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/README.md -------------------------------------------------------------------------------- /img/graphx_aggmsg_map.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/graphx_aggmsg_map.jpg -------------------------------------------------------------------------------- /img/graphx_aggmsg_reduce.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/graphx_aggmsg_reduce.jpg -------------------------------------------------------------------------------- /img/graphx_build_edge.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/graphx_build_edge.jpg -------------------------------------------------------------------------------- /img/graphx_build_graph.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/graphx_build_graph.jpg -------------------------------------------------------------------------------- /img/graphx_build_vertex.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/graphx_build_vertex.jpg -------------------------------------------------------------------------------- /img/graphx_global.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/graphx_global.jpg -------------------------------------------------------------------------------- /img/hidden-kcore.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/hidden-kcore.png -------------------------------------------------------------------------------- /img/k-cores.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/k-cores.png -------------------------------------------------------------------------------- /img/k.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/k.png -------------------------------------------------------------------------------- /img/kcore-runtime-after.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/kcore-runtime-after.jpg -------------------------------------------------------------------------------- /img/kcore-runtime-before.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/kcore-runtime-before.jpg -------------------------------------------------------------------------------- /img/saprk_8_1_dep.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/saprk_8_1_dep.jpg -------------------------------------------------------------------------------- /img/saprk_8_1_dep_data.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/saprk_8_1_dep_data.jpg -------------------------------------------------------------------------------- /img/saprk_8_1_dep_fn.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/saprk_8_1_dep_fn.jpg -------------------------------------------------------------------------------- /img/saprk_8_framework.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/saprk_8_framework.jpg -------------------------------------------------------------------------------- /img/spark_8_2_dag_concept.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_8_2_dag_concept.jpg -------------------------------------------------------------------------------- /img/spark_8_2_dag_concept2.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_8_2_dag_concept2.jpg -------------------------------------------------------------------------------- /img/spark_8_overview.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_8_overview.jpg -------------------------------------------------------------------------------- /img/spark_core_dag_finalstage.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_dag_finalstage.jpg -------------------------------------------------------------------------------- /img/spark_core_dag_submitstage.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_dag_submitstage.jpg -------------------------------------------------------------------------------- /img/spark_core_executor_before_run.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_executor_before_run.jpg -------------------------------------------------------------------------------- /img/spark_core_executor_resulttask.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_executor_resulttask.jpg -------------------------------------------------------------------------------- /img/spark_core_full.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_full.jpg -------------------------------------------------------------------------------- /img/spark_core_init.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_init.jpg -------------------------------------------------------------------------------- /img/spark_core_program.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_program.jpg -------------------------------------------------------------------------------- /img/spark_core_submitjob.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_submitjob.jpg -------------------------------------------------------------------------------- /img/spark_core_taskscheduler.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_core_taskscheduler.jpg -------------------------------------------------------------------------------- /img/spark_repl/1_entrance.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/1_entrance.jpg -------------------------------------------------------------------------------- /img/spark_repl/2_1_create_intp.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/2_1_create_intp.jpg -------------------------------------------------------------------------------- /img/spark_repl/2_2_chose_reader.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/2_2_chose_reader.jpg -------------------------------------------------------------------------------- /img/spark_repl/2_3_bind.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/2_3_bind.jpg -------------------------------------------------------------------------------- /img/spark_repl/2_8_loop_rep.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/2_8_loop_rep.jpg -------------------------------------------------------------------------------- /img/spark_repl/3_summary.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/3_summary.jpg -------------------------------------------------------------------------------- /img/spark_repl/spark_repl.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_repl/spark_repl.jpg -------------------------------------------------------------------------------- /img/spark_ui_jetty_server.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_ui_jetty_server.png -------------------------------------------------------------------------------- /img/spark_ui_master.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/img/spark_ui_master.png -------------------------------------------------------------------------------- /jvm_serializer_benchmark.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/jvm_serializer_benchmark.pdf -------------------------------------------------------------------------------- /overview.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/overview.markdown -------------------------------------------------------------------------------- /spark_core_getstart_from_pi.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_core_getstart_from_pi.markdown -------------------------------------------------------------------------------- /spark_eight_style.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_eight_style.markdown -------------------------------------------------------------------------------- /spark_eight_style_1_rdd.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_eight_style_1_rdd.markdown -------------------------------------------------------------------------------- /spark_eight_style_2_dag_lazy.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_eight_style_2_dag_lazy.markdown -------------------------------------------------------------------------------- /spark_graphx_analyze.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_graphx_analyze.markdown -------------------------------------------------------------------------------- /spark_repl.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_repl.markdown -------------------------------------------------------------------------------- /spark_ui.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/spark_ui.markdown -------------------------------------------------------------------------------- /src/saprk_八法.graffle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/src/saprk_八法.graffle -------------------------------------------------------------------------------- /src/spark_core.graffle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/src/spark_core.graffle -------------------------------------------------------------------------------- /src/spark_graphx_analyze.graffle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/src/spark_graphx_analyze.graffle -------------------------------------------------------------------------------- /src/spark_repl.graffle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/src/spark_repl.graffle -------------------------------------------------------------------------------- /src/spark_streaming.graffle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/src/spark_streaming.graffle -------------------------------------------------------------------------------- /食不厌精，脍不厌细：如何一步步将kcore算法提升5倍性能.markdown: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/shijinkui/spark_study/HEAD/食不厌精，脍不厌细：如何一步步将kcore算法提升5倍性能.markdown --------------------------------------------------------------------------------