├── LICENSE ├── README.md ├── data_processing ├── README.md ├── charuco_calib.py ├── extract_dp_from_raw.py ├── process_err_esti.py ├── sl_decode_multiscale.py ├── step1_geneate_dep_and_coc.py ├── step2_manual_selection.py ├── step3_prepare_final_data.py ├── step4_verify_final_data.py └── step5_train_test_split.py ├── our_simulator ├── README.md ├── custom_transform.py ├── dataset.py ├── example_hyerpsim_data │ ├── ai_001_002.cam_00.0000.h5 │ ├── ai_001_002.cam_00.0002.h5 │ └── ai_001_002.cam_00.0003.h5 ├── loss.py ├── model_our_sim.py ├── process_hypersim │ ├── metadata_camera_parameters.csv │ ├── step1_parse_hypersim.py │ ├── step2_manual_select_hypersim.py │ ├── step3_add_config_hypersim.py │ ├── step4_verify_hypersim.py │ └── url_partition │ │ ├── all_urls.txt │ │ ├── partition_0.txt │ │ ├── partition_1.txt │ │ ├── partition_2.txt │ │ ├── partition_3.txt │ │ ├── partition_4.txt │ │ ├── partition_5.txt │ │ ├── partition_6.txt │ │ ├── partition_7.txt │ │ ├── partition_7_after.txt │ │ ├── partition_7_before.txt │ │ ├── partition_8.txt │ │ └── partition_9.txt ├── render_from_hypersim.ipynb ├── test_dp_simulator.ipynb └── train_dp_simulator.ipynb └── teaser ├── dataset_summary.png └── our_render_from_rgbd.png /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/README.md -------------------------------------------------------------------------------- /data_processing/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/README.md -------------------------------------------------------------------------------- /data_processing/charuco_calib.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/charuco_calib.py -------------------------------------------------------------------------------- /data_processing/extract_dp_from_raw.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/extract_dp_from_raw.py -------------------------------------------------------------------------------- /data_processing/process_err_esti.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/process_err_esti.py -------------------------------------------------------------------------------- /data_processing/sl_decode_multiscale.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/sl_decode_multiscale.py -------------------------------------------------------------------------------- /data_processing/step1_geneate_dep_and_coc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/step1_geneate_dep_and_coc.py -------------------------------------------------------------------------------- /data_processing/step2_manual_selection.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/step2_manual_selection.py -------------------------------------------------------------------------------- /data_processing/step3_prepare_final_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/step3_prepare_final_data.py -------------------------------------------------------------------------------- /data_processing/step4_verify_final_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/step4_verify_final_data.py -------------------------------------------------------------------------------- /data_processing/step5_train_test_split.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/data_processing/step5_train_test_split.py -------------------------------------------------------------------------------- /our_simulator/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/README.md -------------------------------------------------------------------------------- /our_simulator/custom_transform.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/custom_transform.py -------------------------------------------------------------------------------- /our_simulator/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/dataset.py -------------------------------------------------------------------------------- /our_simulator/example_hyerpsim_data/ai_001_002.cam_00.0000.h5: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/example_hyerpsim_data/ai_001_002.cam_00.0000.h5 -------------------------------------------------------------------------------- /our_simulator/example_hyerpsim_data/ai_001_002.cam_00.0002.h5: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/example_hyerpsim_data/ai_001_002.cam_00.0002.h5 -------------------------------------------------------------------------------- /our_simulator/example_hyerpsim_data/ai_001_002.cam_00.0003.h5: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/example_hyerpsim_data/ai_001_002.cam_00.0003.h5 -------------------------------------------------------------------------------- /our_simulator/loss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/loss.py -------------------------------------------------------------------------------- /our_simulator/model_our_sim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/model_our_sim.py -------------------------------------------------------------------------------- /our_simulator/process_hypersim/metadata_camera_parameters.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/metadata_camera_parameters.csv -------------------------------------------------------------------------------- /our_simulator/process_hypersim/step1_parse_hypersim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/step1_parse_hypersim.py -------------------------------------------------------------------------------- /our_simulator/process_hypersim/step2_manual_select_hypersim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/step2_manual_select_hypersim.py -------------------------------------------------------------------------------- /our_simulator/process_hypersim/step3_add_config_hypersim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/step3_add_config_hypersim.py -------------------------------------------------------------------------------- /our_simulator/process_hypersim/step4_verify_hypersim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/step4_verify_hypersim.py -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/all_urls.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/all_urls.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_0.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_0.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_1.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_1.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_2.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_2.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_3.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_3.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_4.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_4.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_5.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_5.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_6.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_6.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_7.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_7.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_7_after.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_7_after.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_7_before.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_7_before.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_8.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_8.txt -------------------------------------------------------------------------------- /our_simulator/process_hypersim/url_partition/partition_9.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/process_hypersim/url_partition/partition_9.txt -------------------------------------------------------------------------------- /our_simulator/render_from_hypersim.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/render_from_hypersim.ipynb -------------------------------------------------------------------------------- /our_simulator/test_dp_simulator.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/test_dp_simulator.ipynb -------------------------------------------------------------------------------- /our_simulator/train_dp_simulator.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/our_simulator/train_dp_simulator.ipynb -------------------------------------------------------------------------------- /teaser/dataset_summary.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/teaser/dataset_summary.png -------------------------------------------------------------------------------- /teaser/our_render_from_rgbd.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/feiran-l/Neural-Dual-Pixel-Simulator/HEAD/teaser/our_render_from_rgbd.png --------------------------------------------------------------------------------