├── .github └── workflows │ └── test.yml ├── .gitignore ├── API_speed_test.py ├── Components ├── Audio_Component.py ├── Eyetracking_Component.py ├── IMU_Component.py ├── Video_Component.py └── __init__.py ├── LICENSE ├── MANIFEST.in ├── MainSys.py ├── README.md ├── Test_Audio.py ├── bpe_simple_vocab_16e6.txt.gz ├── categories_places365.txt ├── clip ├── __init__.py ├── bpe_simple_vocab_16e6.txt.gz ├── clip.py ├── model.py └── simple_tokenizer.py ├── data ├── country211.md ├── prompts.md ├── rendered-sst2.md └── yfcc100m.md ├── database.txt ├── dictionary_and_semantic_hierarchy.txt ├── milvus_management.py ├── requirements.txt ├── socketDemo.py ├── svm_model.joblib └── viewer ├── client_ipc_rc.py ├── client_ipc_sm.py ├── client_ipc_su.py ├── client_ipc_umq.py ├── client_ipc_vi.py ├── client_stream_eet.py ├── client_stream_extended_audio.py ├── client_stream_microphone.py ├── client_stream_microphone_array.py ├── client_stream_pv.py ├── client_stream_rm_depth_ahat.py ├── client_stream_rm_depth_longthrow.py ├── client_stream_rm_imu.py ├── client_stream_rm_vlc.py ├── client_stream_si.py ├── hl2ss.py ├── hl2ss_3dcv.py ├── hl2ss_imshow.py ├── hl2ss_io.py ├── hl2ss_lnm.py ├── hl2ss_mp.py ├── hl2ss_rus.py ├── hl2ss_sa.py ├── hl2ss_utilities.py ├── sample_2d_to_3d_segmentation_pv.py ├── sample_2d_to_3d_segmentation_rm_vlc.py ├── sample_eet_pv.py ├── sample_eet_rm_vlc.py ├── sample_integrator.py ├── sample_integrator_pv.py ├── sample_integrator_pv_sm.py ├── sample_integrator_pv_su.py ├── sample_integrator_rm_vlc.py ├── sample_pv_depth_ahat.py ├── sample_pv_depth_lt.py ├── sample_rgbd.py ├── sample_rgbd_ahat_vlc.py ├── sample_rgbd_pv.py ├── sample_rgbd_rm_vlc.py ├── sample_si_pv.py ├── sample_si_rm_depth_ahat.py ├── sample_si_rm_vlc.py ├── sample_sm_follow.py ├── sample_sm_pv_depth.py ├── sample_stereo_rectify.py ├── sample_stereo_rectify_pv.py ├── sample_video.py ├── sample_viewer_si.py ├── simple_player.py ├── simple_recorder.py ├── simple_sequencer.py ├── texture.jpg ├── unity_sample_cube.py ├── unity_sample_hud.py ├── unity_sample_stickers.py ├── unity_sample_text.py └── unity_sample_tts.py /.github/workflows/test.yml: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/.gitignore -------------------------------------------------------------------------------- /API_speed_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/API_speed_test.py -------------------------------------------------------------------------------- /Components/Audio_Component.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/Components/Audio_Component.py -------------------------------------------------------------------------------- /Components/Eyetracking_Component.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/Components/Eyetracking_Component.py -------------------------------------------------------------------------------- /Components/IMU_Component.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/Components/IMU_Component.py -------------------------------------------------------------------------------- /Components/Video_Component.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/Components/Video_Component.py -------------------------------------------------------------------------------- /Components/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/LICENSE -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- 1 | include clip/bpe_simple_vocab_16e6.txt.gz 2 | -------------------------------------------------------------------------------- /MainSys.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/MainSys.py -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/README.md -------------------------------------------------------------------------------- /Test_Audio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/Test_Audio.py -------------------------------------------------------------------------------- /bpe_simple_vocab_16e6.txt.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/bpe_simple_vocab_16e6.txt.gz -------------------------------------------------------------------------------- /categories_places365.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/categories_places365.txt -------------------------------------------------------------------------------- /clip/__init__.py: -------------------------------------------------------------------------------- 1 | from .clip import * 2 | -------------------------------------------------------------------------------- /clip/bpe_simple_vocab_16e6.txt.gz: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/clip/bpe_simple_vocab_16e6.txt.gz -------------------------------------------------------------------------------- /clip/clip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/clip/clip.py -------------------------------------------------------------------------------- /clip/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/clip/model.py -------------------------------------------------------------------------------- /clip/simple_tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/clip/simple_tokenizer.py -------------------------------------------------------------------------------- /data/country211.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/data/country211.md -------------------------------------------------------------------------------- /data/prompts.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/data/prompts.md -------------------------------------------------------------------------------- /data/rendered-sst2.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/data/rendered-sst2.md -------------------------------------------------------------------------------- /data/yfcc100m.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/data/yfcc100m.md -------------------------------------------------------------------------------- /database.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/database.txt -------------------------------------------------------------------------------- /dictionary_and_semantic_hierarchy.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/dictionary_and_semantic_hierarchy.txt -------------------------------------------------------------------------------- /milvus_management.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/milvus_management.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/requirements.txt -------------------------------------------------------------------------------- /socketDemo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/socketDemo.py -------------------------------------------------------------------------------- /svm_model.joblib: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/svm_model.joblib -------------------------------------------------------------------------------- /viewer/client_ipc_rc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_ipc_rc.py -------------------------------------------------------------------------------- /viewer/client_ipc_sm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_ipc_sm.py -------------------------------------------------------------------------------- /viewer/client_ipc_su.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_ipc_su.py -------------------------------------------------------------------------------- /viewer/client_ipc_umq.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_ipc_umq.py -------------------------------------------------------------------------------- /viewer/client_ipc_vi.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_ipc_vi.py -------------------------------------------------------------------------------- /viewer/client_stream_eet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_eet.py -------------------------------------------------------------------------------- /viewer/client_stream_extended_audio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_extended_audio.py -------------------------------------------------------------------------------- /viewer/client_stream_microphone.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_microphone.py -------------------------------------------------------------------------------- /viewer/client_stream_microphone_array.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_microphone_array.py -------------------------------------------------------------------------------- /viewer/client_stream_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_pv.py -------------------------------------------------------------------------------- /viewer/client_stream_rm_depth_ahat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_rm_depth_ahat.py -------------------------------------------------------------------------------- /viewer/client_stream_rm_depth_longthrow.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_rm_depth_longthrow.py -------------------------------------------------------------------------------- /viewer/client_stream_rm_imu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_rm_imu.py -------------------------------------------------------------------------------- /viewer/client_stream_rm_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_rm_vlc.py -------------------------------------------------------------------------------- /viewer/client_stream_si.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/client_stream_si.py -------------------------------------------------------------------------------- /viewer/hl2ss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss.py -------------------------------------------------------------------------------- /viewer/hl2ss_3dcv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_3dcv.py -------------------------------------------------------------------------------- /viewer/hl2ss_imshow.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_imshow.py -------------------------------------------------------------------------------- /viewer/hl2ss_io.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_io.py -------------------------------------------------------------------------------- /viewer/hl2ss_lnm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_lnm.py -------------------------------------------------------------------------------- /viewer/hl2ss_mp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_mp.py -------------------------------------------------------------------------------- /viewer/hl2ss_rus.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_rus.py -------------------------------------------------------------------------------- /viewer/hl2ss_sa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_sa.py -------------------------------------------------------------------------------- /viewer/hl2ss_utilities.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/hl2ss_utilities.py -------------------------------------------------------------------------------- /viewer/sample_2d_to_3d_segmentation_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_2d_to_3d_segmentation_pv.py -------------------------------------------------------------------------------- /viewer/sample_2d_to_3d_segmentation_rm_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_2d_to_3d_segmentation_rm_vlc.py -------------------------------------------------------------------------------- /viewer/sample_eet_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_eet_pv.py -------------------------------------------------------------------------------- /viewer/sample_eet_rm_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_eet_rm_vlc.py -------------------------------------------------------------------------------- /viewer/sample_integrator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_integrator.py -------------------------------------------------------------------------------- /viewer/sample_integrator_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_integrator_pv.py -------------------------------------------------------------------------------- /viewer/sample_integrator_pv_sm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_integrator_pv_sm.py -------------------------------------------------------------------------------- /viewer/sample_integrator_pv_su.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_integrator_pv_su.py -------------------------------------------------------------------------------- /viewer/sample_integrator_rm_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_integrator_rm_vlc.py -------------------------------------------------------------------------------- /viewer/sample_pv_depth_ahat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_pv_depth_ahat.py -------------------------------------------------------------------------------- /viewer/sample_pv_depth_lt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_pv_depth_lt.py -------------------------------------------------------------------------------- /viewer/sample_rgbd.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_rgbd.py -------------------------------------------------------------------------------- /viewer/sample_rgbd_ahat_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_rgbd_ahat_vlc.py -------------------------------------------------------------------------------- /viewer/sample_rgbd_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_rgbd_pv.py -------------------------------------------------------------------------------- /viewer/sample_rgbd_rm_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_rgbd_rm_vlc.py -------------------------------------------------------------------------------- /viewer/sample_si_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_si_pv.py -------------------------------------------------------------------------------- /viewer/sample_si_rm_depth_ahat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_si_rm_depth_ahat.py -------------------------------------------------------------------------------- /viewer/sample_si_rm_vlc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_si_rm_vlc.py -------------------------------------------------------------------------------- /viewer/sample_sm_follow.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_sm_follow.py -------------------------------------------------------------------------------- /viewer/sample_sm_pv_depth.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_sm_pv_depth.py -------------------------------------------------------------------------------- /viewer/sample_stereo_rectify.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_stereo_rectify.py -------------------------------------------------------------------------------- /viewer/sample_stereo_rectify_pv.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_stereo_rectify_pv.py -------------------------------------------------------------------------------- /viewer/sample_video.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_video.py -------------------------------------------------------------------------------- /viewer/sample_viewer_si.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/sample_viewer_si.py -------------------------------------------------------------------------------- /viewer/simple_player.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/simple_player.py -------------------------------------------------------------------------------- /viewer/simple_recorder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/simple_recorder.py -------------------------------------------------------------------------------- /viewer/simple_sequencer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/simple_sequencer.py -------------------------------------------------------------------------------- /viewer/texture.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/texture.jpg -------------------------------------------------------------------------------- /viewer/unity_sample_cube.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/unity_sample_cube.py -------------------------------------------------------------------------------- /viewer/unity_sample_hud.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/unity_sample_hud.py -------------------------------------------------------------------------------- /viewer/unity_sample_stickers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/unity_sample_stickers.py -------------------------------------------------------------------------------- /viewer/unity_sample_text.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/unity_sample_text.py -------------------------------------------------------------------------------- /viewer/unity_sample_tts.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/JadeGreened/Context_Aware_Text_Augmented_QA_System/HEAD/viewer/unity_sample_tts.py --------------------------------------------------------------------------------