├── .gitignore ├── ASR_main.py ├── LICENSE ├── README.md ├── VLM_main.py ├── assets ├── title.png └── title_emoji.png ├── chatLLM ├── base_model.py ├── gemini.py └── openAI.py ├── configs ├── audio_extract.yml ├── query_engine.yml └── vision_extract.yml ├── env_list.env ├── main.py ├── models_ASR ├── base_model.py └── whisper.py ├── models_VLM ├── base_model.py ├── gemini.py └── smolVLM.py ├── prompts ├── caption.py ├── chatbot.py ├── multi_frame.py └── video_clip.py ├── requirements.txt ├── utils ├── __init__.py ├── audio_utils.py ├── db_utils.py ├── format_text_utils.py ├── index_utils.py └── video_utils.py └── viewer └── video_chat.html /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/.gitignore -------------------------------------------------------------------------------- /ASR_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/ASR_main.py -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/README.md -------------------------------------------------------------------------------- /VLM_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/VLM_main.py -------------------------------------------------------------------------------- /assets/title.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/assets/title.png -------------------------------------------------------------------------------- /assets/title_emoji.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/assets/title_emoji.png -------------------------------------------------------------------------------- /chatLLM/base_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/chatLLM/base_model.py -------------------------------------------------------------------------------- /chatLLM/gemini.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/chatLLM/gemini.py -------------------------------------------------------------------------------- /chatLLM/openAI.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/chatLLM/openAI.py -------------------------------------------------------------------------------- /configs/audio_extract.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/configs/audio_extract.yml -------------------------------------------------------------------------------- /configs/query_engine.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/configs/query_engine.yml -------------------------------------------------------------------------------- /configs/vision_extract.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/configs/vision_extract.yml -------------------------------------------------------------------------------- /env_list.env: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/env_list.env -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/main.py -------------------------------------------------------------------------------- /models_ASR/base_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/models_ASR/base_model.py -------------------------------------------------------------------------------- /models_ASR/whisper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/models_ASR/whisper.py -------------------------------------------------------------------------------- /models_VLM/base_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/models_VLM/base_model.py -------------------------------------------------------------------------------- /models_VLM/gemini.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/models_VLM/gemini.py -------------------------------------------------------------------------------- /models_VLM/smolVLM.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/models_VLM/smolVLM.py -------------------------------------------------------------------------------- /prompts/caption.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/prompts/caption.py -------------------------------------------------------------------------------- /prompts/chatbot.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/prompts/chatbot.py -------------------------------------------------------------------------------- /prompts/multi_frame.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/prompts/multi_frame.py -------------------------------------------------------------------------------- /prompts/video_clip.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/prompts/video_clip.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/requirements.txt -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/utils/__init__.py -------------------------------------------------------------------------------- /utils/audio_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/utils/audio_utils.py -------------------------------------------------------------------------------- /utils/db_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/utils/db_utils.py -------------------------------------------------------------------------------- /utils/format_text_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/utils/format_text_utils.py -------------------------------------------------------------------------------- /utils/index_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/utils/index_utils.py -------------------------------------------------------------------------------- /utils/video_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/utils/video_utils.py -------------------------------------------------------------------------------- /viewer/video_chat.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/choteVLM/shiKai/HEAD/viewer/video_chat.html --------------------------------------------------------------------------------