├── README.md ├── config ├── base.yaml └── large.yaml ├── data ├── asr_data_test.csv ├── mix_2_spk_tt.scp └── noise │ └── babble │ └── babble_all_2nd.wav ├── infer_avse_avss.py ├── infer_vsr_avsr.py ├── models ├── cogenav.py ├── resnet.py └── sepformer.py ├── requirements.txt └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/README.md -------------------------------------------------------------------------------- /config/base.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/config/base.yaml -------------------------------------------------------------------------------- /config/large.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/config/large.yaml -------------------------------------------------------------------------------- /data/asr_data_test.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/data/asr_data_test.csv -------------------------------------------------------------------------------- /data/mix_2_spk_tt.scp: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/data/mix_2_spk_tt.scp -------------------------------------------------------------------------------- /data/noise/babble/babble_all_2nd.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/data/noise/babble/babble_all_2nd.wav -------------------------------------------------------------------------------- /infer_avse_avss.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/infer_avse_avss.py -------------------------------------------------------------------------------- /infer_vsr_avsr.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/infer_vsr_avsr.py -------------------------------------------------------------------------------- /models/cogenav.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/models/cogenav.py -------------------------------------------------------------------------------- /models/resnet.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/models/resnet.py -------------------------------------------------------------------------------- /models/sepformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/models/sepformer.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/requirements.txt -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HumanMLLM/CoGenAV/HEAD/utils.py --------------------------------------------------------------------------------