├── .gitignore ├── README.md ├── environment.yml ├── exp1_multimodal_separation ├── CASE_STUDY_1.ipynb ├── README.md ├── input_files │ ├── mix.wav │ ├── segvel_vln1.mat │ ├── segvel_vln2.mat │ ├── tutorial_video.mp4 │ └── urmp_vln1.mp4 ├── octave │ └── NMF_NNLS.m └── requirements.txt ├── exp2_skeleton_pianist ├── README.md ├── data │ ├── canvas.png │ ├── model │ └── scale_factor.txt ├── example │ ├── Bach_FrenchSuite_1.mid │ ├── Beethoven_No31_Op110_Ch1.mid │ ├── Brahms_Op119.mid │ ├── Mozart_K545_Ch2.mid │ ├── Schubert_D960_Ch1.mid │ └── song_wo_words.mid ├── function.py ├── model.py ├── output │ └── Mozart_K545_Ch2_final.mp4 ├── run.py └── try_more_variations.py └── slides ├── ISMIR2019_Tutorial3_AudiovisualMusicProcessing.pdf └── README.md /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/README.md -------------------------------------------------------------------------------- /environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/environment.yml -------------------------------------------------------------------------------- /exp1_multimodal_separation/CASE_STUDY_1.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/CASE_STUDY_1.ipynb -------------------------------------------------------------------------------- /exp1_multimodal_separation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/README.md -------------------------------------------------------------------------------- /exp1_multimodal_separation/input_files/mix.wav: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/input_files/mix.wav -------------------------------------------------------------------------------- /exp1_multimodal_separation/input_files/segvel_vln1.mat: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/input_files/segvel_vln1.mat -------------------------------------------------------------------------------- /exp1_multimodal_separation/input_files/segvel_vln2.mat: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/input_files/segvel_vln2.mat -------------------------------------------------------------------------------- /exp1_multimodal_separation/input_files/tutorial_video.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/input_files/tutorial_video.mp4 -------------------------------------------------------------------------------- /exp1_multimodal_separation/input_files/urmp_vln1.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/input_files/urmp_vln1.mp4 -------------------------------------------------------------------------------- /exp1_multimodal_separation/octave/NMF_NNLS.m: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp1_multimodal_separation/octave/NMF_NNLS.m -------------------------------------------------------------------------------- /exp1_multimodal_separation/requirements.txt: -------------------------------------------------------------------------------- 1 | librosa 2 | jupyter 3 | matplotlib 4 | oct2py 5 | -------------------------------------------------------------------------------- /exp2_skeleton_pianist/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/README.md -------------------------------------------------------------------------------- /exp2_skeleton_pianist/data/canvas.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/data/canvas.png -------------------------------------------------------------------------------- /exp2_skeleton_pianist/data/model: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/data/model -------------------------------------------------------------------------------- /exp2_skeleton_pianist/data/scale_factor.txt: -------------------------------------------------------------------------------- 1 | 350.899139 2 | 267.102020 3 | 85.514099 -------------------------------------------------------------------------------- /exp2_skeleton_pianist/example/Bach_FrenchSuite_1.mid: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/example/Bach_FrenchSuite_1.mid -------------------------------------------------------------------------------- /exp2_skeleton_pianist/example/Beethoven_No31_Op110_Ch1.mid: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/example/Beethoven_No31_Op110_Ch1.mid -------------------------------------------------------------------------------- /exp2_skeleton_pianist/example/Brahms_Op119.mid: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/example/Brahms_Op119.mid -------------------------------------------------------------------------------- /exp2_skeleton_pianist/example/Mozart_K545_Ch2.mid: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/example/Mozart_K545_Ch2.mid -------------------------------------------------------------------------------- /exp2_skeleton_pianist/example/Schubert_D960_Ch1.mid: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/example/Schubert_D960_Ch1.mid -------------------------------------------------------------------------------- /exp2_skeleton_pianist/example/song_wo_words.mid: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/example/song_wo_words.mid -------------------------------------------------------------------------------- /exp2_skeleton_pianist/function.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/function.py -------------------------------------------------------------------------------- /exp2_skeleton_pianist/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/model.py -------------------------------------------------------------------------------- /exp2_skeleton_pianist/output/Mozart_K545_Ch2_final.mp4: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/output/Mozart_K545_Ch2_final.mp4 -------------------------------------------------------------------------------- /exp2_skeleton_pianist/run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/run.py -------------------------------------------------------------------------------- /exp2_skeleton_pianist/try_more_variations.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/exp2_skeleton_pianist/try_more_variations.py -------------------------------------------------------------------------------- /slides/ISMIR2019_Tutorial3_AudiovisualMusicProcessing.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/bochen1106/ISMIR2019-Tutorial3-Audiovisual-Music-Processing/HEAD/slides/ISMIR2019_Tutorial3_AudiovisualMusicProcessing.pdf -------------------------------------------------------------------------------- /slides/README.md: -------------------------------------------------------------------------------- 1 | 2 | slides will be here 3 | --------------------------------------------------------------------------------