├── README.md ├── accuracy-graph-for-vgg-finetune-lr=1e-3&nestero.png ├── accuracy-graph-for-vgg-finetune-lr=1e-4&nestero&l2=1e-1.png ├── accuracy-graph-for-vgg-finetune-lr=1e-4&nestero.png ├── accuracy-graph-for-vgg-finetune-lr=1e-5&nestero.png ├── accuracy-graph-for-vgg-finetune-lr=5e-3_l2=5e-1.png ├── accuracy-graph-for-vgg-finetune-lr=5e-4&nestero&l2=1e-1.png ├── accuracy-graph-for-vgg-finetune-lr=5e-4&nestero.png ├── accuracy-graph-for-vgg-finetune-lr=5e-5.png ├── accuracy-graph-for-vgg-finetune.png ├── classifier2.py ├── confusion.py ├── loss-graph-for-vgg-finetune-lr=1e-3$nestero.png ├── loss-graph-for-vgg-finetune-lr=1e-4$nestero&l2=1e-1.png ├── loss-graph-for-vgg-finetune-lr=1e-4$nestero.png ├── loss-graph-for-vgg-finetune-lr=1e-5$nestero.png ├── loss-graph-for-vgg-finetune-lr=5e-3_l2=5e-1.png ├── loss-graph-for-vgg-finetune-lr=5e-4$nestero&l2=1e-1.png ├── loss-graph-for-vgg-finetune-lr=5e-4$nestero.png ├── loss-graph-for-vgg-finetune-lr=5e-5.png ├── loss-graph-for-vgg-finetune.png ├── main.py ├── main2.py ├── pictures ├── VGG16-two-fullyconnect-layer-part1.png ├── VGG16-two-fullyconnect-layer-part2.png ├── category.png ├── confusion_matrix_lip_valAcc=50.png ├── result.png └── test ├── predict.py └── vggmodel.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/README.md -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=1e-3&nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=1e-3&nestero.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=1e-4&nestero&l2=1e-1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=1e-4&nestero&l2=1e-1.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=1e-4&nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=1e-4&nestero.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=1e-5&nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=1e-5&nestero.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=5e-3_l2=5e-1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=5e-3_l2=5e-1.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=5e-4&nestero&l2=1e-1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=5e-4&nestero&l2=1e-1.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=5e-4&nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=5e-4&nestero.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune-lr=5e-5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune-lr=5e-5.png -------------------------------------------------------------------------------- /accuracy-graph-for-vgg-finetune.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/accuracy-graph-for-vgg-finetune.png -------------------------------------------------------------------------------- /classifier2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/classifier2.py -------------------------------------------------------------------------------- /confusion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/confusion.py -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=1e-3$nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=1e-3$nestero.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=1e-4$nestero&l2=1e-1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=1e-4$nestero&l2=1e-1.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=1e-4$nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=1e-4$nestero.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=1e-5$nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=1e-5$nestero.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=5e-3_l2=5e-1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=5e-3_l2=5e-1.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=5e-4$nestero&l2=1e-1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=5e-4$nestero&l2=1e-1.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=5e-4$nestero.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=5e-4$nestero.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune-lr=5e-5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune-lr=5e-5.png -------------------------------------------------------------------------------- /loss-graph-for-vgg-finetune.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/loss-graph-for-vgg-finetune.png -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/main.py -------------------------------------------------------------------------------- /main2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/main2.py -------------------------------------------------------------------------------- /pictures/VGG16-two-fullyconnect-layer-part1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/pictures/VGG16-two-fullyconnect-layer-part1.png -------------------------------------------------------------------------------- /pictures/VGG16-two-fullyconnect-layer-part2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/pictures/VGG16-two-fullyconnect-layer-part2.png -------------------------------------------------------------------------------- /pictures/category.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/pictures/category.png -------------------------------------------------------------------------------- /pictures/confusion_matrix_lip_valAcc=50.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/pictures/confusion_matrix_lip_valAcc=50.png -------------------------------------------------------------------------------- /pictures/result.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/pictures/result.png -------------------------------------------------------------------------------- /pictures/test: -------------------------------------------------------------------------------- 1 | 2 | -------------------------------------------------------------------------------- /predict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/predict.py -------------------------------------------------------------------------------- /vggmodel.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/staywithme23/CNN-for-visual-speech-recognition/HEAD/vggmodel.py --------------------------------------------------------------------------------