├── .github └── PULL_REQUEST_TEMPLATE.md ├── .gitignore ├── .gitmodules ├── LICENSE ├── README.md ├── icons ├── Tuebingen_AI_Center.png ├── collabora.png ├── ellis.jpg └── laion.png ├── latencies ├── .ipynb_checkpoints │ └── visualize_latencies-checkpoint.ipynb └── visualize_latencies.ipynb ├── main.py ├── models_voice_assistant ├── STT │ ├── __init__.py │ ├── conformer_encoder.py │ ├── enc_dec_rnnt_model.py │ ├── rnnt_decoder.py │ └── rnnt_joint.py ├── TTS │ ├── __init__.py │ ├── style_tts2_model.py │ └── whisper_speech_model.py ├── __init__.py └── stt_llm_tts_model.py ├── requirements.txt ├── utils_voice_assistant ├── __init__.py ├── nemo_loader.py ├── preprocessor.py └── streaming_buffer.py └── vocab.npy /.github/PULL_REQUEST_TEMPLATE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/.github/PULL_REQUEST_TEMPLATE.md -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | latencies/times* -------------------------------------------------------------------------------- /.gitmodules: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/.gitmodules -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/README.md -------------------------------------------------------------------------------- /icons/Tuebingen_AI_Center.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/icons/Tuebingen_AI_Center.png -------------------------------------------------------------------------------- /icons/collabora.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/icons/collabora.png -------------------------------------------------------------------------------- /icons/ellis.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/icons/ellis.jpg -------------------------------------------------------------------------------- /icons/laion.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/icons/laion.png -------------------------------------------------------------------------------- /latencies/.ipynb_checkpoints/visualize_latencies-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/latencies/.ipynb_checkpoints/visualize_latencies-checkpoint.ipynb -------------------------------------------------------------------------------- /latencies/visualize_latencies.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/latencies/visualize_latencies.ipynb -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/main.py -------------------------------------------------------------------------------- /models_voice_assistant/STT/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /models_voice_assistant/STT/conformer_encoder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/STT/conformer_encoder.py -------------------------------------------------------------------------------- /models_voice_assistant/STT/enc_dec_rnnt_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/STT/enc_dec_rnnt_model.py -------------------------------------------------------------------------------- /models_voice_assistant/STT/rnnt_decoder.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/STT/rnnt_decoder.py -------------------------------------------------------------------------------- /models_voice_assistant/STT/rnnt_joint.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/STT/rnnt_joint.py -------------------------------------------------------------------------------- /models_voice_assistant/TTS/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /models_voice_assistant/TTS/style_tts2_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/TTS/style_tts2_model.py -------------------------------------------------------------------------------- /models_voice_assistant/TTS/whisper_speech_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/TTS/whisper_speech_model.py -------------------------------------------------------------------------------- /models_voice_assistant/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /models_voice_assistant/stt_llm_tts_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/models_voice_assistant/stt_llm_tts_model.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/requirements.txt -------------------------------------------------------------------------------- /utils_voice_assistant/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /utils_voice_assistant/nemo_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/utils_voice_assistant/nemo_loader.py -------------------------------------------------------------------------------- /utils_voice_assistant/preprocessor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/utils_voice_assistant/preprocessor.py -------------------------------------------------------------------------------- /utils_voice_assistant/streaming_buffer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/utils_voice_assistant/streaming_buffer.py -------------------------------------------------------------------------------- /vocab.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LAION-AI/natural_voice_assistant/HEAD/vocab.npy --------------------------------------------------------------------------------