├── .gitignore ├── README.md ├── app ├── .gitignore ├── build.gradle ├── proguard-rules.pro └── src │ ├── androidTest │ └── java │ │ └── com │ │ └── baidu │ │ └── paddle │ │ └── lite │ │ └── demo │ │ └── tts │ │ └── ExampleInstrumentedTest.java │ ├── main │ ├── AndroidManifest.xml │ ├── java │ │ └── com │ │ │ └── baidu │ │ │ └── paddle │ │ │ └── lite │ │ │ └── demo │ │ │ └── tts │ │ │ ├── AppCompatPreferenceActivity.java │ │ │ ├── MainActivity.java │ │ │ ├── Predictor.java │ │ │ ├── SettingsActivity.java │ │ │ └── Utils.java │ └── res │ │ ├── drawable │ │ ├── button_drawable.xml │ │ ├── logo.jpg │ │ └── paddlespeech_logo.png │ │ ├── layout │ │ └── activity_main.xml │ │ ├── menu │ │ └── menu_action_options.xml │ │ ├── values │ │ ├── arrays.xml │ │ ├── colors.xml │ │ ├── strings.xml │ │ └── styles.xml │ │ └── xml │ │ └── settings.xml │ └── test │ └── java │ └── com │ └── baidu │ └── paddle │ └── lite │ └── demo │ └── tts │ └── ExampleUnitTest.java ├── build.gradle ├── gradle.properties ├── gradle └── wrapper │ ├── gradle-wrapper.jar │ └── gradle-wrapper.properties ├── gradlew ├── gradlew.bat └── settings.gradle /.gitignore: -------------------------------------------------------------------------------- 1 | *.iml 2 | .gradle 3 | /local.properties 4 | /.idea/caches 5 | /.idea/libraries 6 | /.idea/modules.xml 7 | /.idea/workspace.xml 8 | /.idea/navEditor.xml 9 | /.idea/assetWizardSettings.xml 10 | .DS_Store 11 | /build 12 | /captures 13 | .externalNativeBuild 14 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # 语音合成 Java API Demo 使用指南 2 | 3 | 在 Android 上实现语音合成功能，此 Demo 有很好的的易用性和开放性，如在 Demo 中跑自己训练好的模型等。 4 | 5 | 本文主要介绍语音合成 Demo 运行方法。 6 | 7 | ## 如何运行语音合成 Demo 8 | 9 | ### 环境准备 10 | 11 | 1. 在本地环境安装好 Android Studio 工具，详细安装方法请见 [Android Stuido 官网](https://developer.android.com/studio)。 12 | 2. 准备一部 Android 手机，并开启 USB 调试模式。开启方法: `手机设置 -> 查找开发者选项 -> 打开开发者选项和 USB 调试模式`。 13 | 14 | **注意**： 15 | > 如果您的 Android Studio 尚未配置 NDK ，请根据 Android Studio 用户指南中的[安装及配置 NDK 和 CMake ](https://developer.android.com/studio/projects/install-ndk)内容，预先配置好 NDK 。您可以选择最新的 NDK 版本，或者使用 Paddle Lite 预测库版本一样的 NDK。 16 | 17 | ### 部署步骤 18 | 19 | 1. 用 Android Studio 打开 TTSAndroid 工程。 20 | 2. 手机连接电脑，打开 USB 调试和文件传输模式，并在 Android Studio 上连接自己的手机设备（手机需要开启允许从 USB 安装软件权限）。 21 | 22 | **注意：** 23 | >1. 如果您在导入项目、编译或者运行过程中遇到 NDK 配置错误的提示，请打开 `File > Project Structure > SDK Location`，修改 `Andriod NDK location` 为您本机配置的 NDK 所在路径。 24 | >2. 如果您是通过 Andriod Studio 的 SDK Tools 下载的 NDK (见本章节"环境准备")，可以直接点击下拉框选择默认路径。 25 | >3. 还有一种 NDK 配置方法，你可以在 `TTSAndroid/local.properties` 文件中手动添加 NDK 路径配置 `nkd.dir=/root/android-ndk-r20b` 26 | >4. 如果以上步骤仍旧无法解决 NDK 配置错误，请尝试根据 Andriod Studio 官方文档中的[更新 Android Gradle 插件](https://developer.android.com/studio/releases/gradle-plugin?hl=zh-cn#updating-plugin)章节，尝试更新 Android Gradle plugin 版本。 27 | 28 | 3. 点击 Run 按钮，自动编译 APP 并安装到手机。(该过程会自动下载 Paddle Lite 预测库和模型，需要联网) 29 | 成功后效果如下： 30 | - pic 1：APP 安装到手机。 31 | - pic 2：APP 打开后的效果，在下拉框中选择待合成的文本。 32 | - pic 3：合成后点击按钮播放音频。 33 | 34 |

35 | 36 | ## 更新预测库 37 | 38 | * Paddle Lite 39 | 项目：[https://github.com/PaddlePaddle/Paddle-Lite](https://github.com/PaddlePaddle/Paddle-Lite)。 40 | 41 | 42 | 参考 [Paddle Lite 源码编译文档](https://www.paddlepaddle.org.cn/lite/v2.11/source_compile/compile_env.html)，编译 43 | Android 预测库。 44 | 45 | * 编译最终产物位于 `build.lite.xxx.xxx.xxx` 下的 `inference_lite_lib.xxx.xxx` 46 | * 替换 java 库 47 | * jar 包 48 | 将生成的 `build.lite.android.xxx.gcc/inference_lite_lib.android.xxx/java/jar/PaddlePredictor.jar` 49 | 替换 Demo 中的 `TTSAndroid/app/libs/PaddlePredictor.jar`。 50 | * Java so 51 | * arm64-v8a 52 | 将生成的 `build.lite.android.armv8.gcc/inference_lite_lib.android.armv8/java/so/libpaddle_lite_jni.so` 53 | 库替换 Demo 中的 `TTSAndroid/app/src/main/jniLibs/arm64-v8a/libpaddle_lite_jni.so`。 54 | 55 | ## Demo 内容介绍 56 | 57 | 先整体介绍下目标检测 Demo 的代码结构，然后介绍 Java 各功能模块的功能。 58 | 59 |

60 | image 61 |

62 | 63 | ### 重点关注内容 64 | 65 | 1. `Predictor.java`： 预测代码。 66 | 67 | ```bash 68 | # 位置： 69 | TTSAndroid/app/src/main/java/com/baidu/paddle/lite/demo/tts/Predictor.java 70 | ``` 71 | 72 | 2. `fastspeech2_csmsc_arm.nb` 和 `mb_melgan_csmsc_arm.nb`: 模型文件 (opt 工具转化后 Paddle Lite 模型) 73 | ，分别来自 [fastspeech2_cnndecoder_csmsc_pdlite_1.3.0.zip](https://paddlespeech.bj.bcebos.com/Parakeet/released_models/fastspeech2/fastspeech2_cnndecoder_csmsc_pdlite_1.3.0.zip) 74 | 和 [mb_melgan_csmsc_pdlite_1.3.0.zip](https://paddlespeech.bj.bcebos.com/Parakeet/released_models/mb_melgan/mb_melgan_csmsc_pdlite_1.3.0.zip)。 75 | 76 | ```bash 77 | # 位置： 78 | TTSAndroid/app/src/main/assets/models/cpu/fastspeech2_csmsc_arm.nb 79 | TTSAndroid/app/src/main/assets/models/cpu/mb_melgan_csmsc_arm.nb 80 | ``` 81 | 82 | 3. `libpaddle_lite_jni.so`、`PaddlePredictor.jar`：Paddle Lite Java 预测库与 jar 包。 83 | 84 | ```bash 85 | # 位置 86 | TTSAndroid/app/src/main/jniLibs/arm64-v8a/libpaddle_lite_jni.so 87 | TTSAndroid/app/libs/PaddlePredictor.jar 88 | ``` 89 | 90 | > 如果要替换动态库 so 和 jar 文件，则将新的动态库 so 更新到 `TTSAndroid/app/src/main/jniLibs/arm64-v8a/` 目录下 新的 jar 文件更新到 `TTSAndroid/app/libs/` 目录下 91 | 92 | 4. `build.gradle` : 定义编译过程的 gradle 脚本。（不用改动，定义了自动下载 Paddle Lite 预测和模型的过程） 93 | 94 | ```bash 95 | # 位置 96 | TTSAndroid/app/build.gradle 97 | ``` 98 | 99 | 如果需要手动更新模型和预测库，则可将 gradle 脚本中的 `download*` 接口注释即可, 将新的预测库替换至相应目录下 100 | 101 | ### Java 端 102 | 103 | * 模型存放，将下载好的模型解压存放在 `app/src/assets/models` 目录下。 104 | * TTSAndroid Java 包在 `app/src/main/java/com/baidu/paddle/lite/demo/tts` 目录下，实现 APP 界面消息事件。 105 | * MainActivity 实现 APP 的创建、运行、释放功能，重点关注 `onLoadModel` 和 `onRunModel` 函数，实现 APP 界面值传递和推理处理。 106 | 107 | ```java 108 | public boolean onLoadModel() { 109 | return predictor.init(MainActivity.this, modelPath, AMmodelName, VOCmodelName, cpuThreadNum, 110 | cpuPowerMode); 111 | } 112 | 113 | public boolean onRunModel() { 114 | return predictor.isLoaded() && predictor.runModel(phones); 115 | } 116 | ``` 117 | 118 | * SettingActivity 实现设置界面各个元素的更新与显示如模型地址、线程数、输入 shape 大小等，如果新增/删除界面的某个元素，均在这个类里面实现： 119 | - 参数的默认值可在 `app/src/main/res/values/strings.xml` 查看 120 | - 每个元素的 ID 和 value 是对应 `app/src/main/res/xml/settings.xml` 121 | 和 `app/src/main/res/values/string.xml` 文件中的值 122 | - 这部分内容不建议修改，如果有新增属性，可以按照此格式进行添加 123 | 124 | * Predictor 使用 Java API 实现语音合成模型的预测功能，重点关注 `init`、和 `runModel` 函数，实现 Paddle Lite 端侧推理功能： 125 | ```java 126 | // 初始化函数，完成预测器初始化 127 | public boolean init(Context appCtx, String modelPath, String AMmodelName, String VOCmodelName, int cpuThreadNum, String cpuPowerMode); 128 | // 模型推理函数 129 | public boolean runModel(float[] phones); 130 | ``` 131 | 132 | ## 代码讲解 （使用 Paddle Lite `Java API` 执行预测） 133 | 134 | Android 示例基于 Java API 开发，调用 Paddle Lite `Java API` 包括以下五步。更详细的 `API` 135 | 描述参考：[Paddle Lite Java API ](https://www.paddlepaddle.org.cn/lite/v2.11/api_reference/java_api_doc.html)。 136 | 137 | ## 如何更新模型和输入 138 | 139 | ### 更新模型 140 | 141 | 1. 将优化后的模型存放到目录 `TTSAndroid/app/src/main/assets/models/cpu/` 142 | 下，可任意换成 [released_model.md](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/docs/source/released_model.md) 143 | 中的 `*_pdlite_*.zip/*_arm.nb` 144 | 格式的声学模型和声码器，注意更换声学模型需要对应修改 `TTSAndroid/app/src/main/java/com/baidu/paddle/lite/demo/tts/MainActivity.java` 145 | 中的 `sentencesToChoose` 数组。 146 | 2. 如果模型名字跟工程中模型名字一模一样，即均是使用`fastspeech2_csmsc_arm.nb` （假设声学模型的 `phone_id_map.txt` 147 | 也一样）和 `mb_melgan_csmsc_arm.nb` 148 | ，则代码不需更新；否则，需要修改 `TTSAndroid/app/src/main/java/com/baidu/paddle/lite/demo/tts/MainActivity.java` 149 | 中的 `AMmodelName` 和 `VOCmodelName`： 150 | 151 |

152 | 153 |

154 | 155 | 3. 如果更新模型的输入/输出 Tensor 个数、shape 和 Dtype 156 | 发生更新，需要更新文件 `TTSAndroid/app/src/main/java/com/baidu/paddle/lite/demo/tts/Predictor.java`。 157 | 158 | ### 更新输入 159 | 160 | **本 Demo 不包含文本前端模块**，通过下拉框选择预先设置好的文本，在代码中映射成对应的 phone_id，**如需文本前端模块请自行处理**，`phone_id_map.txt` 161 | 请参考 [fastspeech2_cnndecoder_csmsc_pdlite_1.3.0.zip](https://paddlespeech.bj.bcebos.com/Parakeet/released_models/fastspeech2/fastspeech2_cnndecoder_csmsc_pdlite_1.3.0.zip)。 162 | 163 | ## 通过 setting 界面更新语音合成的相关参数 164 | 165 | ### setting 界面参数介绍 166 | 167 | 可通过 APP 上的 Settings 按钮，实现语音合成 Demo 中参数的更新，目前支持以下参数的更新： 168 | 参数的默认值可在 `app/src/main/res/values/strings.xml` 查看 169 | 170 | - CPU setting： 171 | - power_mode 默认是 `LITE_POWER_HIGH` 172 | - thread_num 默认是 1 173 | 174 | ### setting 界面参数更新 175 | 176 | 1. 打开 APP，点击右上角的 `:` 符合，选择 `Settings..` 选项，打开 setting 界面； 177 | 2. 再将 setting 界面的 Enable custom settings 选中☑️，然后更新部分参数； 178 | 3. 假设更新线程数据，将 CPU Thread Num 设置为 4，更新后，返回原界面，APP 将自动重新加载模型，在下拉框中选择文本会进行合成，合成结束后悔打印 4 线程的耗时和结果 179 | 180 | ## 性能优化方法 181 | 182 | 如果你觉得当前性能不符合需求，想进一步提升模型性能，可参考[性能优化文档](https://github.com/PaddlePaddle/Paddle-Lite-Demo#%E6%80%A7%E8%83%BD%E4%BC%98%E5%8C%96)完成性能优化。 183 | 184 | ## Release 185 | 186 | [2022-11-29-app-release.apk](https://paddlespeech.bj.bcebos.com/demos/TTSAndroid/2022-11-29-app-release.apk) 187 | -------------------------------------------------------------------------------- /app/.gitignore: -------------------------------------------------------------------------------- 1 | /build 2 | -------------------------------------------------------------------------------- /app/build.gradle: -------------------------------------------------------------------------------- 1 | import java.security.MessageDigest 2 | 3 | apply plugin: 'com.android.application' 4 | 5 | android { 6 | compileSdkVersion 28 7 | defaultConfig { 8 | applicationId "com.baidu.paddle.lite.demo.tts" 9 | minSdkVersion 15 10 | targetSdkVersion 28 11 | versionCode 1 12 | versionName "1.0" 13 | testInstrumentationRunner "android.support.test.runner.AndroidJUnitRunner" 14 | } 15 | buildTypes { 16 | release { 17 | minifyEnabled false 18 | proguardFiles getDefaultProguardFile('proguard-android-optimize.txt'), 'proguard-rules.pro' 19 | } 20 | } 21 | } 22 | 23 | dependencies { 24 | implementation fileTree(include: ['*.jar'], dir: 'libs') 25 | implementation 'com.android.support:appcompat-v7:28.0.0' 26 | implementation 'com.android.support.constraint:constraint-layout:1.1.3' 27 | implementation 'com.android.support:design:28.0.0' 28 | testImplementation 'junit:junit:4.12' 29 | androidTestImplementation 'com.android.support.test:runner:1.0.2' 30 | androidTestImplementation 'com.android.support.test.espresso:espresso-core:3.0.2' 31 | implementation files('libs/PaddlePredictor.jar') 32 | } 33 | 34 | def paddleLiteLibs = 'https://paddlespeech.bj.bcebos.com/demos/TTSAndroid/paddle_lite_libs_68b66fd3.tar.gz' 35 | task downloadAndExtractPaddleLiteLibs(type: DefaultTask) { 36 | doFirst { 37 | println "Downloading and extracting Paddle Lite libs" 38 | } 39 | doLast { 40 | // Prepare cache folder for libs 41 | if (!file("cache").exists()) { 42 | mkdir "cache" 43 | } 44 | // Generate cache name for libs 45 | MessageDigest messageDigest = MessageDigest.getInstance('MD5') 46 | messageDigest.update(paddleLiteLibs.bytes) 47 | String cacheName = new BigInteger(1, messageDigest.digest()).toString(32) 48 | // Download libs 49 | if (!file("cache/${cacheName}.tar.gz").exists()) { 50 | ant.get(src: paddleLiteLibs, dest: file("cache/${cacheName}.tar.gz")) 51 | } 52 | // Unpack libs 53 | if (!file("cache/${cacheName}").exists()) { 54 | copy { 55 | from tarTree("cache/${cacheName}.tar.gz") 56 | into "cache/${cacheName}" 57 | } 58 | } 59 | // Copy PaddlePredictor.jar 60 | if (!file("libs/PaddlePredictor.jar").exists()) { 61 | copy { 62 | from "cache/${cacheName}/java/PaddlePredictor.jar" 63 | into "libs" 64 | } 65 | } 66 | if (!file("src/main/jniLibs/arm64-v8a/libpaddle_lite_jni.so").exists()) { 67 | copy { 68 | from "cache/${cacheName}/java/libs/arm64-v8a/" 69 | into "src/main/jniLibs/arm64-v8a" 70 | } 71 | } 72 | } 73 | } 74 | preBuild.dependsOn downloadAndExtractPaddleLiteLibs 75 | 76 | def paddleLiteModels = [['src' : 'https://paddlespeech.bj.bcebos.com/demos/TTSAndroid/fs2cnn_mbmelgan_cpu_v1.3.0.tar.gz', 77 | 'dest': 'src/main/assets/models'],] 78 | task downloadAndExtractPaddleLiteModels(type: DefaultTask) { 79 | doFirst { 80 | println "Downloading and extracting Paddle Lite models" 81 | } 82 | doLast { 83 | // Prepare cache folder for models 84 | String cachePath = "cache" 85 | if (!file("${cachePath}").exists()) { 86 | mkdir "${cachePath}" 87 | } 88 | paddleLiteModels.eachWithIndex { model, index -> 89 | MessageDigest messageDigest = MessageDigest.getInstance('MD5') 90 | messageDigest.update(model.src.bytes) 91 | String cacheName = new BigInteger(1, messageDigest.digest()).toString(32) 92 | // Download the target model if not exists 93 | boolean copyFiles = !file("${model.dest}").exists() 94 | if (!file("${cachePath}/${cacheName}.tar.gz").exists()) { 95 | ant.get(src: model.src, dest: file("${cachePath}/${cacheName}.tar.gz")) 96 | copyFiles = true // force to copy files from the latest archive files 97 | } 98 | // Copy model file 99 | if (copyFiles) { 100 | copy { 101 | from tarTree("${cachePath}/${cacheName}.tar.gz") 102 | into "${model.dest}" 103 | } 104 | } 105 | } 106 | } 107 | } 108 | preBuild.dependsOn downloadAndExtractPaddleLiteModels 109 | -------------------------------------------------------------------------------- /app/proguard-rules.pro: -------------------------------------------------------------------------------- 1 | # Add project specific ProGuard rules here. 2 | # You can control the set of applied configuration files using the 3 | # proguardFiles setting in build.gradle. 4 | # 5 | # For more details, see 6 | # http://developer.android.com/guide/developing/tools/proguard.html 7 | 8 | # If your project uses WebView with JS, uncomment the following 9 | # and specify the fully qualified class name to the JavaScript interface 10 | # class: 11 | #-keepclassmembers class fqcn.of.javascript.interface.for.webview { 12 | # public *; 13 | #} 14 | 15 | # Uncomment this to preserve the line number information for 16 | # debugging stack traces. 17 | #-keepattributes SourceFile,LineNumberTable 18 | 19 | # If you keep the line number information, uncomment this to 20 | # hide the original source file name. 21 | #-renamesourcefileattribute SourceFile 22 | -------------------------------------------------------------------------------- /app/src/androidTest/java/com/baidu/paddle/lite/demo/tts/ExampleInstrumentedTest.java: -------------------------------------------------------------------------------- 1 | package com.baidu.paddle.lite.demo.tts; 2 | 3 | import android.content.Context; 4 | import android.support.test.InstrumentationRegistry; 5 | import android.support.test.runner.AndroidJUnit4; 6 | 7 | import org.junit.Test; 8 | import org.junit.runner.RunWith; 9 | 10 | import static org.junit.Assert.*; 11 | 12 | /** 13 | * Instrumented test, which will execute on an Android device. 14 | * 15 | * @see Testing documentation 16 | */ 17 | @RunWith(AndroidJUnit4.class) 18 | public class ExampleInstrumentedTest { 19 | @Test 20 | public void useAppContext() { 21 | // Context of the app under test. 22 | Context appContext = InstrumentationRegistry.getTargetContext(); 23 | 24 | assertEquals("com.baidu.paddle.lite.demo", appContext.getPackageName()); 25 | } 26 | } 27 | -------------------------------------------------------------------------------- /app/src/main/AndroidManifest.xml: -------------------------------------------------------------------------------- 1 | 2 | 4 | 5 | 6 | 7 | 8 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 25 | 26 | 27 | -------------------------------------------------------------------------------- /app/src/main/java/com/baidu/paddle/lite/demo/tts/AppCompatPreferenceActivity.java: -------------------------------------------------------------------------------- 1 | /* 2 | * Copyright (C) 2014 The Android Open Source Project 3 | * 4 | * Licensed under the Apache License, Version 2.0 (the "License"); 5 | * you may not use this file except in compliance with the License. 6 | * You may obtain a copy of the License at 7 | * 8 | * http://www.apache.org/licenses/LICENSE-2.0 9 | * 10 | * Unless required by applicable law or agreed to in writing, software 11 | * distributed under the License is distributed on an "AS IS" BASIS, 12 | * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 13 | * See the License for the specific language governing permissions and 14 | * limitations under the License. 15 | */ 16 | 17 | package com.baidu.paddle.lite.demo.tts; 18 | 19 | import android.content.res.Configuration; 20 | import android.os.Bundle; 21 | import android.preference.PreferenceActivity; 22 | import android.support.annotation.LayoutRes; 23 | import android.support.v7.app.ActionBar; 24 | import android.support.v7.app.AppCompatDelegate; 25 | import android.view.MenuInflater; 26 | import android.view.View; 27 | import android.view.ViewGroup; 28 | 29 | /** 30 | * A {@link android.preference.PreferenceActivity} which implements and proxies the necessary calls 31 | * to be used with AppCompat. 32 | *

33 | * This technique can be used with an {@link android.app.Activity} class, not just 34 | * {@link android.preference.PreferenceActivity}. 35 | */ 36 | public abstract class AppCompatPreferenceActivity extends PreferenceActivity { 37 | private AppCompatDelegate mDelegate; 38 | 39 | @Override 40 | protected void onCreate(Bundle savedInstanceState) { 41 | getDelegate().installViewFactory(); 42 | getDelegate().onCreate(savedInstanceState); 43 | super.onCreate(savedInstanceState); 44 | } 45 | 46 | @Override 47 | protected void onPostCreate(Bundle savedInstanceState) { 48 | super.onPostCreate(savedInstanceState); 49 | getDelegate().onPostCreate(savedInstanceState); 50 | } 51 | 52 | public ActionBar getSupportActionBar() { 53 | return getDelegate().getSupportActionBar(); 54 | } 55 | 56 | 57 | @Override 58 | public MenuInflater getMenuInflater() { 59 | return getDelegate().getMenuInflater(); 60 | } 61 | 62 | @Override 63 | public void setContentView(@LayoutRes int layoutResID) { 64 | getDelegate().setContentView(layoutResID); 65 | } 66 | 67 | @Override 68 | public void setContentView(View view) { 69 | getDelegate().setContentView(view); 70 | } 71 | 72 | @Override 73 | public void setContentView(View view, ViewGroup.LayoutParams params) { 74 | getDelegate().setContentView(view, params); 75 | } 76 | 77 | @Override 78 | public void addContentView(View view, ViewGroup.LayoutParams params) { 79 | getDelegate().addContentView(view, params); 80 | } 81 | 82 | @Override 83 | protected void onPostResume() { 84 | super.onPostResume(); 85 | getDelegate().onPostResume(); 86 | } 87 | 88 | @Override 89 | protected void onTitleChanged(CharSequence title, int color) { 90 | super.onTitleChanged(title, color); 91 | getDelegate().setTitle(title); 92 | } 93 | 94 | @Override 95 | public void onConfigurationChanged(Configuration newConfig) { 96 | super.onConfigurationChanged(newConfig); 97 | getDelegate().onConfigurationChanged(newConfig); 98 | } 99 | 100 | @Override 101 | protected void onStop() { 102 | super.onStop(); 103 | getDelegate().onStop(); 104 | } 105 | 106 | @Override 107 | protected void onDestroy() { 108 | super.onDestroy(); 109 | getDelegate().onDestroy(); 110 | } 111 | 112 | public void invalidateOptionsMenu() { 113 | getDelegate().invalidateOptionsMenu(); 114 | } 115 | 116 | private AppCompatDelegate getDelegate() { 117 | if (mDelegate == null) { 118 | mDelegate = AppCompatDelegate.create(this, null); 119 | } 120 | return mDelegate; 121 | } 122 | } 123 | -------------------------------------------------------------------------------- /app/src/main/java/com/baidu/paddle/lite/demo/tts/MainActivity.java: -------------------------------------------------------------------------------- 1 | package com.baidu.paddle.lite.demo.tts; 2 | 3 | import android.Manifest; 4 | import android.app.ProgressDialog; 5 | import android.content.Intent; 6 | import android.content.SharedPreferences; 7 | import android.content.pm.PackageManager; 8 | import android.media.MediaPlayer; 9 | import android.os.Bundle; 10 | import android.os.Environment; 11 | import android.os.Handler; 12 | import android.os.HandlerThread; 13 | import android.os.Message; 14 | import android.preference.PreferenceManager; 15 | import android.support.annotation.NonNull; 16 | import android.support.v4.app.ActivityCompat; 17 | import android.support.v4.content.ContextCompat; 18 | import android.support.v7.app.AppCompatActivity; 19 | import android.text.method.ScrollingMovementMethod; 20 | import android.util.Log; 21 | import android.view.Menu; 22 | import android.view.MenuInflater; 23 | import android.view.MenuItem; 24 | import android.view.View; 25 | import android.widget.AdapterView; 26 | import android.widget.ArrayAdapter; 27 | import android.widget.Button; 28 | import android.widget.Spinner; 29 | import android.widget.TextView; 30 | import android.widget.Toast; 31 | 32 | import java.io.File; 33 | import java.io.IOException; 34 | 35 | public class MainActivity extends AppCompatActivity implements View.OnClickListener, MediaPlayer.OnPreparedListener, MediaPlayer.OnErrorListener, AdapterView.OnItemSelectedListener { 36 | public static final int REQUEST_LOAD_MODEL = 0; 37 | public static final int REQUEST_RUN_MODEL = 1; 38 | public static final int RESPONSE_LOAD_MODEL_SUCCESSED = 0; 39 | public static final int RESPONSE_LOAD_MODEL_FAILED = 1; 40 | public static final int RESPONSE_RUN_MODEL_SUCCESSED = 2; 41 | public static final int RESPONSE_RUN_MODEL_FAILED = 3; 42 | public MediaPlayer mediaPlayer = new MediaPlayer(); 43 | private static final String TAG = Predictor.class.getSimpleName(); 44 | protected ProgressDialog pbLoadModel = null; 45 | protected ProgressDialog pbRunModel = null; 46 | // Receive messages from worker thread 47 | protected Handler receiver = null; 48 | // Send command to worker thread 49 | protected Handler sender = null; 50 | // Worker thread to load&run model 51 | protected HandlerThread worker = null; 52 | // UI components of image classification 53 | protected TextView tvInputSetting; 54 | protected TextView tvInferenceTime; 55 | protected Button btn_play; 56 | protected Button btn_pause; 57 | protected Button btn_stop; 58 | // Model settings of image classification 59 | protected String modelPath = ""; 60 | protected int cpuThreadNum = 1; 61 | protected String cpuPowerMode = ""; 62 | protected Predictor predictor = new Predictor(); 63 | int sampleRate = 24000; 64 | private final String wavName = "tts_output.wav"; 65 | private final String wavFile = Environment.getExternalStorageDirectory() + File.separator + wavName; 66 | private final String AMmodelName = "fastspeech2_csmsc_arm.nb"; 67 | private final String VOCmodelName = "mb_melgan_csmsc_arm.nb"; 68 | private float[] phones = {}; 69 | private final float[][] sentencesToChoose = { 70 | // 009901 昨日，这名“伤者”与医生全部被警方依法刑事拘留。 71 | {261, 231, 175, 116, 179, 262, 44, 154, 126, 177, 19, 262, 42, 241, 72, 177, 56, 174, 245, 37, 186, 37, 49, 151, 127, 69, 19, 179, 72, 69, 4, 260, 126, 177, 116, 151, 239, 153, 141}, 72 | // 009902 钱伟长想到上海来办学校是经过深思熟虑的。 73 | {174, 83, 213, 39, 20, 260, 89, 40, 30, 177, 22, 71, 9, 153, 8, 37, 17, 260, 251, 260, 99, 179, 177, 116, 151, 125, 70, 233, 177, 51, 176, 108, 177, 184, 153, 242, 40, 45}, 74 | // 009903 她见我一进门就骂，吃饭时也骂，骂得我抬不起头。 75 | {182, 2, 151, 85, 232, 73, 151, 123, 154, 52, 151, 143, 154, 5, 179, 39, 113, 69, 17, 177, 114, 105, 154, 5, 179, 154, 5, 40, 45, 232, 182, 8, 37, 186, 174, 74, 182, 168}, 76 | // 009904 李述德在离开之前，只说了一句“柱驼杀父亲了”。 77 | {153, 74, 177, 186, 40, 42, 261, 10, 153, 73, 152, 7, 262, 113, 174, 83, 179, 262, 115, 177, 230, 153, 45, 73, 151, 242, 180, 262, 186, 182, 231, 177, 2, 69, 186, 174, 124, 153, 45}, 78 | // 009905 这种车票和保险单捆绑出售属于重复性购买。 79 | {262, 44, 262, 163, 39, 41, 173, 99, 71, 42, 37, 28, 260, 84, 40, 14, 179, 152, 220, 37, 21, 39, 183, 177, 170, 179, 177, 185, 240, 39, 162, 69, 186, 260, 128, 70, 170, 154, 9}, 80 | // 009906 戴佩妮的男友西米露接唱情歌，让她非常开心。 81 | {40, 10, 173, 49, 155, 72, 40, 45, 155, 15, 142, 260, 72, 154, 74, 153, 186, 179, 151, 103, 39, 22, 174, 126, 70, 41, 179, 175, 22, 182, 2, 69, 46, 39, 20, 152, 7, 260, 120}, 82 | // 009907 观大势、谋大局、出大策始终是该院的办院方针。 83 | {70, 199, 40, 5, 177, 116, 154, 168, 40, 5, 151, 240, 179, 39, 183, 40, 5, 38, 44, 179, 177, 115, 262, 161, 177, 116, 70, 7, 247, 40, 45, 37, 17, 247, 69, 19, 262, 51}, 84 | // 009908 他们骑着摩托回家，正好为农忙时的父母帮忙。 85 | {182, 2, 154, 55, 174, 73, 262, 45, 154, 157, 182, 230, 71, 212, 151, 77, 180, 262, 59, 71, 29, 214, 155, 162, 154, 20, 177, 114, 40, 45, 69, 186, 154, 185, 37, 19, 154, 20}, 86 | // 009909 但是因为还没到退休年龄，只能掰着指头捱日子。 87 | {40, 17, 177, 116, 120, 214, 71, 8, 154, 47, 40, 30, 182, 214, 260, 140, 155, 83, 153, 126, 180, 262, 115, 155, 57, 37, 7, 262, 45, 262, 115, 182, 171, 8, 175, 116, 261, 112}, 88 | // 009910 这几天雨水不断，人们恨不得待在家里不出门。 89 | {262, 44, 151, 74, 182, 82, 240, 177, 213, 37, 184, 40, 202, 180, 175, 52, 154, 55, 71, 54, 37, 186, 40, 42, 40, 7, 261, 10, 151, 77, 153, 74, 37, 186, 39, 183, 154, 52} 90 | 91 | }; 92 | 93 | @Override 94 | public void onClick(View v) { 95 | switch (v.getId()) { 96 | case R.id.btn_play: 97 | if (!mediaPlayer.isPlaying()) { 98 | mediaPlayer.start(); 99 | } 100 | break; 101 | case R.id.btn_pause: 102 | if (mediaPlayer.isPlaying()) { 103 | mediaPlayer.pause(); 104 | } 105 | break; 106 | case R.id.btn_stop: 107 | if (mediaPlayer.isPlaying()) { 108 | mediaPlayer.reset(); 109 | initMediaPlayer(); 110 | } 111 | break; 112 | default: 113 | break; 114 | } 115 | } 116 | 117 | private void initMediaPlayer() { 118 | try { 119 | File file = new File(wavFile); 120 | // 指定音频文件的路径 121 | mediaPlayer.setDataSource(file.getPath()); 122 | // 让 MediaPlayer 进入到准备状态 123 | mediaPlayer.prepare(); 124 | // 该方法使得进入应用时就播放音频 125 | // mediaPlayer.setOnPreparedListener(this); 126 | // prepare async to not block main thread 127 | mediaPlayer.prepareAsync(); 128 | } catch (Exception e) { 129 | e.printStackTrace(); 130 | } 131 | } 132 | 133 | @Override 134 | public void onPrepared(MediaPlayer player) { 135 | player.start(); 136 | } 137 | 138 | @Override 139 | public boolean onError(MediaPlayer mp, int what, int extra) { 140 | // The MediaPlayer has moved to the Error state, must be reset! 141 | mediaPlayer.reset(); 142 | initMediaPlayer(); 143 | return true; 144 | } 145 | 146 | @Override 147 | protected void onCreate(Bundle savedInstanceState) { 148 | requestAllPermissions(); 149 | super.onCreate(savedInstanceState); 150 | setContentView(R.layout.activity_main); 151 | 152 | // 初始化控件 153 | Spinner spinner = findViewById(R.id.spinner1); 154 | // 建立数据源 155 | String[] sentences = getResources().getStringArray(R.array.text); 156 | // 建立 Adapter 并且绑定数据源 157 | ArrayAdapter adapter = new ArrayAdapter(this, android.R.layout.simple_spinner_dropdown_item, sentences); 158 | // 第一个参数表示在哪个 Activity 上显示，第二个参数是系统下拉框的样式，第三个参数是数组。 159 | spinner.setAdapter(adapter);//绑定Adapter到控件 160 | spinner.setOnItemSelectedListener(this); 161 | 162 | btn_play = findViewById(R.id.btn_play); 163 | btn_pause = findViewById(R.id.btn_pause); 164 | btn_stop = findViewById(R.id.btn_stop); 165 | 166 | btn_play.setOnClickListener(this); 167 | btn_pause.setOnClickListener(this); 168 | btn_stop.setOnClickListener(this); 169 | 170 | btn_play.setVisibility(View.INVISIBLE); 171 | btn_pause.setVisibility(View.INVISIBLE); 172 | btn_stop.setVisibility(View.INVISIBLE); 173 | 174 | 175 | // Clear all setting items to avoid app crashing due to the incorrect settings 176 | SharedPreferences sharedPreferences = PreferenceManager.getDefaultSharedPreferences(this); 177 | SharedPreferences.Editor editor = sharedPreferences.edit(); 178 | editor.clear(); 179 | editor.commit(); 180 | 181 | // Prepare the worker thread for mode loading and inference 182 | receiver = new Handler() { 183 | @Override 184 | public void handleMessage(Message msg) { 185 | switch (msg.what) { 186 | case RESPONSE_LOAD_MODEL_SUCCESSED: 187 | pbLoadModel.dismiss(); 188 | onLoadModelSuccessed(); 189 | break; 190 | case RESPONSE_LOAD_MODEL_FAILED: 191 | pbLoadModel.dismiss(); 192 | Toast.makeText(MainActivity.this, "Load model failed!", Toast.LENGTH_SHORT).show(); 193 | onLoadModelFailed(); 194 | break; 195 | case RESPONSE_RUN_MODEL_SUCCESSED: 196 | pbRunModel.dismiss(); 197 | onRunModelSuccessed(); 198 | break; 199 | case RESPONSE_RUN_MODEL_FAILED: 200 | pbRunModel.dismiss(); 201 | Toast.makeText(MainActivity.this, "Run model failed!", Toast.LENGTH_SHORT).show(); 202 | onRunModelFailed(); 203 | break; 204 | default: 205 | break; 206 | } 207 | } 208 | }; 209 | 210 | worker = new HandlerThread("Predictor Worker"); 211 | worker.start(); 212 | sender = new Handler(worker.getLooper()) { 213 | public void handleMessage(Message msg) { 214 | switch (msg.what) { 215 | case REQUEST_LOAD_MODEL: 216 | // Load model and reload test image 217 | if (onLoadModel()) { 218 | receiver.sendEmptyMessage(RESPONSE_LOAD_MODEL_SUCCESSED); 219 | } else { 220 | receiver.sendEmptyMessage(RESPONSE_LOAD_MODEL_FAILED); 221 | } 222 | break; 223 | case REQUEST_RUN_MODEL: 224 | // Run model if model is loaded 225 | if (onRunModel()) { 226 | receiver.sendEmptyMessage(RESPONSE_RUN_MODEL_SUCCESSED); 227 | } else { 228 | receiver.sendEmptyMessage(RESPONSE_RUN_MODEL_FAILED); 229 | } 230 | break; 231 | default: 232 | break; 233 | } 234 | } 235 | }; 236 | 237 | // Setup the UI components 238 | tvInputSetting = findViewById(R.id.tv_input_setting); 239 | tvInferenceTime = findViewById(R.id.tv_inference_time); 240 | tvInputSetting.setMovementMethod(ScrollingMovementMethod.getInstance()); 241 | } 242 | 243 | @Override 244 | protected void onResume() { 245 | super.onResume(); 246 | boolean settingsChanged = false; 247 | SharedPreferences sharedPreferences = PreferenceManager.getDefaultSharedPreferences(this); 248 | String model_path = sharedPreferences.getString(getString(R.string.MODEL_PATH_KEY), 249 | getString(R.string.MODEL_PATH_DEFAULT)); 250 | 251 | settingsChanged |= !model_path.equalsIgnoreCase(modelPath); 252 | 253 | int cpu_thread_num = Integer.parseInt(sharedPreferences.getString(getString(R.string.CPU_THREAD_NUM_KEY), 254 | getString(R.string.CPU_THREAD_NUM_DEFAULT))); 255 | settingsChanged |= cpu_thread_num != cpuThreadNum; 256 | String cpu_power_mode = 257 | sharedPreferences.getString(getString(R.string.CPU_POWER_MODE_KEY), 258 | getString(R.string.CPU_POWER_MODE_DEFAULT)); 259 | settingsChanged |= !cpu_power_mode.equalsIgnoreCase(cpuPowerMode); 260 | 261 | if (settingsChanged) { 262 | modelPath = model_path; 263 | cpuThreadNum = cpu_thread_num; 264 | cpuPowerMode = cpu_power_mode; 265 | // Update UI 266 | tvInputSetting.setText("Model: " + modelPath.substring(modelPath.lastIndexOf("/") + 1) + "\n" + "CPU" + 267 | " Thread Num: " + cpuThreadNum + "\n" + "CPU Power Mode: " + cpuPowerMode + "\n"); 268 | tvInputSetting.scrollTo(0, 0); 269 | // Reload model if configure has been changed 270 | loadModel(); 271 | } 272 | } 273 | 274 | public void loadModel() { 275 | pbLoadModel = ProgressDialog.show(this, "", "Loading model...", false, false); 276 | sender.sendEmptyMessage(REQUEST_LOAD_MODEL); 277 | } 278 | 279 | public void runModel() { 280 | pbRunModel = ProgressDialog.show(this, "", "Running model...", false, false); 281 | sender.sendEmptyMessage(REQUEST_RUN_MODEL); 282 | } 283 | 284 | public boolean onLoadModel() { 285 | return predictor.init(MainActivity.this, modelPath, AMmodelName, VOCmodelName, cpuThreadNum, 286 | cpuPowerMode); 287 | } 288 | 289 | public boolean onRunModel() { 290 | return predictor.isLoaded() && predictor.runModel(phones); 291 | } 292 | 293 | public boolean onLoadModelSuccessed() { 294 | // Load test image from path and run model 295 | // runModel(); 296 | return true; 297 | } 298 | 299 | public void onLoadModelFailed() { 300 | } 301 | 302 | public void onRunModelSuccessed() { 303 | // Obtain results and update UI 304 | btn_play.setVisibility(View.VISIBLE); 305 | btn_pause.setVisibility(View.VISIBLE); 306 | btn_stop.setVisibility(View.VISIBLE); 307 | tvInferenceTime.setText("Inference done！\nInference time: " + predictor.inferenceTime() + " ms" 308 | + "\nRTF: " + predictor.inferenceTime() * sampleRate / (predictor.wav.length * 1000) + "\nAudio saved in " + wavFile); 309 | try { 310 | Utils.rawToWave(wavFile, predictor.wav, sampleRate); 311 | } catch (IOException e) { 312 | e.printStackTrace(); 313 | } 314 | if (ContextCompat.checkSelfPermission(MainActivity.this, 315 | Manifest.permission.WRITE_EXTERNAL_STORAGE) != PackageManager.PERMISSION_GRANTED) { 316 | ActivityCompat.requestPermissions(MainActivity.this, new String[]{Manifest.permission.WRITE_EXTERNAL_STORAGE}, 1); 317 | } else { 318 | // 初始化 MediaPlayer 319 | initMediaPlayer(); 320 | } 321 | } 322 | 323 | public void onRunModelFailed() { 324 | } 325 | 326 | 327 | public void onSettingsClicked() { 328 | startActivity(new Intent(MainActivity.this, SettingsActivity.class)); 329 | } 330 | 331 | @Override 332 | public boolean onCreateOptionsMenu(Menu menu) { 333 | MenuInflater inflater = getMenuInflater(); 334 | inflater.inflate(R.menu.menu_action_options, menu); 335 | return true; 336 | } 337 | 338 | @Override 339 | public boolean onOptionsItemSelected(MenuItem item) { 340 | switch (item.getItemId()) { 341 | case android.R.id.home: 342 | finish(); 343 | break; 344 | case R.id.settings: 345 | onSettingsClicked(); 346 | } 347 | return super.onOptionsItemSelected(item); 348 | } 349 | 350 | @Override 351 | public void onRequestPermissionsResult(int requestCode, @NonNull String[] permissions, 352 | @NonNull int[] grantResults) { 353 | 354 | super.onRequestPermissionsResult(requestCode, permissions, grantResults); 355 | if (grantResults[0] != PackageManager.PERMISSION_GRANTED) { 356 | Toast.makeText(this, "Permission Denied", Toast.LENGTH_SHORT).show(); 357 | } 358 | } 359 | 360 | 361 | @Override 362 | protected void onDestroy() { 363 | if (predictor != null) { 364 | predictor.releaseModel(); 365 | } 366 | worker.quit(); 367 | super.onDestroy(); 368 | if (mediaPlayer != null) { 369 | mediaPlayer.stop(); 370 | mediaPlayer.release(); 371 | } 372 | } 373 | 374 | private boolean requestAllPermissions() { 375 | if (ContextCompat.checkSelfPermission(this, Manifest.permission.WRITE_EXTERNAL_STORAGE) 376 | != PackageManager.PERMISSION_GRANTED || ContextCompat.checkSelfPermission(this, 377 | Manifest.permission.CAMERA) 378 | != PackageManager.PERMISSION_GRANTED) { 379 | ActivityCompat.requestPermissions(this, new String[]{Manifest.permission.WRITE_EXTERNAL_STORAGE}, 380 | 0); 381 | return false; 382 | } 383 | return true; 384 | } 385 | 386 | 387 | @Override 388 | public void onItemSelected(AdapterView parent, View view, int position, long id) { 389 | if (position > 0) { 390 | phones = sentencesToChoose[position - 1]; 391 | runModel(); 392 | } 393 | 394 | } 395 | 396 | @Override 397 | public void onNothingSelected(AdapterView parent) { 398 | 399 | } 400 | } 401 | -------------------------------------------------------------------------------- /app/src/main/java/com/baidu/paddle/lite/demo/tts/Predictor.java: -------------------------------------------------------------------------------- 1 | package com.baidu.paddle.lite.demo.tts; 2 | 3 | import android.content.Context; 4 | import android.util.Log; 5 | 6 | import com.baidu.paddle.lite.MobileConfig; 7 | import com.baidu.paddle.lite.PaddlePredictor; 8 | import com.baidu.paddle.lite.PowerMode; 9 | import com.baidu.paddle.lite.Tensor; 10 | 11 | import java.io.File; 12 | import java.util.Date; 13 | 14 | 15 | public class Predictor { 16 | private static final String TAG = Predictor.class.getSimpleName(); 17 | public boolean isLoaded = false; 18 | public int cpuThreadNum = 1; 19 | public String cpuPowerMode = "LITE_POWER_HIGH"; 20 | public String modelPath = ""; 21 | protected PaddlePredictor AMPredictor = null; 22 | protected PaddlePredictor VOCPredictor = null; 23 | protected float inferenceTime = 0; 24 | protected float[] wav; 25 | 26 | public boolean init(Context appCtx, String modelPath, String AMmodelName, String VOCmodelName, int cpuThreadNum, String cpuPowerMode) { 27 | // Release model if exists 28 | releaseModel(); 29 | 30 | AMPredictor = loadModel(appCtx, modelPath, AMmodelName, cpuThreadNum, cpuPowerMode); 31 | if (AMPredictor == null) { 32 | return false; 33 | } 34 | VOCPredictor = loadModel(appCtx, modelPath, VOCmodelName, cpuThreadNum, cpuPowerMode); 35 | if (VOCPredictor == null) { 36 | return false; 37 | } 38 | isLoaded = true; 39 | return true; 40 | } 41 | 42 | protected PaddlePredictor loadModel(Context appCtx, String modelPath, String modelName, int cpuThreadNum, String cpuPowerMode) { 43 | // Load model 44 | if (modelPath.isEmpty()) { 45 | return null; 46 | } 47 | String realPath = modelPath; 48 | if (modelPath.charAt(0) != '/') { 49 | // Read model files from custom path if the first character of mode path is '/' 50 | // otherwise copy model to cache from assets 51 | realPath = appCtx.getCacheDir() + "/" + modelPath; 52 | // push model to mobile 53 | Utils.copyDirectoryFromAssets(appCtx, modelPath, realPath); 54 | } 55 | if (realPath.isEmpty()) { 56 | return null; 57 | } 58 | MobileConfig config = new MobileConfig(); 59 | config.setModelFromFile(realPath + File.separator + modelName); 60 | Log.e(TAG, "File:" + realPath + File.separator + modelName); 61 | config.setThreads(cpuThreadNum); 62 | if (cpuPowerMode.equalsIgnoreCase("LITE_POWER_HIGH")) { 63 | config.setPowerMode(PowerMode.LITE_POWER_HIGH); 64 | } else if (cpuPowerMode.equalsIgnoreCase("LITE_POWER_LOW")) { 65 | config.setPowerMode(PowerMode.LITE_POWER_LOW); 66 | } else if (cpuPowerMode.equalsIgnoreCase("LITE_POWER_FULL")) { 67 | config.setPowerMode(PowerMode.LITE_POWER_FULL); 68 | } else if (cpuPowerMode.equalsIgnoreCase("LITE_POWER_NO_BIND")) { 69 | config.setPowerMode(PowerMode.LITE_POWER_NO_BIND); 70 | } else if (cpuPowerMode.equalsIgnoreCase("LITE_POWER_RAND_HIGH")) { 71 | config.setPowerMode(PowerMode.LITE_POWER_RAND_HIGH); 72 | } else if (cpuPowerMode.equalsIgnoreCase("LITE_POWER_RAND_LOW")) { 73 | config.setPowerMode(PowerMode.LITE_POWER_RAND_LOW); 74 | } else { 75 | Log.e(TAG, "Unknown cpu power mode!"); 76 | return null; 77 | } 78 | return PaddlePredictor.createPaddlePredictor(config); 79 | } 80 | 81 | public void releaseModel() { 82 | AMPredictor = null; 83 | VOCPredictor = null; 84 | isLoaded = false; 85 | cpuThreadNum = 1; 86 | cpuPowerMode = "LITE_POWER_HIGH"; 87 | modelPath = ""; 88 | } 89 | 90 | public boolean runModel(float[] phones) { 91 | if (!isLoaded()) { 92 | return false; 93 | } 94 | Date start = new Date(); 95 | Tensor am_output_handle = getAMOutput(phones, AMPredictor); 96 | wav = getVOCOutput(am_output_handle, VOCPredictor); 97 | Date end = new Date(); 98 | inferenceTime = (end.getTime() - start.getTime()); 99 | return true; 100 | } 101 | 102 | public Tensor getAMOutput(float[] phones, PaddlePredictor am_predictor) { 103 | Tensor phones_handle = am_predictor.getInput(0); 104 | long[] dims = {phones.length}; 105 | phones_handle.resize(dims); 106 | phones_handle.setData(phones); 107 | am_predictor.run(); 108 | Tensor am_output_handle = am_predictor.getOutput(0); 109 | // [?, 80] 110 | // long outputShape[] = am_output_handle.shape(); 111 | float[] am_output_data = am_output_handle.getFloatData(); 112 | // [? x 80] 113 | // long[] am_output_data_shape = {am_output_data.length}; 114 | // Log.e(TAG, Arrays.toString(am_output_data)); 115 | // 打印 mel 数组 116 | // for (int i=0;i preInstalledModelPaths = null; 21 | List preInstalledCPUThreadNums = null; 22 | List preInstalledCPUPowerModes = null; 23 | 24 | 25 | @Override 26 | public void onCreate(Bundle savedInstanceState) { 27 | super.onCreate(savedInstanceState); 28 | addPreferencesFromResource(R.xml.settings); 29 | ActionBar supportActionBar = getSupportActionBar(); 30 | if (supportActionBar != null) { 31 | supportActionBar.setDisplayHomeAsUpEnabled(true); 32 | } 33 | 34 | // Initialized pre-installed models 35 | preInstalledModelPaths = new ArrayList(); 36 | preInstalledCPUThreadNums = new ArrayList(); 37 | preInstalledCPUPowerModes = new ArrayList(); 38 | preInstalledModelPaths.add(getString(R.string.MODEL_PATH_DEFAULT)); 39 | preInstalledCPUThreadNums.add(getString(R.string.CPU_THREAD_NUM_DEFAULT)); 40 | preInstalledCPUPowerModes.add(getString(R.string.CPU_POWER_MODE_DEFAULT)); 41 | 42 | 43 | // Setup UI components 44 | lpChoosePreInstalledModel = (ListPreference) findPreference(getString(R.string.CHOOSE_PRE_INSTALLED_MODEL_KEY)); 45 | String[] preInstalledModelNames = new String[preInstalledModelPaths.size()]; 46 | for (int i = 0; i < preInstalledModelPaths.size(); i++) { 47 | preInstalledModelNames[i] = preInstalledModelPaths.get(i).substring(preInstalledModelPaths.get(i).lastIndexOf("/") + 1); 48 | } 49 | lpChoosePreInstalledModel.setEntries(preInstalledModelNames); 50 | lpChoosePreInstalledModel.setEntryValues(preInstalledModelPaths.toArray(new String[preInstalledModelPaths.size()])); 51 | lpCPUThreadNum = (ListPreference) findPreference(getString(R.string.CPU_THREAD_NUM_KEY)); 52 | lpCPUPowerMode = (ListPreference) findPreference(getString(R.string.CPU_POWER_MODE_KEY)); 53 | cbEnableCustomSettings = (CheckBoxPreference) findPreference(getString(R.string.ENABLE_CUSTOM_SETTINGS_KEY)); 54 | etModelPath = (EditTextPreference) findPreference(getString(R.string.MODEL_PATH_KEY)); 55 | etModelPath.setTitle("Model Path (SDCard: " + Utils.getSDCardDirectory() + ")"); 56 | } 57 | 58 | private void reloadPreferenceAndUpdateUI() { 59 | SharedPreferences sharedPreferences = getPreferenceScreen().getSharedPreferences(); 60 | boolean enableCustomSettings = sharedPreferences.getBoolean(getString(R.string.ENABLE_CUSTOM_SETTINGS_KEY), false); 61 | String modelPath = sharedPreferences.getString(getString(R.string.CHOOSE_PRE_INSTALLED_MODEL_KEY), getString(R.string.MODEL_PATH_DEFAULT)); 62 | int modelIdx = lpChoosePreInstalledModel.findIndexOfValue(modelPath); 63 | if (modelIdx >= 0 && modelIdx < preInstalledModelPaths.size()) { 64 | if (!enableCustomSettings) { 65 | SharedPreferences.Editor editor = sharedPreferences.edit(); 66 | editor.putString(getString(R.string.MODEL_PATH_KEY), preInstalledModelPaths.get(modelIdx)); 67 | editor.putString(getString(R.string.CPU_THREAD_NUM_KEY), preInstalledCPUThreadNums.get(modelIdx)); 68 | editor.putString(getString(R.string.CPU_POWER_MODE_KEY), preInstalledCPUPowerModes.get(modelIdx)); 69 | editor.commit(); 70 | } 71 | lpChoosePreInstalledModel.setSummary(modelPath); 72 | } 73 | cbEnableCustomSettings.setChecked(enableCustomSettings); 74 | etModelPath.setEnabled(enableCustomSettings); 75 | lpCPUThreadNum.setEnabled(enableCustomSettings); 76 | lpCPUPowerMode.setEnabled(enableCustomSettings); 77 | modelPath = sharedPreferences.getString(getString(R.string.MODEL_PATH_KEY), getString(R.string.MODEL_PATH_DEFAULT)); 78 | String cpuThreadNum = sharedPreferences.getString(getString(R.string.CPU_THREAD_NUM_KEY), getString(R.string.CPU_THREAD_NUM_DEFAULT)); 79 | String cpuPowerMode = sharedPreferences.getString(getString(R.string.CPU_POWER_MODE_KEY), getString(R.string.CPU_POWER_MODE_DEFAULT)); 80 | 81 | etModelPath.setSummary(modelPath); 82 | etModelPath.setText(modelPath); 83 | lpCPUThreadNum.setValue(cpuThreadNum); 84 | lpCPUThreadNum.setSummary(cpuThreadNum); 85 | lpCPUPowerMode.setValue(cpuPowerMode); 86 | lpCPUPowerMode.setSummary(cpuPowerMode); 87 | } 88 | 89 | @Override 90 | protected void onResume() { 91 | super.onResume(); 92 | getPreferenceScreen().getSharedPreferences().registerOnSharedPreferenceChangeListener(this); 93 | reloadPreferenceAndUpdateUI(); 94 | } 95 | 96 | @Override 97 | protected void onPause() { 98 | super.onPause(); 99 | getPreferenceScreen().getSharedPreferences().unregisterOnSharedPreferenceChangeListener(this); 100 | } 101 | 102 | @Override 103 | public void onSharedPreferenceChanged(SharedPreferences sharedPreferences, String key) { 104 | if (key.equals(getString(R.string.CHOOSE_PRE_INSTALLED_MODEL_KEY))) { 105 | SharedPreferences.Editor editor = sharedPreferences.edit(); 106 | editor.putBoolean(getString(R.string.ENABLE_CUSTOM_SETTINGS_KEY), false); 107 | editor.commit(); 108 | } 109 | reloadPreferenceAndUpdateUI(); 110 | } 111 | } 112 | -------------------------------------------------------------------------------- /app/src/main/java/com/baidu/paddle/lite/demo/tts/Utils.java: -------------------------------------------------------------------------------- 1 | package com.baidu.paddle.lite.demo.tts; 2 | 3 | import static java.lang.Math.abs; 4 | 5 | import android.content.Context; 6 | import android.os.Environment; 7 | 8 | import java.io.BufferedInputStream; 9 | import java.io.BufferedOutputStream; 10 | import java.io.DataOutputStream; 11 | import java.io.File; 12 | import java.io.FileNotFoundException; 13 | import java.io.FileOutputStream; 14 | import java.io.IOException; 15 | import java.io.InputStream; 16 | import java.io.OutputStream; 17 | 18 | public class Utils { 19 | public static void copyFileFromAssets(Context appCtx, String srcPath, String dstPath) { 20 | if (srcPath.isEmpty() || dstPath.isEmpty()) { 21 | return; 22 | } 23 | InputStream is = null; 24 | OutputStream os = null; 25 | try { 26 | is = new BufferedInputStream(appCtx.getAssets().open(srcPath)); 27 | os = new BufferedOutputStream(new FileOutputStream(new File(dstPath))); 28 | byte[] buffer = new byte[1024]; 29 | int length = 0; 30 | while ((length = is.read(buffer)) != -1) { 31 | os.write(buffer, 0, length); 32 | } 33 | } catch (FileNotFoundException e) { 34 | e.printStackTrace(); 35 | } catch (IOException e) { 36 | e.printStackTrace(); 37 | } finally { 38 | try { 39 | os.close(); 40 | is.close(); 41 | } catch (IOException e) { 42 | e.printStackTrace(); 43 | } 44 | } 45 | } 46 | 47 | public static void copyDirectoryFromAssets(Context appCtx, String srcDir, String dstDir) { 48 | if (srcDir.isEmpty() || dstDir.isEmpty()) { 49 | return; 50 | } 51 | try { 52 | if (!new File(dstDir).exists()) { 53 | new File(dstDir).mkdirs(); 54 | } 55 | for (String fileName : appCtx.getAssets().list(srcDir)) { 56 | String srcSubPath = srcDir + File.separator + fileName; 57 | String dstSubPath = dstDir + File.separator + fileName; 58 | if (new File(srcSubPath).isDirectory()) { 59 | copyDirectoryFromAssets(appCtx, srcSubPath, dstSubPath); 60 | } else { 61 | copyFileFromAssets(appCtx, srcSubPath, dstSubPath); 62 | } 63 | } 64 | } catch (Exception e) { 65 | e.printStackTrace(); 66 | } 67 | } 68 | 69 | 70 | public static String getSDCardDirectory() { 71 | return Environment.getExternalStorageDirectory().getAbsolutePath(); 72 | } 73 | 74 | public static void rawToWave(String file, float[] data, int samplerate) throws IOException { 75 | // creating the empty wav file. 76 | File waveFile = new File(file); 77 | waveFile.createNewFile(); 78 | //following block is converting raw to wav. 79 | DataOutputStream output = null; 80 | try { 81 | output = new DataOutputStream(new FileOutputStream(waveFile)); 82 | // WAVE header 83 | // chunk id 84 | writeString(output, "RIFF"); 85 | // chunk size 86 | writeInt(output, 36 + data.length * 2); 87 | // format 88 | writeString(output, "WAVE"); 89 | // subchunk 1 id 90 | writeString(output, "fmt "); 91 | // subchunk 1 size 92 | writeInt(output, 16); 93 | // audio format (1 = PCM) 94 | writeShort(output, (short) 1); 95 | // number of channels 96 | writeShort(output, (short) 1); 97 | // sample rate 98 | writeInt(output, samplerate); 99 | // byte rate 100 | writeInt(output, samplerate * 2); 101 | // block align 102 | writeShort(output, (short) 2); 103 | // bits per sample 104 | writeShort(output, (short) 16); 105 | // subchunk 2 id 106 | writeString(output, "data"); 107 | // subchunk 2 size 108 | writeInt(output, data.length * 2); 109 | short[] short_data = FloatArray2ShortArray(data); 110 | for (int i = 0; i < short_data.length; i++) { 111 | writeShort(output, short_data[i]); 112 | } 113 | } finally { 114 | if (output != null) { 115 | output.close(); 116 | } 117 | } 118 | } 119 | 120 | private static void writeInt(final DataOutputStream output, final int value) throws IOException { 121 | output.write(value); 122 | output.write(value >> 8); 123 | output.write(value >> 16); 124 | output.write(value >> 24); 125 | } 126 | 127 | private static void writeShort(final DataOutputStream output, final short value) throws IOException { 128 | output.write(value); 129 | output.write(value >> 8); 130 | } 131 | 132 | private static void writeString(final DataOutputStream output, final String value) throws IOException { 133 | for (int i = 0; i < value.length(); i++) { 134 | output.write(value.charAt(i)); 135 | } 136 | } 137 | 138 | public static short[] FloatArray2ShortArray(float[] values) { 139 | float mmax = (float) 0.01; 140 | short[] ret = new short[values.length]; 141 | 142 | for (int i = 0; i < values.length; i++) { 143 | if (abs(values[i]) > mmax) { 144 | mmax = abs(values[i]); 145 | } 146 | } 147 | 148 | for (int i = 0; i < values.length; i++) { 149 | values[i] = values[i] * (32767 / mmax); 150 | ret[i] = (short) (values[i]); 151 | } 152 | return ret; 153 | } 154 | 155 | } 156 | -------------------------------------------------------------------------------- /app/src/main/res/drawable/button_drawable.xml: -------------------------------------------------------------------------------- 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | -------------------------------------------------------------------------------- /app/src/main/res/drawable/logo.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yt605155624/TTSAndroid/66f4decb697d9e9c32c5d2ecd9b1703d7dd94abd/app/src/main/res/drawable/logo.jpg -------------------------------------------------------------------------------- /app/src/main/res/drawable/paddlespeech_logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/yt605155624/TTSAndroid/66f4decb697d9e9c32c5d2ecd9b1703d7dd94abd/app/src/main/res/drawable/paddlespeech_logo.png -------------------------------------------------------------------------------- /app/src/main/res/layout/activity_main.xml: -------------------------------------------------------------------------------- 1 | 2 | 7 | 8 | 11 | 12 | 18 | 19 | 27 | 28 | 42 | 43 | 49 | 50 | 65 | 66 | 73 | 74 |