└── README.md /README.md: -------------------------------------------------------------------------------- 1 | # Reproducible-Bayesian-Tensor/Matrix-Machine-Learning-SOTA 2 | 3 | Collection of state-of-the-art and reproducible Bayesian tensor/matrix machine learning works. 4 | 5 | - This list is maintained by: 6 | Zhongtao Chen, Le Xu, Yangge Chen, Lei Cheng [\[Website\]](https://person.zju.edu.cn/leicheng#0), and Yik-Chung Wu [\[Website\]](https://www.eee.hku.hk/~ycwu/). 7 | 8 | 9 | ## Bayesian Tensor Canonical Polyadic Decomposition (CPD) 10 | 11 | - Flexible Sparsity-Aware Bayesian Tensor CPD using GH prior [\[Code\]](https://github.com/leicheng-tensor/pcpd_gh) [\[PDF\]](https://ieeexplore.ieee.org/document/9747988) 12 | - Reference: Lei Cheng, Zhongtao Chen, Qingjiang Shi, Yik-Chung Wu, and Sergios Theodoridis, "Towards Flexible Sparsity-Aware Modeling: Automatic Tensor Rank Learning using The Generalized Hyperbolic Prior," _IEEE Trans. on Signal Processing_, 2022. 13 | 14 | - Accelerated Bayesian Tensor CPD With Nonnegative Factors [\[Code\]](https://github.com/leicheng-tensor/fast_pncpd) 15 | - Reference: Zhongtao Chen, Lei Cheng, and Yik-Chung Wu, "Accelerating Probabilistic Tensor Canonical Polyadic Decomposition With Nonnegative Factors: An Inexact BCD Approach," _Signal Processing_, 2023. 16 | 17 | - Bayesian Tensor CPD with Nonnegative Factors [\[Code\]](https://github.com/leicheng-tensor/pncpd) [\[PDF\]](https://ieeexplore.ieee.org/document/9006902) 18 | - Reference: Lei Cheng, Xueke Tong, Shuai Wang, Yik-Chung Wu, and H. Vincent Poor, "Learning Nonnegative Factors from Tensor Data: Probabilistic Modeling and Inference Algorithm," _IEEE Trans. on Signal Processing_, vol. 68, pp. 1792-1806, 2020. 19 | 20 | - Bayesian Robust Streaming CPD and Completion [\[Code\]](https://github.com/colehawkins/Robust-Streaming-Tensor-Factorization) [\[PDF\]](https://ieeexplore.ieee.org/document/8595009) 21 | - Reference: Z. Zhang and C. Hawkins, "Variational Bayesian Inference for Robust Streaming Tensor Factorization and Completion," _2018 IEEE International Conference on Data Mining (ICDM)_, 2018, pp. 1446-1451 22 | 23 | - Bayesian Tensor CPD with Orthogonal Factors [\[Code\]](https://github.com/leicheng-tensor/pcpd-orthogonal-) [\[PDF\]](https://ieeexplore.ieee.org/document/7555316/) 24 | - Reference: Lei Cheng, Yik-Chung Wu, and H. Vincent Poor, "Probabilistic Tensor Canonical Polyadic Decomposition With Orthogonal Factors," _IEEE Trans. on Signal Processing_, Vol. 65, no. 3, pp. 663-676, 2017. 25 | 26 | - Bayesian Robust Tesor CPD using Gaussian-Gamma Prior [\[Code\]](https://github.com/qbzhao/BRTF) [\[PDF\]](https://ieeexplore.ieee.org/document/7120147) 27 | 28 | - Reference: Q. Zhao, G. Zhou, L. Zhang, A. Cichocki and S. -I. Amari, "Bayesian Robust Tensor Factorization for Incomplete Multiway Data," _IEEE Trans. on Neural Networks and Learning Systems_, vol. 27, no. 4, pp. 736-748, 2016. 29 | 30 | - Bayesian Tensor CPD using Gaussian-Gamma Prior [\[Code\]](https://github.com/qbzhao/BCPF) [\[PDF\]](https://ieeexplore.ieee.org/document/7010937) 31 | 32 | - Reference: Q. Zhao, L. Zhang and A. Cichocki, "Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination," _IEEE Trans. on Pattern Analysis and Machine Intelligence_, vol. 37, no. 9, pp. 1751-1763, 2015. 33 | 34 | ## Bayesian Tucker Decomposition 35 | 36 | - Bayesian Tensor Tucker Completion With a Flexible Core [\[Code\]](https://github.com/leicheng-tensor/BFCTC/tree/main) [\[PDF\]](https://ieeexplore.ieee.org/document/10305542) 37 | - Reference: Xueke Tong, Lei Cheng, and Yik-Chung Wu, “Bayesian Tensor Tucker Completion With A Flexible Core,” _IEEE Trans. on Signal Processing_, 2023. 38 | 39 | ## Bayesian Tensor Train Decomposition 40 | 41 | - Bayesian Tensor Train Decomposition [\[Code\]](https://github.com/xumaomao94/PTTC) [\[PDF\]](https://ieeexplore.ieee.org/document/9679150) 42 | - Reference: Le Xu, Lei Cheng, Ngai Wong, and Yik-Chung Wu, "Overfitting Avoidance in Tensor Train Factorization and Completion: Prior Analysis and Inference," _2021 IEEE International Conference on Data Mining (ICDM)_, 2021, pp. 1439-1444. 43 | 44 | - Bayesian Tensor Train Decomposition Based Neural Network Compression [\[Code\]](https://github.com/colehawkins/bayesian-tensor-rank-determination) [\[PDF\]](https://arxiv.org/abs/2010.08689) 45 | - Reference: C. Hawkins, X. Liu and Z.Zhang, "Towards compact neural networks via end-to-end training: a Bayesian tensor approach with automatic rank determination," _SIAM Journal on Mathematics of Data Science_, vol. 4, no. 1, pp. 46-71, Jan. 2022. 46 | 47 | 48 | ## Bayesian Tensor Ring Decompositon 49 | - Bayesian Tensor Ring Decompositon [\[Code\]](https://github.com/yipengliu/bayesian_tensor_ring) [\[PDF\]](https://ieeexplore.ieee.org/document/9369109) 50 | - Reference: Z. Long, C. Zhu, J. Liu and Y. Liu, "Bayesian Low Rank Tensor Ring for Image Recovery," in _IEEE Trans. on Image Processing_, vol. 30, pp. 3568-3580, 2021. 51 | 52 | ## Bayesian Tensor t-SVD 53 | - Bayesian tensor t-SVD [\[Code\]](https://github.com/yangzhou12/BTRTF) [\[PDF\]](https://ieeexplore.ieee.org/document/8740980/media) 54 | - Reference: Y. Zhou and Y. -M. Cheung, "Bayesian Low-Tubal-Rank Robust Tensor Factorization with Multi-Rank Determination," _IEEE Trans. on Pattern Analysis and Machine Intelligence_, vol. 43, no. 1, pp. 62-76, 2021. 55 | 56 | 57 | ## Graph-Aided Bayesian Matrix Completion 58 | - Bayesian Matrix Completion With Graphs [\[Code\]](https://github.com/leicheng-tensor/BMCG) [\[PDF\]](https://arxiv.org/abs/2203.10044) 59 | - Reference: Yangge Chen, Lei Cheng#, and Yik-Chung Wu, 'Bayesian Low-rank Matrix Completion with Dual-graph Embedding: Prior Analysis and Tuning-free Inference', arXiv preprint arXiv:2203.10044. 60 | --------------------------------------------------------------------------------