├── README.md └── materials └── README.md /README.md: -------------------------------------------------------------------------------- 1 | # OpenSemanticComm 2 | 3 | This repository organizes open source code in the field of semantic communication. 4 | 5 | Give this project a star if you find it useful — it helps others discover the repo! And don't forget to watch for updates 6 | 7 | Besides, warmly invite you to contribute to this repository by sharing your open-source code through pull requests. Additionally, if you have conference presentations (PPTs), recordings, or any other materials that you think could be valuable to others, feel free to share them to the `\materials` folder. 8 | 9 | Any question or cooperation, feel free to contact me at yangxiao241@mails.ucas.ac.cn 10 | | Title | Source | code | 11 | | --- | --- | --- | 12 | | [Content Adaptive Distributed Joint Source-Channel Coding for Image Transmission With Hyperprior](https://ieeexplore.ieee.org/document/10623367) | TCCN 2025 | [Official code](https://github.com/listen06/DHF-JSCC) | 13 | | [SQ-GAN: Semantic Image Communications Using Masked Vector Quantization](https://arxiv.org/pdf/2502.09520) | Arxiv | [Official code](https://github.com/frapez1/SQ-GAN) | 14 | | [Contrastive Learning and Adversarial Disentanglement for Privacy-Preserving Task-Oriented Semantic Communications](https://arxiv.org/abs/2410.22784) | ArXiv | [Official Version](https://github.com/OmarErak/CLAD) | 15 | | [Compression Ratio Learning and Semantic Communications for Video Imaging](https://ieeexplore.ieee.org/abstract/document/10539255) | JSTSP 2024 | [Official Version](https://github.com/Bowen-zhang96/CRL-SemCom-VidCI) | 16 | | [CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communications](https://ieeexplore.ieee.org/document/10480348) | TWC 2024 | [Official Version](https://github.com/Wireless3C-SJTU/CDDM-channel-denoising-diffusion-model-for-semantic-communication) | 17 | | [Reasoning Over the Air: A Reasoning- Based Implicit Semantic-Aware Communication Framework](https://ieeexplore.ieee.org/document/10250170) | TWC 2024 | [Official Version](https://github.com/Yiwei-Liao/iSAC) | 18 | | [Joint Coding-Modulation for Digital Semantic Communications via Variational Autoencoder](https://arxiv.org/pdf/2310.06690) | TCOMM 2024 | [Official Version](https://github.com/SJTU-mxtao/Joint-Coding-Modulation-for-Digital-Semantic-Communication) | 19 | | [A Unified Multi-Task Semantic Communication System for Multimodal Data](https://ieeexplore.ieee.org/abstract/document/10431795) | TCOMM 2024 | [Official Version](https://github.com/zhang-guangyi/t-udeepsc) | 20 | | [Swinjscc: Taming swin transformer for deep joint source-channel coding](https://arxiv.org/abs/2308.09361) | TCCN 2024 | [Official Version](https://github.com/semcomm/SwinJSCC) | 21 | | [Two-way semantic communications without feedback](https://ieeexplore.ieee.org/abstract/document/10400867) | TVT 2024 | [Official Version](https://github.com/Kiven-ykw/TW-SemanticComm) | 22 | | [GenSC: Generative Semantic Communication Systems Using BART-Like Model](https://ieeexplore.ieee.org/document/10648817) | COMML 2024 | [official version](https://github.com/minkuanc-WMC/gensc) | 23 | | [Diffusion Models for Audio Semantic Communication](https://ieeexplore.ieee.org/document/10447612) | ICASSP 2024 | [Official Version](https://github.com/ispamm/DM4ASC) | 24 | | [Extreme Video Compression With Prediction Using Pre-trainded Diffusion Models](https://arxiv.org/abs/2402.08934) | WCSP 2024 | [Official Version](https://github.com/ElesionKyrie/Extreme-Video-Compression-With-Prediction-Using-Pre-trainded-Diffusion-Models-) | 25 | | [Distributed Deep Joint Source-Channel Coding with Decoder-Only Side Information](https://arxiv.org/abs/2310.04311) | ICMLCN 2024 | [Official Version](https://github.com/ipc-lab/deepjscc-wz) | 26 | | Wireless Image Semantic Cooperative Transmission in Distributed Edge Networks: An Information Disentanglement Method | SPAWC 2024 | [Official Version](https://github.com/Donghong-Cai/Two-view-DC-DeepJSCC-D) | 27 | | [Digital Semantic Communications: An Alternating Multi-Phase Training Strategy with Mask Attack](https://arxiv.org/pdf/2408.04972) | ArXiv | [Official Version](https://github.com/gmzSZU/AMP-SC) | 28 | | [Language-Oriented Semantic Latent Representation for Image Transmission](https://arxiv.org/abs/2405.09976) | ArXiv | [Official Version](https://github.com/ispamm/Img2Img-SC/) | 29 | | [Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission](https://arxiv.org/abs/2404.17736) | ArXiv | [Official Version](https://github.com/mingyuyng/DiffJSCC) | 30 | | [Deep Learning-Based Adaptive Joint Source-Channel Coding using Hypernetworks](https://arxiv.org/abs/2401.11155) | ArXiv | [Official Version](https://github.com/SongjieXie/Hyper-AJSCC) | 31 | | [Semantic Communications With Variable-Length Coding for Extended Reality](https://ieeexplore.ieee.org/document/10198383) | JSTSP 2023 | [Official Version](https://github.com/Bowen-zhang96/VL-SCC) | 32 | | [Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication](https://ieeexplore.ieee.org/abstract/document/10015684) | TWC 2023 | [Official Version](https://github.com/wyzhang-ustb/Predictive-and-Adaptive-Deep-Coding-for-Wireless-Image-Transmission-in-Semantic-Communication) | 33 | | [Robust Semantic Communications With Masked VQ-VAE Enabled Codebook](https://ieeexplore.ieee.org/document/10101778) | TWC 2023 | [Official Version](https://github.com/hqyyqh888/RobustSemanComm) | 34 | | [Knowledge Enhanced Semantic Communication Receiver](https://ieeexplore.ieee.org/abstract/document/10122227) | COMML 2023 | [Official Version](https://github.com/ZJUNICE/Knowledge-Enhanced-SemCom) | 35 | | [Alleviating Distortion Accumulation in Multi-Hop Semantic Communication](https://ieeexplore.ieee.org/abstract/document/10345598) | COMML 2023 | [Official Version](https://github.com/ZJU-IICNS-AICOMM/Multihop-DeepSC) | 36 | | [Distributed Deep Joint Source-Channel Coding over a Multiple Access Channel](https://arxiv.org/pdf/2211.09920) | ICC 2023 | [Official Version](https://github.com/ipc-lab/deepjscc-noma) | 37 | | [DeepJSCC-1++: Robust and Bandwidth-Adaptive Wireless Image Transmission](https://ieeexplore.ieee.org/document/10436878) | Globecom 2023 | [Official Version](https://github.com/aprilbian/deepjscc-lplusplus) | 38 | | [Alternate Learning based Sparse Semantic Communications for Visual Transmission](https://ieeexplore.ieee.org/abstract/document/10293971) | PIMRC 2023 | [Official Version](https://github.com/ZJUNICE/SparseSBC) | 39 | | [WITT: A WIRELESS IMAGE TRANSMISSION TRANSFORMER FOR SEMANTIC COMMUNICATIONS](https://arxiv.org/pdf/2211.00937) | ICASSP 2023 | [Official Version](https://github.com/KeYang8/WITT) | 40 | | [Space-Time Design for Deep Joint Source Channel Coding of Images over MIMO Channels](https://ieeexplore.ieee.org/document/10304536) | SPAWC 2023 | [Official Version](https://github.com/aprilbian/ST_JSCC) | 41 | | [On the role of ViT and CNN in semantic communications: Analysis and prototype validation](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10171356) | IEEE Access 2023 | [Official Version](https://github.com/kmsiapps/Semantic-Communications-with-a-Vision-Transformer) | 42 | | [Deep Learning Enabled Video Semantic Transmission Against Multi-dimensional Noise](https://ieeexplore.ieee.org/abstract/document/10464432) | Globecom Workshops 2023 | [Official Version](https://github.com/hwniu/DVSC) | 43 | | [Alleviating Distortion Accumulation in Multi-Hop Semantic Communication](https://arxiv.org/pdf/2308.11126) | ArXiv | [Official Version](https://github.com/ZJU-IICNS-AICOMM/Multihop-DeepSC) | 44 | | [Large AI Model-Based Semantic Communications](https://arxiv.org/abs/2307.03492) | ArXiv | [Official Version](https://github.com/jiangfeibo/LAMSC) | 45 | | [Generative Semantic Communication: Diffusion Models Beyond Bit Recovery](https://arxiv.org/pdf/2306.04321v1) | ArXiv | [Official Version](https://github.com/ispamm/GESCO) | 46 | | [Semantic-Functional Communications in Cyber-Physical Systems](https://arxiv.org/pdf/2305.19710) | ArXiv | [Official Version](https://github.com/pedrogoria/Semantic-Functional-Communications) | 47 | | [Deep Learning-Enabled Semantic Communication Systems with Task-Unaware Transmitter and Dynamic Data](https://arxiv.org/pdf/2205.00271) | JSAC 2022 | [Official Version](https://github.com/SJTU-mxtao/Semantic-Communication-Systems) | 48 | | [Nonlinear Transform Source-Channel Coding for Semantic Communications](https://arxiv.org/abs/2112.10961) | JSAC 2022 | [Official Version](https://github.com/wsxtyrdd/NTSCC_JSAC22) | 49 | | [OFDM-guided deep joint source channel coding for wireless multipath fading channels](https://arxiv.org/abs/2109.05194) | TCCN 2022 | [Official Version](https://github.com/mingyuyng/OFDM-guided-JSCC) | 50 | | [Adaptive bit rate control in semantic communication with incremental knowledge-based HARQ](https://ieeexplore.ieee.org/abstract/document/9827978) | OJCOMS 2022 | [Official Version](https://github.com/ZJUNICE/Semantic-Communication-IK-HARQ) | 51 | | [Resource Allocation for Text Semantic Communications](https://ieeexplore.ieee.org/document/9763856) | WCL 2022 | [Official Version](https://github.com/YL12345/semantic-resource-allocation-S-SE-) | 52 | | [Semantic Communications with Discrete-time Analog Transmission: A PAPR Perspective](https://arxiv.org/abs/2208.08342) | WCL 2022 | [Official Version](https://github.com/lynshao/SemanticPAPR) | 53 | | [QoE-aware resource allocation for semantic communication networks](https://ieeexplore.ieee.org/abstract/document/10001594) | Globecom 2022 | [Official Version](https://github.com/YL12345/QoE-Aware-Resource-Allocation-for-Semantic-Communication-Networks) | 54 | | [Perceptual Learned Source-Channel Coding for High-Fidelity Image Semantic Transmission](https://ieeexplore.ieee.org/abstract/document/10001359) | Globecom 2022 | [Official Version](https://github.com/semcomm/GC2022_Perceptual_Learned_Source_Channel_Coding) | 55 | | [Deep joint source-channel coding for wireless image transmission with adaptive rate control](https://arxiv.org/pdf/2110.04456) | ICASSP 2022 | [Official Version](https://github.com/mingyuyng/Dynamic_JSCC) | 56 | | [Real-time semantic communications with a vision transformer](https://arxiv.org/pdf/2205.03886) | ICC Workshops 2022 | [Official Version](https://github.com/kmsiapps/e2e-dnn-comm-for-image) | 57 | | [Deep Joint Source-Channel Coding Over Cooperative Relay Networks](https://arxiv.org/pdf/2211.06705) | ArXiv | [Official Version](https://github.com/aprilbian/Relay_JSCC) | 58 | | [Semantic Communication Systems for Speech Transmission](https://ieeexplore.ieee.org/abstract/document/9450827) | JSAC 2021 | [Official Version](https://github.com/Zhenzi-Weng/DeepSC-S) | 59 | | [Deep Learning Enabled Semantic Communication Systems](https://ieeexplore.ieee.org/abstract/document/9398576) | TSP 2021 | [Official Version](https://github.com/HQXie0910/The-implementations-of-DeepSC); [PyTorch Version](https://github.com/13274086/DeepSC) | 60 | | [Wireless Image Transmission Using Deep Source Channel Coding With Attention Modules](https://ieeexplore.ieee.org/abstract/document/9438648) | TCSVT 2021 | [Official Version](https://github.com/alexxu1988/ADJSCC) | 61 | | [Deep joint source channel coding for wireless image transmission with OFDM](https://ieeexplore.ieee.org/abstract/document/9500996) | ICC 2021 | [Official Version](https://github.com/mingyuyng/Deep-JSCC-for-images-with-OFDM) | 62 | | [Reinforcement Learning-powered Semantic Communication via Semantic Similarity](https://arxiv.org/abs/2108.12121) | ArXiv | [Official Version](https://github.com/ZJUNICE/SemanticRL) | 63 | | [DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedback](https://arxiv.org/pdf/1911.11174) | JSAIT 2020 | [Official Version](https://github.com/ipc-lab/deepJSCC-feedback) | 64 | 65 | ## Acknowlegaements 66 | Thanks to the original authors of this open-source code for their valuable contributions to the community. 67 | -------------------------------------------------------------------------------- /materials/README.md: -------------------------------------------------------------------------------- 1 | For clarity, please follow the naming convention "ConferenceName_SpeakerName." --------------------------------------------------------------------------------