├── .gitignore ├── LICENSE ├── NOTICES ├── README.md ├── accelerate_configs ├── ddp_config.yaml ├── deepspeed_zero2_config.yaml ├── deepspeed_zero2_config_test.yaml ├── deepspeed_zero2_offload_config.yaml ├── deepspeed_zero3_config.yaml ├── deepspeed_zero3_offload_config.yaml ├── default_config.yaml ├── multi_node_example.yaml ├── multi_node_example_by_ddp.yaml ├── zero2.json ├── zero2_npu.json ├── zero2_offload.json ├── zero3.json └── zero3_offload.json ├── assets ├── Gen_Arch.pdf ├── figure2.pdf └── teaser.jpg ├── bae ├── ae_model.py ├── bnl.py ├── llama_attn.py ├── resize_layers.py └── transformer_df.py ├── configs ├── ar_config.py ├── bae_config.py └── diff_config.py ├── models ├── ar_model.py ├── diff_model.py └── llama_attn.py ├── requirements.txt ├── scripts ├── train_ar.py └── train_diff.py ├── test_ar.py ├── test_diff.py └── utils ├── config_utils.py ├── data_filtering.py ├── imagenet_label.json ├── lr_scheduler.py ├── misc.py └── training_utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/LICENSE -------------------------------------------------------------------------------- /NOTICES: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/NOTICES -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/README.md -------------------------------------------------------------------------------- /accelerate_configs/ddp_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/ddp_config.yaml -------------------------------------------------------------------------------- /accelerate_configs/deepspeed_zero2_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/deepspeed_zero2_config.yaml -------------------------------------------------------------------------------- /accelerate_configs/deepspeed_zero2_config_test.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/deepspeed_zero2_config_test.yaml -------------------------------------------------------------------------------- /accelerate_configs/deepspeed_zero2_offload_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/deepspeed_zero2_offload_config.yaml -------------------------------------------------------------------------------- /accelerate_configs/deepspeed_zero3_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/deepspeed_zero3_config.yaml -------------------------------------------------------------------------------- /accelerate_configs/deepspeed_zero3_offload_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/deepspeed_zero3_offload_config.yaml -------------------------------------------------------------------------------- /accelerate_configs/default_config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/default_config.yaml -------------------------------------------------------------------------------- /accelerate_configs/multi_node_example.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/multi_node_example.yaml -------------------------------------------------------------------------------- /accelerate_configs/multi_node_example_by_ddp.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/multi_node_example_by_ddp.yaml -------------------------------------------------------------------------------- /accelerate_configs/zero2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/zero2.json -------------------------------------------------------------------------------- /accelerate_configs/zero2_npu.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/zero2_npu.json -------------------------------------------------------------------------------- /accelerate_configs/zero2_offload.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/zero2_offload.json -------------------------------------------------------------------------------- /accelerate_configs/zero3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/zero3.json -------------------------------------------------------------------------------- /accelerate_configs/zero3_offload.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/accelerate_configs/zero3_offload.json -------------------------------------------------------------------------------- /assets/Gen_Arch.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/assets/Gen_Arch.pdf -------------------------------------------------------------------------------- /assets/figure2.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/assets/figure2.pdf -------------------------------------------------------------------------------- /assets/teaser.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/assets/teaser.jpg -------------------------------------------------------------------------------- /bae/ae_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/bae/ae_model.py -------------------------------------------------------------------------------- /bae/bnl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/bae/bnl.py -------------------------------------------------------------------------------- /bae/llama_attn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/bae/llama_attn.py -------------------------------------------------------------------------------- /bae/resize_layers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/bae/resize_layers.py -------------------------------------------------------------------------------- /bae/transformer_df.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/bae/transformer_df.py -------------------------------------------------------------------------------- /configs/ar_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/configs/ar_config.py -------------------------------------------------------------------------------- /configs/bae_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/configs/bae_config.py -------------------------------------------------------------------------------- /configs/diff_config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/configs/diff_config.py -------------------------------------------------------------------------------- /models/ar_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/models/ar_model.py -------------------------------------------------------------------------------- /models/diff_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/models/diff_model.py -------------------------------------------------------------------------------- /models/llama_attn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/models/llama_attn.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/requirements.txt -------------------------------------------------------------------------------- /scripts/train_ar.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/scripts/train_ar.py -------------------------------------------------------------------------------- /scripts/train_diff.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/scripts/train_diff.py -------------------------------------------------------------------------------- /test_ar.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/test_ar.py -------------------------------------------------------------------------------- /test_diff.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/test_diff.py -------------------------------------------------------------------------------- /utils/config_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/utils/config_utils.py -------------------------------------------------------------------------------- /utils/data_filtering.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/utils/data_filtering.py -------------------------------------------------------------------------------- /utils/imagenet_label.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/utils/imagenet_label.json -------------------------------------------------------------------------------- /utils/lr_scheduler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/utils/lr_scheduler.py -------------------------------------------------------------------------------- /utils/misc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/utils/misc.py -------------------------------------------------------------------------------- /utils/training_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AMD-AGI/Instella-T2I/HEAD/utils/training_utils.py --------------------------------------------------------------------------------